Has this changed, If I want to go hands on with development using pytorch or whatever is used now, would you recommend an AMD card?
replyGenuine question, I have not followed this topic closely for years :)
Short answer, no.
replyThere are better learning resources and a better ecosystem available around Nvidia cards & software (cuda).
Long answer, it depends. It will add more challenges and require significantly more effort (even outside the GPU programming itself, debugging toolchain etc. is a somewhat separate skill). The smaller/less mature ecosystem also means you will have less examples to look at for references.
Still rocking a 3090 so can't speak from experience but general vibe around simple at home inference seems like it has improved (esp since both vulkan and rocm are now viable paths on newer cards).
reply>development using pytorch
Would probably still play it nvidia safe for more adventurous stuff than token generation even if it has improved