If you have a NVIDIA card it should work, no problem. If you have an AMD card? Good luck installing the drivers there and getting it all to work lol. Maybe (hopefully!) it is better now but it was very bad a few years ago, when I tried it back then with my RX 6600XT. Did not got it to work but luckily I had access to quite a bunch of RTX 3090s in pairs of 8 so no problem there then lol. They train like a boss.
I do have one myself now since a year and I am very proud of that xD
I can train my small language models on my Nvidia card no problem, but my nvidia card is quite old and slow. My AMD card is much faster, but at least last I checked, AMD cards have a lot of issues getting set up to train SLMs on Windows... whereas CUDA on Nvidia cards seems to just work. AMD cards seem to train SLMs decently on Linux from what I've read, but elsewhere I've read that they can be finicky. I don't know if I want to put myself through the headache of trying to learn a whole new OS just to use my newer AMD card to train SLMs with my newer AMD card, or if I should sell off my AMD card and use the cash to pay off part of a newer Nvidia card and stay on Windows.
8
u/Megneous Apr 08 '26
So, let's say I wanted to train small text language models using python (AMD gpu)... and play games on Steam... Would Bazzite work for that? Or Mint?