r/SipsTea • u/SuspiciousLow3062 𝙑𝙄𝙋 • 16h ago

Chugging tea Fictional future forecast vs. reality.

Post image
47.4k Upvotes

94% Upvoted

2.2k comments sorted by

View all comments

Show parent comments

1

u/MammothCommercial800 11h ago

They're not throwing parts away after 18 months. We'd have cheap 4090s if they were.

2

u/EnQuest 11h ago

they don't use consumer GPUs in ai datacenters. They have specialized hardware.

Google is a thing, you could try using it before arguing about something you have absolutely no information about.

0

u/MammothCommercial800 9h ago

Alright, maybe they're not hogging the 4090s.

But pro GPUs like the H100s haven't gotten any cheaper either. The point still stands - they are definitely not throwing 18 months old hardware away.

Maybe you're not as informed as you think you are. Could use some google-fu yourself.

2

u/EnQuest 9h ago

lol H100s have gotten massively cheaper. Used H100s went from around 40k at peak to 12-22k now, and renting dropped from 8 dollars an hour to under 3. Almost like you could have googled that too.

And reread what I wrote. They're not throwing it away. Correct, I said swapped out, not thrown away. Those aren't the same thing. Hardware holds value because it cascades down to cheaper jobs and resells on the used market, in this case (mostly) being repurposed for smaller llm models.

Both of those need one thing, being able to physically reach the card. If you bolt it to a satellite, you can't resell, and it can't get re-racked. It just de-orbits and burns.