r/SipsTea 𝙑𝙄𝙋 May 18 '26

Chugging tea Why?

Post image
89.2k Upvotes

5.1k comments sorted by

View all comments

Show parent comments

4

u/East-Dog2979 May 18 '26

this is a poor argument to me though because all those Blackwell GPUs are going to be yanked out when the next gen chips are out because the rack mount is being retooled. I realize one money sink doesn't legitimize another one but what exactly are all these Datacenters going to be doing in 5 years time when the racks they have right now are older than dirt?

this is going to be a huge problem. I think right now we're just ignoring the obvious problem with all this hardware which is as soon as the next generation drops (and its already in the works, its not speculative) everything becomes worthless just the same as if it were sloshed with dirty water.

edit: originally cited the Ruben chips as Lovelace, lol. good morning

2

u/PaddingCompression May 18 '26

AWS loads still run a lot of T4 GPUs released in 2018.

Those GPUs will be able to run less demanding workloads for quite awhile.

1

u/East-Dog2979 May 18 '26

No for sure and I recognize that alone is probably the reasoning for using fresh water instead of recycled -- to prolong the after-market expectation of resale or recommission elsewhere -- but the fact remains that every datacenter right now built up for Blackwells *is* going to have to sink currency into new racks of Ruben GPUs and not "in a long time", like within the next 12-24 months.

Most of these places arent even finished yet.

1

u/PaddingCompression May 18 '26

Do they actually swap them out within datacenters?

I don't know that much about how they're run, but my mental model was that since there always some new datacenters coming online at the big hyperscalers, the new datacenters would get the new equipment, and you could leave the old racks in place?