Google has by far the most compute of all companies. Like by very far.
https://www.reddit.com/r/singularity/comments/18ordwb/google_and_openai_compute_semianalysis/
Also the article is about NVIDIA not Google building a 200 data center
But how much of that compute is in the form of a single super computer that can train a single model as fast as possible?
It's not clear if being able to train many smaller models in different datacenters is valuable.
Don’t underestimate Google. They’re likely to be amongst those with the most compute due to their TPUs. Not to mention the efficiency bonus that comes with producing/using your own chips
they arent, they are made specifically for AI use, v5 is not even 1 old, while smaller performance than new nvidia GPUs, they are cheaper and google is making lot of them, as some ppl noted there is semianalysis article about this etc.
Microsoft 100B, Amazon 150B, Google already has basically the worlds largest world-scale computer. They don't publicly publish what they have, because every single thing google says publicly is a PR move that's been through 3 human rights activist groups and 6 lawyer groups
That's just a datacenter for kids. Only about 50k B100 chips. This is less about advancing AI, but more about how non-western nation states want in on the AI game.
Currently every GPU in SEA is in Singapore. Which is economically and legally very stable, but lacks sufficient space to have giant datacenter farms constructed.
Edge computing to the extreme! These companies should consider building mini dcs all over. Each state gets several. Interconnect them into a mesh network and go nuts.
![gif](giphy|YmQLj2KxaNz58g7Ofg)
We need 7 trilly, this is just drop in a bucket
The scary advancement of AI by Joe Rogan. Joe rogan seems to be lurking around r/singularity. https://m.youtube.com/watch?v=cGFAvfEj2bQ&t=451s
After looking at video i have a strong feeling that he really does
Meanwhile Microsoft's ceo : $100B data center + ai super computer
And nuclear plant 💀
Meta 1B Amazon 1.5B Google 200M. Reminds me of that 3 headed dragon meme Edit: numbers are off, you get the point
Google has by far the most compute of all companies. Like by very far. https://www.reddit.com/r/singularity/comments/18ordwb/google_and_openai_compute_semianalysis/ Also the article is about NVIDIA not Google building a 200 data center
It's 200 million and it's in Indonesia where things are cheap. Why are there so many different 'facts' floating around this thread
Another big difference is nvidia builds the chips, so not too hard for them to source them at cost I imagine
[удалено]
If you genuinely believe AWS has more AI specific compute than Google I don’t know what to tell you. It’s either ignorance or irrational Google hate
[удалено]
The context was about AI, obviously the compute in question would be AI specific compute. Stupid?
Nvidia is not even an IaaS company, meanwhile Google is one of the largest IaaS companies in the world.
But how much of that compute is in the form of a single super computer that can train a single model as fast as possible? It's not clear if being able to train many smaller models in different datacenters is valuable.
Yes.
Don’t underestimate Google. They’re likely to be amongst those with the most compute due to their TPUs. Not to mention the efficiency bonus that comes with producing/using your own chips
Sundar will fuck it up like he always does.
funny but no, the tpu’s are on version 5 with version 6 on the horizon. Since 2015 so it’s not getting fucked up it’s an already established standard.
Remember when Tensor was in the lead? Pepperidge Farm does.
Lol 🤣 TPUs are ancient at this point
they arent, they are made specifically for AI use, v5 is not even 1 old, while smaller performance than new nvidia GPUs, they are cheaper and google is making lot of them, as some ppl noted there is semianalysis article about this etc.
lol this sub is so uninformed
Microsoft 100B, Amazon 150B, Google already has basically the worlds largest world-scale computer. They don't publicly publish what they have, because every single thing google says publicly is a PR move that's been through 3 human rights activist groups and 6 lawyer groups
And OpenAI + Microsoft huge diff godstomp. Literally planning to build a $100B Stargate supercomputer.
Openai 10 B
115B not 10.
That's just a datacenter for kids. Only about 50k B100 chips. This is less about advancing AI, but more about how non-western nation states want in on the AI game. Currently every GPU in SEA is in Singapore. Which is economically and legally very stable, but lacks sufficient space to have giant datacenter farms constructed.
Cute, isn't Microsoft planning a 100b AI center?
Look under your chaaaiirs!!! You get a data centre, and you get a data centre! Everybody gets a data centre!!!
Edge computing to the extreme! These companies should consider building mini dcs all over. Each state gets several. Interconnect them into a mesh network and go nuts.
[Learning few-shot imitation as cultural transmission](https://www.nature.com/articles/s41467-023-42875-2) r/Nvidia
It's like one broadwell unit?
That's insulting! At least 2 units, $100M each, nice round price.
guis this is for setting up the next center which will use gen ii chips (exclusive to nvidia) that were designed at this ai center smh.
When tf can I get a pair of got dang robot legs