What are people doing with all the GPGPUs?

Question

I just realized that I do not understand the current "AI" craze. I understand OpenAI and ChatGPT. Amazing product, provides value, clear room for further improvement. Fine.What is everyone else trying to do? Why are they buying whole 1000 GPGPU clusters? Are all of them each trying to train their own LLMs from scratch? If not, what are they trying to do?

endisneigh · Accepted Answer

inference at scale

verdverm · Answer

- serving production inference (after training)
- self-driving (Tesla Dojo)
- computational chemistry, drug discovery, protein folding
- physics simulations
- the many things the US national labs do (https://www.scientificamerican.com/article/new-exascale-supe...)

p1esk · Answer

clear room for further improvementThat&rsquo;s your answer. It&rsquo;s hard to imagine what GPT-5 will be capable of.

What are people doing with all the GPGPUs?

inference at scale

- serving production inference (after training)- self-driving (Tesla Dojo)- computational chemistry, drug discovery, protein folding- physics simulations- the many things the US national labs do (https://www.scientificamerican.com/article/new-exascale-supe...)

clear room for further improvementThat’s your answer. It’s hard to imagine what GPT-5 will be capable of.

- serving production inference (after training)
- self-driving (Tesla Dojo)
- computational chemistry, drug discovery, protein folding
- physics simulations
- the many things the US national labs do (https://www.scientificamerican.com/article/new-exascale-supe...)

clear room for further improvement
That’s your answer. It’s hard to imagine what GPT-5 will be capable of.