HACKER Q&A
📣 tikkun

What's the current status of A100/H100 supply shortages?


How big is the shortage now?

Also, what chips would you expect will be the dominant chips for training (not inference) of massive foundation models in a few years?

I saw Microsoft has teamed up with AMD to help them make some chips. And I know Jim Keller is working on it. Then there's the other things like Cerebras and such.