OpenAI CEO Sam Altman has data centers full of memory, but seemingly it’s the 32GB of RAM in your desktop that’s the problem. In an interview over beers with the YouTube channel Cheeky Pint, Altman said that local inference, and, by extension, people having DRAM in computers at home, is “quite terrible.”
Go deeper with TH Premium: AI and data centers
(Image credit: Microsoft)
When discussing local inference on home computers with open-source models, Altman discussed the assumption that people will be able to run local AI on their own computers, the ones they may already own or want to build. Then he explained why that’s a bad idea (at the 29-minute mark):