Yes, LLMs are trained one token at a time and produce one token at a time.

That does not mean that we understand exactly how the encode or process information within their neural networks. Even the most advanced researchers don’t claim that knowledge.

Saying “They don’t reason” without exact knowledge of what they do or a precise definition of what counts as “reasoning” isn’t very useful.

God I hate Krugman. Not that he’s wrong here but I’ll never forgive his hit pieces on Bernie Sanders.

350 million would be closer.