← Home
TWIML · September 9, 2026 · 59m

Do AI Tokenomics Matter More Than Model Benchmarks? with Chris Potts - #776

Stanford professor and Big Spin co-founder Chris Potts joins Sam Charrington to discuss AI tokenomics and his research into “tokenflation”—the possibility that token usage is growing faster than the measurable value those tokens produce. They explore how to measure return on AI spending, why benchmarks alone give an incomplete picture, and what inference-time scaling means for the economics of increasingly capable models. Chris also shares why expert AI users get better results by challenging and iterating with models, and how AI fluency affects outcomes. The conversation covers DSPy, interpretability, the limits of today’s transformer architectures, and where Chris sees opportunities for more fundamental innovation in AI.

This summary was generated from show notes and public descriptions, not from a full transcript review. Details may contain inaccuracies.

Novel

•
Tokenflation
Chris Potts introduces the concept of tokenflation—the possibility that token usage in AI systems is growing faster than the measurable value those tokens produce.

Highlights

•
Return on AI spending
Potts and Charrington discuss how to measure the return on investment from AI spending, beyond just model benchmark scores.
•
Incomplete picture from benchmarks
Potts explains why benchmarks alone provide an incomplete view of model progress and utility.
•
Inference-time scaling economics
The episode examines what inference-time scaling means for the economics of increasingly capable models.
•
Expert users get better results through iteration
Potts shares that expert AI users achieve superior outcomes by challenging and iterating with models, not just by crafting better single prompts.
Was this useful?