← Home
TWIML · September 17, 2026 · 1h 4m

From Voice Agents to AI Avatars with Alexander Smola - #777

Alexander Smola, co-founder and CEO of Boson AI, discusses the path from voice agents to audiovisual AI avatars. He explains why natural conversation still poses a high bar for AI, despite recent advances, and outlines the technical tradeoffs in real-time voice, including audio tokenization, latency, model size, and inference cost. Smola also explores how adding vision raises the stakes for natural interaction and why emotional intelligence is critical for avatars that feel human. The conversation covers how agents can learn from real human feedback to move beyond impressive demos toward genuinely fluid interactions.

This summary was generated from show notes and public descriptions, not from a full transcript review. Details may contain inaccuracies.

Highlights

•
Natural conversation remains a high bar for voice AI
Even state-of-the-art voice systems are easily tripped up by small delays, awkward interruptions, or misaligned tone, breaking the conversational illusion.
•
Real‑time voice forces tough engineering tradeoffs
Building agents that can hold natural conversations requires balancing audio tokenization, latency, model size, and inference cost.
•
Adding visual presence raises the stakes for natural AI interaction
When an AI agent has a visible avatar, any mismatch between speech, expression, and body language quickly breaks immersion.
•
Emotional intelligence is critical for AI avatars
Smola argues that for interactions to feel truly natural, agents need to recognize and respond to user emotions, not just transact.
•
Agents can learn from human interactions to become more natural over time
Rather than relying solely on pre-trained behavior, AI agents can improve by analyzing real conversations and user feedback.
Was this useful?