en
Free
Sophia Dew,Mario Martone

Why Real-World AI Is Harder Than the Benchmark | EliseAI’s Mario Martone

Слушать в приложении
What changes when an AI mistake doesn’t just hurt a benchmark score, but affects someone’s housing or healthcare? EliseAI Head of Applied Research Mario Martone argues that deploying AI in essential industries requires a very different standard of reliability.
Mario joins MTS to explain how EliseAI handles roughly 5 million phone calls a month, why LLMs aren’t the right solution for every problem, and how the team combines language models, traditional machine learning, neural networks, and internally built evaluations to decide what actually works in production.
Drawing on 15 years studying theoretical physics, Mario also explains how the scientific method shapes EliseAI’s research culture, from testing new models against its own benchmarks to fine-tuning open-source models and automating increasingly complex workflows across housing and healthcare. And he makes the case that applying AI to the real world can produce problems every bit as intellectually difficult as the ones he encountered studying string theory.
0:24:25
Издательство
a16z
Серия
a16z
Год выхода издания
2026
Уже прочитали? Что скажете?
👍👎
fb2epub
Перетащите файлы сюда, не более 5 за один раз