Jul 1
I sat down with @ml_angelopoulos to understand how @arena became the neutral judge of the AI race.
It started as a research project at UC Berkeley, with PhD students asking a simple question: are we measuring AI the right way? Today, Arena is the largest real-world AI evaluation platform in the world, reaching $100M ARR in under 8 months.
We get into:
- Why traditional AI benchmarks are fundamentally broken
- How Arena's leaderboard became the industry standard
- Agent Mode: millions of agentic traces, causal tracing
- How humans are actually using AI agents today
- From Berkeley research project to $100M ARR
FULL CONVERSATION LINKED BELOW
Arena has crossed $100M in annualized revenue run rate, eight months after launching our evaluation product.
With our recent release of Agent Mode, millions of users on Arena are doing real work with agents, from coding to document analysis, in long-running, multi-turn sessions with hundreds of tool calls. Arena now evaluates objective criteria like task completion rates, hallucination rates, and more, far beyond our original human preference voting model. This expansion has taken us from a student project at Berkeley to one of the fastest growing companies in history. Go Bears! 🐻
Our core thesis is simple: to align AI with human values, we must directly measure its impact on people in the real world. Today's milestone is proof that Arena’s platform is the de-facto standard for post-deployment evaluation of AI.
6
4
44
8,751
