AU
AutoArena
AutoArena is an open-source tool designed to automate head-to-head evaluations of GenAI systems using LLM judges. It allows users to quickly and accur
Updated: 2026-08-21
Download / Access
Web N/A
Windows N/A
macOS N/A
iOS N/A
Android N/A
Huawei N/A
Linux N/A
www.autoarena.app
AU
AutoArena
AutoArena is an open-source tool designed to automate head-to-head evaluations of GenAI systems using LLM judges. It allows users to quickly and accur
Get StartedLearn More
What is AutoArena?
AutoArena is an open-source tool designed to automate head-to-head evaluations of GenAI systems using LLM judges. It allows users to quickly and accurately generate leaderboards comparing different LLMs, RAG setups, or prompt variations. Users can fine-tune custom judges to fit their specific needs. AutoArena facilitates trustworthy evaluation of LLMs, RAG systems, and generative AI applications through automated head-to-head judgement.
4.5
Rating
Free
Pricing
1+
Platforms
0
Saves
Compare with Alternatives
| Feature | AutoArena | ArXiv Pulse | Stable Attribution | Outlier AI |
|---|---|---|---|---|
| Rating | — | — | — | — |
| Pricing | Free | Free | Free | Free |
| Starting From | — | — | — | — |
| API | — | — | — | — |
| Free Tier | — | — | — | — |
| Mobile App | — | — | — | — |
Website