Chatbot Arena Leaderboard Updates (Week 8)
Introducing MT-Bench and Vicuna-33B
LMArena Team
Chatbot Arena Leaderboard Updates (Week 4)
In this update, we are excited to welcome the following models joining the Chatbot Arena:
1. Google PaLM 2, chat-tuned with the code name chat-bison@001 on Google Cloud Vertex AI
2. Anthropic Claude-instant-v1
3. MosaicML MPT-7B-chat
4. Vicuna-7B
A new Elo rating leaderboard based on the 27K anonymous voting
Chatbot Arena Leaderboard Updates (Week 2)
We release an updated leaderboard with more models and new data we collected last week, after the announcement of the anonymous Chatbot Arena. We are actively iterating on the design of the arena and leaderboard scores.
In this update, we have added 4 new yet strong players into the Arena,
Chatbot Arena
Benchmarking LLMs in the Wild with Elo Ratings