Skip to content

CSVs of the Huggingface and LMArena LLM leaderboards, along with the code to generate them in Python and R.

License

Notifications You must be signed in to change notification settings

fboulnois/llm-leaderboard-csv

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

283 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

LLM Leaderboard CSVs

Generates CSVs of the LMArena Leaderboard in Python.

The latest LMArena CSVs can be downloaded from the Releases page.

Previously, CSVs were also generated for the v1 and v2 Huggingface Open LLM Leaderboard in R but this leaderboard has been retired. The latest code and versions of those CSVs is in the v1.3.0 release.

Run

Tip

Delete the csv directory before running the code if you want to recreate the CSVs using the latest data.

Run using Python

The code is in huggingface.py:

# run the code to generate the leaderboard data frames
uv run huggingface.py

Run using Docker

A Dockerfile is also provided to build and run the code using the official uv Docker image:

docker build . --tag llm-leaderboard-csv
docker run -v ./csv:/home/uv/csv --rm llm-leaderboard-csv