lm-evaluation-harness
Framework for evaluating language models on a common set of benchmark tasks.
Find alternatives to lm-evaluation-harness
MIT licensed on the repository page. EleutherAI's own site has no product pages — its Releases page files each artifact as Library, Dataset or Model — so the repository is the tool's official home.
What it does
- Evaluation and observability
Sources
- Pricing
-
Official documentation · 23 Aug 2026
MIT licensed on the repository page. EleutherAI's own site has no product pages — its Releases page files each artifact as Library, Dataset or Model — so the repository is the tool's official home.
- Sold within
-
Official documentation · 30 Sep 2026
The repository is published under the "MIT license" and installs with "git clone --depth 1 https://github.com/EleutherAI/lm-evaluation-harness" or "pip install lm_eval[hf]". No paid offering is named.
Also from EleutherAI
-
GPT-NeoX Developer tool
Library for training large autoregressive language models on GPU clusters.
Open EleutherAI in the directory
Something wrong here? Send a correction — quote this product id: eleutherai-lm-evaluation-harness.