docs

Jun 12, 2024

6f43493 · Jun 12, 2024

This branch is 260 commits behind EleutherAI/lm-evaluation-harness:main.

Name	Name	Last commit message	Last commit date
parent directory ..
img	img	Add `description_dict` docs and update `task-guide`	Dec 17, 2021
CONTRIBUTING.md	CONTRIBUTING.md	Update installation commands in openai_completions.py and contributin…	Mar 6, 2024
README.md	README.md	Fix links in README guiding to another branch (EleutherAI#1838 )	May 14, 2024
decontamination.md	decontamination.md	Cleanup and fixes (Task, Instance, and a little bit of *evaluate) (El…	Mar 6, 2024
interface.md	interface.md	Update interface.md (EleutherAI#1955 )	Jun 12, 2024
model_guide.md	model_guide.md	Add chat template (EleutherAI#1873 )	Jun 3, 2024
new_task_guide.md	new_task_guide.md	Complete task list from pr 1727 (EleutherAI#1901 )	Jun 3, 2024
task_guide.md	task_guide.md	Fix outdated links to the latest links in `docs` (EleutherAI#1876 )	May 24, 2024

README.md

Welcome to the docs for the LM Evaluation Harness!

To learn about the public interface of the library, as well as how to evaluate via the commandline or as integrated into an external library, see the Interface
To learn how to add a new library, API, or model type to the library, as well as a quick explainer on the types of ways to evaluate an LM, see the Model Guide.
For a crash course on adding new tasks to the library, see our New Task Guide.
To learn more about pushing the limits of task configuration that the Eval Harness supports, see the Task Configuration Guide.