Skip to content

Add ImageBench V1 to Benchmark Suites - #798

Open
dh7 wants to merge 1 commit into
alvinreal:mainfrom
dh7:add-imagebench
Open

dh7 wants to merge 1 commit into
alvinreal:mainfrom
dh7:add-imagebench

Conversation

@dh7

@dh7 dh7 commented Oct 1, 2026

Copy link
Copy Markdown

Adds ImageBench V1 to Section 9 → Benchmark Suites.

Fit note. The existing suite entries (LiveBench, lm-evaluation-harness, HELM, SWE-bench, VLMEvalKit, etc.) are all LLM / multimodal-understanding benchmarks. ImageBench adds the complementary angle: a prompt-adherence benchmark for text-to-image generation models, judged by a VLM panel.

Why it fits "opensource AI":

Happy to reword, slot elsewhere (e.g. under Evaluation Frameworks or a new Image Generation Benchmarks subsection), or close if it's not a fit for this list.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant