Skip to content

Commit ecc6135

Browse files
borgrborgr
committed
Add paper links and citation blocks to EEE and Eval Cards
Both projects now have arXiv papers, but the site didn't consistently surface them and neither landing page told a reader how to cite the work. - New _includes/cite.html: a "Cite this work" band rendered above the footer, with the reference line, the arXiv BibTeX and a copy button. Driven entirely by project front matter and guarded by `{% if page.bibtex %}`, so it is inert on projects without a paper. Styled with the layouts' design tokens (with light-mode fallbacks, since the tokens aren't defined site-wide) so it works in light and dark on both custom layouts and on the generic project layout. - Every Eval Ever (arXiv:2606.14516) had no paper link anywhere. It now mirrors Eval Cards' treatment: a "Paper" item in the nav next to Dataset and GitHub, plus the understated accent line below the hero buttons. Eval Cards already had both, so it only gains the cite band. - BibTeX entries are the canonical arxiv.org/bibtex exports, verified byte-for-byte against the rendered output. - The EEE launch post cited itself as a blog post. Now that the paper exists, it cites the paper.
1 parent ca3b7f9 commit ecc6135

7 files changed

Lines changed: 230 additions & 7 deletions

File tree

‎_includes/cite.html‎

Lines changed: 169 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,169 @@
1+
{%- comment -%}
2+
Citation block for project pages that have an accompanying paper.
3+
4+
Renders nothing unless the page defines `bibtex` in its front matter, so it is
5+
safe to drop into any project layout. Expected front matter (see
6+
_projects/every_eval_ever.md for a worked example):
7+
8+
paper_url, paper_arxiv, paper_title, paper_authors, paper_year, bibtex
9+
10+
`paper_authors` is rendered verbatim, so it should include its own terminal
11+
punctuation (e.g. "Jan Batzner, Sree Harsha Nelaturu, Damian Stachura, et al.").
12+
13+
Styled with the design tokens (--bg, --bg-subtle, --fg, --fg-muted, --fg-subtle,
14+
--border, --accent) that the eval_cards and every_eval_ever layouts define, so it
15+
picks up light and dark mode on those pages without per-layout tailoring. Those
16+
tokens are not defined site-wide, so every reference carries the light-mode value
17+
as a fallback — that keeps the block styled correctly on the generic project
18+
layout too.
19+
{%- endcomment -%}
20+
{% if page.bibtex %}
21+
<!-- ===================== CITATION ===================== -->
22+
<section id="cite" class="py-16 sm:py-20 px-4 sm:px-6 lg:px-8"
23+
style="background: var(--bg-subtle, #f5f4f1); border-top: 1px solid var(--border, #e8e6e1);">
24+
<div class="max-w-3xl mx-auto">
25+
26+
<div class="cite-kicker">Citation</div>
27+
<h2 class="font-bold mt-3 mb-4"
28+
style="font-size: clamp(1.5rem, 3vw, 2rem); letter-spacing: -.01em; color: var(--fg, #1a1916);">
29+
Cite this work
30+
</h2>
31+
32+
<p class="text-sm sm:text-base leading-relaxed mb-5" style="color: var(--fg-muted, #5c5a55);">
33+
If {{ page.title }} informs your research, please cite the paper:
34+
</p>
35+
36+
{%- comment -%}
37+
`paper_authors` carries its own terminal punctuation (author lists usually end
38+
in "et al."), so don't append a period here or it doubles up.
39+
{%- endcomment -%}
40+
<p class="text-sm sm:text-base leading-relaxed mb-6" style="color: var(--fg-muted, #5c5a55);">
41+
{% if page.paper_authors %}{{ page.paper_authors }}{% endif %}
42+
{% if page.paper_year %}{{ page.paper_year }}.{% endif %}
43+
<em style="color: var(--fg, #1a1916);">{{ page.paper_title | default: page.title }}</em>.
44+
{% if page.paper_arxiv %}arXiv:{{ page.paper_arxiv }}.{% endif %}
45+
{% if page.paper_url %}
46+
<a href="{{ page.paper_url }}" target="_blank" rel="noopener"
47+
class="cite-link">Read it here<span aria-hidden="true"> &rarr;</span></a>
48+
{% endif %}
49+
</p>
50+
51+
<div class="cite-block">
52+
<button type="button" class="cite-copy" data-cite-copy aria-label="Copy BibTeX to clipboard">
53+
<i data-lucide="clipboard" class="w-3.5 h-3.5"></i>
54+
<span data-cite-copy-label>Copy</span>
55+
</button>
56+
<pre data-cite-bibtex>{{ page.bibtex | strip | escape }}</pre>
57+
</div>
58+
59+
</div>
60+
</section>
61+
62+
<style>
63+
#cite .cite-kicker {
64+
font-family: var(--font-mono, 'IBM Plex Mono', ui-monospace, SFMono-Regular, Menlo, monospace);
65+
font-size: 11px;
66+
letter-spacing: .14em;
67+
text-transform: uppercase;
68+
color: var(--fg-subtle, #9c9a95);
69+
}
70+
#cite .cite-link {
71+
color: var(--accent, #5bacd1);
72+
font-weight: 500;
73+
text-decoration: underline;
74+
text-underline-offset: 2px;
75+
white-space: nowrap;
76+
}
77+
#cite .cite-block { position: relative; }
78+
#cite pre {
79+
margin: 0;
80+
padding: 1.25rem 1.25rem 1.25rem;
81+
background: var(--bg, #ffffff);
82+
border: 1px solid var(--border, #e8e6e1);
83+
border-radius: 8px;
84+
overflow-x: auto;
85+
font-family: var(--font-mono, 'IBM Plex Mono', ui-monospace, SFMono-Regular, Menlo, monospace);
86+
font-size: 12px;
87+
line-height: 1.7;
88+
color: var(--fg-muted, #5c5a55);
89+
/* BibTeX is pre-wrapped by arXiv; keep long author lists scrollable, not reflowed. */
90+
white-space: pre;
91+
tab-size: 2;
92+
}
93+
#cite .cite-copy {
94+
position: absolute;
95+
top: .625rem;
96+
right: .625rem;
97+
display: inline-flex;
98+
align-items: center;
99+
gap: .375rem;
100+
padding: .3rem .6rem;
101+
background: var(--bg-subtle, #f5f4f1);
102+
border: 1px solid var(--border, #e8e6e1);
103+
border-radius: 5px;
104+
font-family: var(--font-mono, 'IBM Plex Mono', ui-monospace, SFMono-Regular, Menlo, monospace);
105+
font-size: 11px;
106+
color: var(--fg-muted, #5c5a55);
107+
cursor: pointer;
108+
transition: color .2s, border-color .2s;
109+
}
110+
#cite .cite-copy:hover { color: var(--fg, #1a1916); border-color: var(--border-strong, #c8c6c0); }
111+
#cite .cite-copy[data-copied] { color: var(--accent, #5bacd1); border-color: var(--accent, #5bacd1); }
112+
@media (max-width: 640px) {
113+
/* Don't let the button sit on top of the first line of the entry. */
114+
#cite pre { padding-top: 2.75rem; }
115+
}
116+
</style>
117+
118+
<script>
119+
(function () {
120+
var btn = document.querySelector('#cite [data-cite-copy]');
121+
var pre = document.querySelector('#cite [data-cite-bibtex]');
122+
if (!btn || !pre) return;
123+
124+
var label = btn.querySelector('[data-cite-copy-label]');
125+
var reset;
126+
127+
function flash(text) {
128+
if (label) label.textContent = text;
129+
btn.setAttribute('data-copied', '');
130+
clearTimeout(reset);
131+
reset = setTimeout(function () {
132+
if (label) label.textContent = 'Copy';
133+
btn.removeAttribute('data-copied');
134+
}, 2000);
135+
}
136+
137+
btn.addEventListener('click', function () {
138+
// textContent decodes the Liquid-escaped entities, so the clipboard gets
139+
// BibTeX that compiles as-is.
140+
var bibtex = pre.textContent;
141+
142+
if (navigator.clipboard && window.isSecureContext) {
143+
navigator.clipboard.writeText(bibtex).then(function () {
144+
flash('Copied');
145+
}).catch(function () {
146+
flash('Press ⌘C');
147+
});
148+
return;
149+
}
150+
151+
// Fallback for non-secure contexts (e.g. plain-http local previews).
152+
try {
153+
var ta = document.createElement('textarea');
154+
ta.value = bibtex;
155+
ta.setAttribute('readonly', '');
156+
ta.style.position = 'fixed';
157+
ta.style.opacity = '0';
158+
document.body.appendChild(ta);
159+
ta.select();
160+
var ok = document.execCommand('copy');
161+
document.body.removeChild(ta);
162+
flash(ok ? 'Copied' : 'Press ⌘C');
163+
} catch (e) {
164+
flash('Press ⌘C');
165+
}
166+
});
167+
})();
168+
</script>
169+
{% endif %}

‎_layouts/eval_cards.html‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -784,6 +784,8 @@ <h4 class="font-bold mb-1.5 flex items-center gap-2"><i data-lucide="landmark" c
784784
</div>
785785
</section>
786786

787+
{% include cite.html %}
788+
787789
<!-- ===================== FOOTER ===================== -->
788790
<footer class="py-12 px-8" style="border-top: 1px solid var(--border); background: var(--bg);">
789791
<div class="max-w-7xl mx-auto">

‎_layouts/every_eval_ever.html‎

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -274,6 +274,13 @@
274274

275275
<!-- Right side -->
276276
<div class="flex items-center gap-3 sm:gap-6">
277+
{% if page.paper_url %}
278+
<a href="{{ page.paper_url }}" target="_blank" rel="noopener" class="flex items-center gap-2 text-sm font-medium hover:text-gray-600 transition-colors">
279+
<i class="fas fa-file-lines"></i>
280+
<span class="hidden sm:inline">Paper</span>
281+
</a>
282+
{% endif %}
283+
277284
<a href="https://huggingface.co/datasets/evaleval/EEE_datastore" target="_blank" class="flex items-center gap-2 text-sm font-medium hover:text-gray-600 transition-colors group">
278285
<img src="https://huggingface.co/datasets/huggingface/brand-assets/resolve/main/hf-logo-pirate.svg" alt="Hugging Face Logo" class="w-6 h-6 opacity-80 group-hover:opacity-100">
279286
<span class="hidden sm:inline">Dataset</span>
@@ -322,6 +329,15 @@ <h1 class="text-5xl sm:text-7xl font-extrabold tracking-tight mb-6 leading-tight
322329
<i data-lucide="external-link" class="w-4 h-4"></i>
323330
</a>
324331
</div>
332+
333+
{% if page.paper_url %}
334+
<div class="mt-6">
335+
<a href="{{ page.paper_url }}" target="_blank" rel="noopener" class="text-sm font-medium inline-flex items-center gap-1.5" style="color: var(--accent);">
336+
<i data-lucide="file-text" class="w-4 h-4"></i>
337+
Read the full paper{% if page.paper_arxiv %} (arXiv:{{ page.paper_arxiv }}){% endif %}
338+
</a>
339+
</div>
340+
{% endif %}
325341
</div>
326342
</section>
327343

@@ -1040,6 +1056,8 @@ <h2 class="text-3xl font-bold mb-4">Join the Evaluation Revolution</h2>
10401056
</div>
10411057
</section>
10421058

1059+
{% include cite.html %}
1060+
10431061
<!-- Footer -->
10441062
<footer class="py-12 px-8 border-t border-gray-200 bg-white">
10451063
<div class="max-w-7xl mx-auto">

‎_layouts/project.html‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -50,6 +50,9 @@ <h1 class="text-3xl font-bold mb-4">{{ page.title }}</h1>
5050
</div>
5151
{% endif %}
5252

53+
<!-- Citation (renders only when the project's front matter defines `bibtex`) -->
54+
{% include cite.html %}
55+
5356
<!-- Back Button -->
5457
{% if page.collection %}
5558
<a href="{{ '/' | append: page.collection | relative_url }}"

‎_posts/2026-02-17-everyevalever-launch.md‎

Lines changed: 8 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -176,13 +176,14 @@ We need your help. We're launching a [Shared Task](https://evalevalai.com/events
176176
[^3]: EvalEval (2026). [Every Eval Ever Converters](https://github.com/evaleval/every_eval_ever/tree/main/eval_converters). Converters for popular evaluation frameworks to the Every Eval Ever format. Top Contributor: Damian Stachura.
177177

178178
```bibtex
179-
@misc{evaleval2026everyevalever,
180-
title = {Every Eval Ever: Toward a Common Language for AI Eval Reporting},
181-
author = {Jan Batzner and Leshem Choshen and Avijit Ghosh and Sree Harsha Nelaturu and Anastassia Kornilova and Damian Stachura and Yifan Mai and Asaf Yehudai and Anka Reuel and Irene Solaiman and Stella Biderman},
182-
year = {2026},
183-
month = {February},
184-
url = {https://evalevalai.com/infrastructure/2026/02/17/everyevalever-launch/},
185-
note = {Blog Post, EvalEval Coalition}
179+
@misc{batzner2026evaleverunifyingschema,
180+
title={Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results},
181+
author={Jan Batzner and Sree Harsha Nelaturu and Damian Stachura and Anastassia Kornilova and Jon Crall and Tommaso Cerruti and Yanan Long and Yifan Mai and Sanchit Ahuja and Asaf Yehudai and Marek Šuppa and John P. Lalor and Oluwagbemike Olowe and Jatin Ganhotra and Brian H. Hu and Eliya Habba and Andrew M. Bean and Chang Liu and Sander Land and Steven Dillmann and Aniketh Garikaparthi and Elron Bandel and Saki Imai and James Edgell and Wm. Matthew Kennedy and Jenny Chim and Patrick Meusling and Asteria Kaeberlein and Venkata Ramachandra Karthik Chundi and Manasi Patwardhan and Martin Ku and Austin Meek and Leon Knauer and Brian Wingenroth and Srishti Yadav and Usman Gohar and Felix Friedrich and Michelle Lin and Jennifer Mickel and Arman Cohan and Stella Biderman and Irene Solaiman and Zeerak Talat and Anka Reuel and Mubashara Akhtar and Gjergji Kasneci and Avijit Ghosh and Leshem Choshen},
182+
year={2026},
183+
eprint={2606.14516},
184+
archivePrefix={arXiv},
185+
primaryClass={cs.AI},
186+
url={https://arxiv.org/abs/2606.14516},
186187
}
187188
```
188189

‎_projects/eval-cards.md‎

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -8,4 +8,19 @@ alt: image-alt
88
category: Infrastructure
99
status: active
1010
description: A live interpretive layer over AI evaluation reporting. Evaluation Cards composes run data, benchmark metadata, and model metadata into one canonical evaluation record, then computes four novel signals—reproducibility, completeness, provenance, and comparability—across 100,000+ reported results spanning hundreds of benchmarks and thousands of models. Built as an open, participatory initiative, it lets developers, evaluators, researchers, and policymakers centralize and interpret evaluation results across the whole ecosystem.
11+
paper_url: https://arxiv.org/abs/2606.09809
12+
paper_arxiv: "2606.09809"
13+
paper_title: "Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting"
14+
paper_authors: "Avijit Ghosh, Anka Reuel, Jenny Chim, et al."
15+
paper_year: 2026
16+
bibtex: |
17+
@misc{ghosh2026evaluationcardsinterpretivelayer,
18+
title={Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting},
19+
author={Avijit Ghosh and Anka Reuel and Jenny Chim and Wm. Matthew Kennedy and Srishti Yadav and Jennifer Mickel and Yanan Long and Andrew Tran and Anastassia Kornilova and Damian Stachura and Kevin Klyman and Felix Friedrich and Jeba Sania and Jan Batzner and Anoop Mishra and Eliya Habba and Yixiong Hao and Nathan Heath and Shalaleh Rismani and Usman Gohar and Andrea Loehr and David Manheim and Ruchira Dhar and Sree Harsha Nelaturu and Aarush Sinha and Leshem Choshen and Drishti Sharma and Ishan Khire and Amit Saha and Subramanyam Sahoo and Michael Hardy and Michael Alexander Riegler and Kabir Manghnani and Michelle Lin and Yanan Jiang and Yilin Huang and Asaf Yehudai and Jessica Ji and Aris Hofmann and Mubashara Akhtar and Max Lamparth and Nuno Moniz and Yacine Jernite and Stella Biderman and Zeerak Talat and Sanmi Koyejo and Mykel Kochenderfer and Irene Solaiman},
20+
year={2026},
21+
eprint={2606.09809},
22+
archivePrefix={arXiv},
23+
primaryClass={cs.AI},
24+
url={https://arxiv.org/abs/2606.09809},
25+
}
1126
---

‎_projects/every_eval_ever.md‎

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,4 +7,19 @@ status: active
77
category: Infrastructure
88
team: "Jan Batzner, Leshem Choshen, Avijit Ghosh"
99
description: "Every Eval Ever is a standardized schema for AI evaluation results, promoting interoperability, reproducibility, and transparency across the ecosystem."
10+
paper_url: https://arxiv.org/abs/2606.14516
11+
paper_arxiv: "2606.14516"
12+
paper_title: "Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results"
13+
paper_authors: "Jan Batzner, Sree Harsha Nelaturu, Damian Stachura, et al."
14+
paper_year: 2026
15+
bibtex: |
16+
@misc{batzner2026evaleverunifyingschema,
17+
title={Every Eval Ever: A Unifying Schema and Community Repository for AI Evaluation Results},
18+
author={Jan Batzner and Sree Harsha Nelaturu and Damian Stachura and Anastassia Kornilova and Jon Crall and Tommaso Cerruti and Yanan Long and Yifan Mai and Sanchit Ahuja and Asaf Yehudai and Marek Šuppa and John P. Lalor and Oluwagbemike Olowe and Jatin Ganhotra and Brian H. Hu and Eliya Habba and Andrew M. Bean and Chang Liu and Sander Land and Steven Dillmann and Aniketh Garikaparthi and Elron Bandel and Saki Imai and James Edgell and Wm. Matthew Kennedy and Jenny Chim and Patrick Meusling and Asteria Kaeberlein and Venkata Ramachandra Karthik Chundi and Manasi Patwardhan and Martin Ku and Austin Meek and Leon Knauer and Brian Wingenroth and Srishti Yadav and Usman Gohar and Felix Friedrich and Michelle Lin and Jennifer Mickel and Arman Cohan and Stella Biderman and Irene Solaiman and Zeerak Talat and Anka Reuel and Mubashara Akhtar and Gjergji Kasneci and Avijit Ghosh and Leshem Choshen},
19+
year={2026},
20+
eprint={2606.14516},
21+
archivePrefix={arXiv},
22+
primaryClass={cs.AI},
23+
url={https://arxiv.org/abs/2606.14516},
24+
}
1025
---

0 commit comments

Comments
 (0)