UDTR Global Radar

UDTR Global Rights of Nature Radar

Documentary registry of records detected across the scholarly, legal and institutional infrastructures monitored by UDTR.

A global documentary infrastructure designed to achieve the broadest verifiable and scientifically defensible coverage of the Rights of Nature.

← Back to Radar

Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting

Identification

Public canonical key
radar:r-89817ab6f5cac343b6f09ef46bf8dcea
Authors
Avijit Ghosh · Anka Reuel · Jenny Chim · Wm. Matthew Kennedy · Srishti Yadav · Jennifer Mickel · Yanan Long · Andrew Tran · Anastassia Kornilova · Damian Stachura · Kevin Klyman · Felix Friedrich · Jeba Sania · Jan Batzner · Anoop Mishra · Eliya Habba · Yixiong Hao · Nathan Heath · Shalaleh Rismani · Usman Gohar · Andrea Loehr · David Manheim · Ruchira Dhar · Sree Harsha Nelaturu · Aarush Sinha · Leshem Choshen · Drishti Sharma · Ishan Khire · Amit Saha · Subramanyam Sahoo · Michael Hardy · Michael Alexander Riegler · Kabir Manghnani · Michelle Lin · Yanan Jiang · Yanan Jiang · Asaf Yehudai · Jessica Ji · Aris Hofmann · Mubashara Akhtar · Max Lamparth · Nuno Moniz · Yacine Jernite · Stella Biderman · Zeerak Talat · Sanmi Koyejo · Mykel J. Kochenderfer · Irene Solaiman
Reported year
2026
Reported language
en
Source type
preprint
First detected
2026-11-14T02:16:53.707393+00:00
Last metadata observation
2026-11-14T02:16:53.707393+00:00
Last HTTP verification
Not checked

Institutions reported by the source

Baden-Wuerttemberg Cooperative State University · Georgetown University · Stanford University · Queen Mary University of London · Technion – Israel Institute of Technology · Technische Universität Darmstadt · Harvard University · Weizenbaum Institute · Technical University of Munich · Amherst College · Hebrew University of Jerusalem · Iowa State University · McGill University · University of Copenhagen · Zuse Institute Berlin · IBM (United States) · Massachusetts Institute of Technology · Georgia Institute of Technology · Mila - Quebec Artificial Intelligence Institute · Université de Montréal · ETH Zurich · University of Notre Dame · University of Edinburgh

Reported affiliation countries

CA · CH · DE · DK · GB · IL · US

Documentary abstract — original language

AI evaluation results are produced at scale but reported inconsistently across leaderboards, model cards, benchmark papers, and company blogs. The cost is interpretive: readers cannot reliably compare results across sources, identify what a report omits, or trace an aggregate claim to its underlying evidence. Recent efforts address isolated components but leave three gaps: they cover only narrow slices of the evaluation lifecycle and do not compose into a single interpretable record; they specify static representations that do not differentiate the questions different stakeholders bring to the same evidence; and they remain proposals on paper, lacking the extraction infrastructure required for adoption at scale. We present \EvalCards{}, an operational reporting layer that composes benchmark metadata, evaluation run data, and model metadata into a unified record. We (1) derive a reporting schema from a structured review of 52 papers and 10 stakeholder interviews, (2) implement four interpretive signals (reproducibility, documentation completeness, provenance and risk, and score comparability), rendered through reader modes calibrated to research and non-research audiences, and (3) deploy a monitoring tool that applies \EvalCards{} across 5,816 models, 635 benchmarks, and 101,843 results, surfacing systematic gaps in current reporting practice.

Identifiers

OPENALEX
https://openalex.org/W7164018997
DOI
10.48550/arxiv.2606.09809

Documentary context

Documentary family
preprint
Source-reported types
preprint

Entity mentions are not evidence of legal recognition. Jurisdiction studied is separate from author affiliation country.

Sources

OpenAlex · Record 1

Cite this reference

Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809

JSON · CSL-JSON · BibTeX · RIS · CSV · JSON-LD ·

APA, Chicago, ISO 690: bibliographic formats using available fields. OSCOLA / Bluebook: structured data only; full legal citation compliance is not claimed without verification of required elements.

APA
Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. (2026). Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. https://doi.org/10.48550/arxiv.2606.09809
Chicago
Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809
ISO 690
Avijit Ghosh; Anka Reuel; Jenny Chim; Wm. Matthew Kennedy; Srishti Yadav; Jennifer Mickel; Yanan Long; Andrew Tran; Anastassia Kornilova; Damian Stachura; Kevin Klyman; Felix Friedrich; Jeba Sania; Jan Batzner; Anoop Mishra; Eliya Habba; Yixiong Hao; Nathan Heath; Shalaleh Rismani; Usman Gohar; Andrea Loehr; David Manheim; Ruchira Dhar; Sree Harsha Nelaturu; Aarush Sinha; Leshem Choshen; Drishti Sharma; Ishan Khire; Amit Saha; Subramanyam Sahoo; Michael Hardy; Michael Alexander Riegler; Kabir Manghnani; Michelle Lin; Yanan Jiang; Yanan Jiang; Asaf Yehudai; Jessica Ji; Aris Hofmann; Mubashara Akhtar; Max Lamparth; Nuno Moniz; Yacine Jernite; Stella Biderman; Zeerak Talat; Sanmi Koyejo; Mykel J. Kochenderfer; Irene Solaiman. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. 2026. https://doi.org/10.48550/arxiv.2606.09809

Warning: Undefined array key "last_link_verified" in /home/clients/e27d81e12f04d2bfd747aa264540ac56/sites/_UDTR_APP/legal_library_reference.php on line 31

UDTR Global Rights of Nature Legal Library. Evaluation Cards: An Interpretive Layer for AI Evaluation Reporting. Documentary record: https://www.declarationuniverselledesdroitsdelarbre.org/global-rights-of-nature-radar/reference/r-89817ab6f5cac343b6f09ef46bf8dcea/ · Last HTTP verification: not performed

Report a correction

Frozen-version metadata

Research dossiers and documentary relations

Source roles

Bibliographic / original publication source · https://arxiv.org/abs/2606.09809

An authority link alone does not verify a legal claim. Abstracts and full texts remain subject to their source terms.

Documentary status

Relevance pending

Library

This identity is not yet included in the Legal Library.

UDTR Global Rights of Nature Legal Library