UniAgent at CLEF 2027

Synopsis/Call

Agentic AI systems combine large language models, information retrieval, planning, and tool use to act on behalf of users in complex digital environments. A university administration is a closed-world, socio-technical environment whose tasks follow standardized, well-documented processes, which makes it particularly suited to a Cranfield-style evaluation of AI agents.

UniAgent: Shared Tasks on Agentic AI in University Administration continues this line of work as an evaluation lab at CLEF 2027, building on the first rendition at the CIKM 2026 AnalytiCup. The tasks of the lab are to be announced.

We will present the lab at CLEF 2026 in Jena, 21 to 24 September 2026, and at ECIR 2027 in Southampton, 21 to 25 March 2027. Come talk to us there if you are considering taking part.

Shared Tasks

To be announced.

Important Dates

To be announced.

Registration will run through the CLEF labs registration, and the schedule will follow the CLEF 2027 lab timeline once it is published.

Participation

To be announced.

Paper Submission

To be announced.

Awards

To be announced.

Results

To be announced.

Organizing Committee

Martin Potthast

University of Kassel, hessian.AI, ScaDS.AI · Track coordinator

Udo Kruschwitz

University of Regensburg · Enterprise search and assessment design

Michael Granitzer

University of Passau · Collection, crawling, RAG infrastructure (OpenWebSearch.eu)

Michael Dinzinger

University of Passau · Collection, crawling, RAG infrastructure (OpenWebSearch.eu)

Hai Dang Dang

University of Passau · Crawling and document collection (OpenWebSearch.eu)

Arjen P. de Vries

Radboud University · Evaluation methodology

Harrisen Scells

University of Tübingen · Tooling and baselines

Maik Fröbe

Friedrich-Schiller-Universität Jena · Reproducibility infrastructure (TIRA)

Andrew Parry

Bloomberg LP · Measures and analysis

Simon Ruth

University of Kassel, hessian.AI · Topic curation, data labeling, mock tool backends

Clara Erner

University of Kassel · Topic curation, data labeling, mock tool backends

Contact

Questions and discussion take place in the UniAgent forum on TIRA. You can also reach the organizers at uniagent@lists.its.uni-kassel.de. Releases are announced on this page.