The 11th International Workshop on Evaluating Information Access (EVIA 2025)
EVIA 2025
The Eleventh International Workshop on Evaluating Information
Access
(EVIA 2025),
a Satellite Workshop of the NTCIR-18 Conference
13:00-17:30, DAY-1, Tuesday, June. 10 at National Institute of Informatics,
Tokyo, Japan.
Submission Instructions
Important Dates
EVIA 2025 Co-chairs
Past EVIAs
We are delighted to invite submissions for the Eleventh International Workshop on Evaluating Information Access (EVIA 2025), which will be held in conjunction with NTCIR 18 in Tokyo, Japan, June 10-13, 2025. Information Access technologies play a crucial role as intermediaries between human information needs and digital information resources. The reliable evaluation of these technologies has been long recognized as central to the advancement of the field. As information retrieval technologies continue to pervade, retrieval methods diversify, and retrieval tools are enhanced, the importance of effective, efficient, and innovative evaluation grows as well.
Authors are encouraged to submit regular research or position papers of 2-10 pages in ACM format. Position papers should have a clearly stated focus or perspective, or weigh a balance of perspectives. Accepted papers will be allocated speaking slots appropriate to their content and length. Regular research and position papers should not have been previously published in an archival venue. Papers that previously appeared in non-archival workshops or on preprint repositories (e.g., arXiv) are not considered to be previously published.
Authors may also request to present a poster on previously published work that may be of interest to the EVIA community. If you are requesting to present a poster on previously published work, it is sufficient to provide an abstract that includes a link to the previous publication. You do not need to upload a copy of the paper. Depending on time availability, people presenting posters may also be allocated a short speaking slot.
Papers should address one or more of the following topics, or that explore any other topics related
to information access evaluation:
- Creation of test collections or other evaluation environments
- Evaluation using large language models
- Evaluation of retrieval augment generation (RAG) systems
- Evaluation using crowdsourcing, implicit feedback, living labs, or other inferential methods
- User studies and the evaluation of human-computer interaction in information retrieval
- Evaluation measures and statistical issues in retrieval evaluation
- Evaluation methods for multilingual, multimedia, or mobile information access
- Evaluation issues in enterprise retrieval systems
- Other novel information access tasks and their evaluation
Submissions must be in English, in PDF, and use the standard ACM proceedings template, available for LaTeX or Word from https://www.acm.org/publications/proceedings-template.
Submit papers to the EVIA track using the NTCIR submission system at https://easychair.org/my/conference?conf=ntcir18 (Choose the “EVIA” track).
May 2, 2025: Submission deadline
May 23, 2025: Notification of acceptance
May 30, 2025: Camera-ready paper deadline
June 10-13, 2025: EVIA Workshop and NTCIR
NTCIR and EVIA will be primarily in person events, but we will be able to arrange remote participation for cases in which travel to Tokyo is not possible. We look forward to an engaging exchange of research ideas, insights, and discoveries at EVIA 2025, contributing to the continued evolution of the information access landscape. Please join us for this intellectually enriching event!
Charles L. A. Clarke (University of Waterloo, Canada) and
Zhao Cao (Huawei Technologies Co., Ltd, China)
Email: evia2025 [at] nii.ac.jp
Proceedings and reports from the first nine workshops are available below:
EVIA 2007 website, EVIA 2007 online proceedings
EVIA 2008 online
proceedings
EVIA 2010 website, EVIA 2010 online
proceedings
EVIA 2011 website, EVIA 2011 online
proceedings
EVIA 2013 website, EVIA 2013 online
proceedings
EVIA 2014 website, EVIA 2014 online
proceedings
EVIA 2016 website, EVIA 2016 online
proceedings
EVIA 2017 website, EVIA 2017 online proceedings
EVIA 2019 website, EVIA 2019 online
proceedings
EVIA 2023 website, EVIA 2023 online
proceedings
Last Modified: 2025-04-05