NTCIR-18 Conference

The 11th International Workshop on Evaluating Information Access (EVIA 2025)

EVIA 2025

The Eleventh International Workshop on Evaluating Information Access
(EVIA 2025),

a Satellite Workshop of the NTCIR-18 Conference
13:00-17:30, DAY-1, Tuesday, June. 10 at National Institute of Informatics, Tokyo, Japan.

Submission Instructions   Important Dates   EVIA 2025 Co-chairs   Past EVIAs

EVIA 2025 CALL FOR PAPERS

We are delighted to invite submissions for the Eleventh International Workshop on Evaluating Information Access (EVIA 2025), which will be held in conjunction with NTCIR 18 in Tokyo, Japan, June 10-13, 2025. Information Access technologies play a crucial role as intermediaries between human information needs and digital information resources. The reliable evaluation of these technologies has been long recognized as central to the advancement of the field. As information retrieval technologies continue to pervade, retrieval methods diversify, and retrieval tools are enhanced, the importance of effective, efficient, and innovative evaluation grows as well.


Authors are encouraged to submit regular research or position papers of 2-10 pages in ACM format. Position papers should have a clearly stated focus or perspective, or weigh a balance of perspectives. Accepted papers will be allocated speaking slots appropriate to their content and length. Regular research and position papers should not have been previously published in an archival venue. Papers that previously appeared in non-archival workshops or on preprint repositories (e.g., arXiv) are not considered to be previously published.


Authors may also request to present a poster on previously published work that may be of interest to the EVIA community. If you are requesting to present a poster on previously published work, it is sufficient to provide an abstract that includes a link to the previous publication. You do not need to upload a copy of the paper. Depending on time availability, people presenting posters may also be allocated a short speaking slot.


Papers should address one or more of the following topics, or that explore any other topics related to information access evaluation:

- Creation of test collections or other evaluation environments
- Evaluation using large language models
- Evaluation of retrieval augment generation (RAG) systems
- Evaluation using crowdsourcing, implicit feedback, living labs, or other inferential methods
- User studies and the evaluation of human-computer interaction in information retrieval
- Evaluation measures and statistical issues in retrieval evaluation
- Evaluation methods for multilingual, multimedia, or mobile information access
- Evaluation issues in enterprise retrieval systems
- Other novel information access tasks and their evaluation

SUBMISSION INSTRUCTIONS

Submissions must be in English, in PDF, and use the standard ACM proceedings template, available for LaTeX or Word from https://www.acm.org/publications/proceedings-template.


Submit papers to the EVIA track using the NTCIR submission system at https://easychair.org/my/conference?conf=ntcir18 (Choose the “EVIA” track).

PAGE TOP

IMPORTANT DATES (Anywhere on Earth)

May 2, 2025: Submission deadline

May 23, 2025: Notification of acceptance

May 30, 2025: Camera-ready paper deadline

June 10-13, 2025: EVIA Workshop and NTCIR

NTCIR and EVIA will be primarily in person events, but we will be able to arrange remote participation for cases in which travel to Tokyo is not possible. We look forward to an engaging exchange of research ideas, insights, and discoveries at EVIA 2025, contributing to the continued evolution of the information access landscape. Please join us for this intellectually enriching event!

PAGE TOP

EVIA 2025 Co-chairs

Charles L. A. Clarke (University of Waterloo, Canada) and
Zhao Cao (Huawei Technologies Co., Ltd, China)

Email: evia2025 [at] nii.ac.jp

PAGE TOP

PAST EVIAs

Last Modified: 2025-04-05