NTCIR-16 Conference

The 16th NTCIR Conference
Evaluation of Information Access Technologies

June 14(Tue)-17(Fri), 2022
Virtual event
National Institute of Informatics (NII)

The NTCIR-16 Conference ended successfully.
Thank you very much for your participation, cooperation, support, and interest.

Online Proceedings

Presentation Awards

In response to the pandemic of COVID-19, NTCIR-16 Conference will be a fully online conference with the same schedule (14-17 Jun, 2022).
We are looking forward to enjoying an online conference together with you!

The Sixteenth NTCIR conference (NTCIR-16) would like to welcome all of you who are interested in and/or working on information access research. This sesquiannual event was first held in 1999, and has grown steadily ever since. About 277 people from 22 different countries attended NTCIR-15 and we are hoping that the event will be even more successful this time. NTCIR covers diverse information access tasks including, but not limited to, information retrieval, question answering, text summarisation and text mining, with an emphasis on East Asian languages and English.

At the NTCIR-16 conference, we will hear exciting reports from the following tasks:

- Data Search 2 (Data Search 2)
- Dialogue Evaluation 2 (DialEval-2)
- Investor's and Manager's Fine-grained Claim Detection (FinNum-3)
- Lifelog Access and Retrieval (Lifelog-4)
- QA Lab for Politics Information-3 (QA Lab-PoliInfo-3)
- We Want Web 4 with CENTER (WWW-4)
- Reading Comprehension for Information Retrieval (RCIR)
- Real document-based Medical Natural Language Processing (Real-MedNLP)
- Session Search (SS)
- Unbiased Learning to Ranking Evaluation Task (ULTRE)

While the NTCIR conference is a venue for task participants and organisers to discuss the official task results, open problems and future task designs, our door is open even to those who did not participate in any of the NTCIR-16 tasks. For the previous Conference, among them about half were researchers participated in the "task(s)" set by NTCIR, and others contributed to fruitful discussion.

We look forward to seeing you all at NII in June!

Call For Conference Participation

Registration fee is complimentary.

Keynote & Invited Talk

Tutorial (10:00~12:00, DAY-1: Jun 14 (Tue), 2022)

  • Speaker: Tetsuya Sakai (Waseda University)
  • Title: Evaluating Evaluation Measures, Evaluating Information Access Systems, Designing and Constructing Test Collections, and Evaluating Again

Keynote 1 (10:00~11:00, DAY-2: Jun 15 (Wed), 2022)

  • Speaker: Chengxiang Zhai (University of Illinois at Urbana-Champaign, USA)
  • Title: Information Retrieval Evaluation as Search Simulation

Keynote 2 (20:00~21:00, DAY-2: Jun 15 (Wed), 2022)

  • Speaker: Ellen Voorhees (NIST, USA)
  • Title: Cranfield is Dead; Long Live Cranfield

Keynote 3 (17:00~18:00, DAY-4: Jun 17 (Fri), 2022)

  • Speaker: Falk Scholer (RMIT University, Australia)
  • Title: The Impact of Query Variability and Relevance Measurement Scales on Information Retrieval Evaluation


Sponsors for NTCIR-16 Conference

Institutional Supporters

Thank you to our sponsors!

Contact Us

For further information, please contact NTCIR Project Office (Conference) at

Thank you very much for your participation, cooperation, support, and interest.

NTCIR-16 Program Co-Chairs:
Takehiro Yamamoto (University of Hyogo, Japan)
Zhicheng Dou (Renmin University of China)
NTCIR-16 General Co-Chairs:
Charles Clarke (University of Waterloo, Canada)
Noriko Kando (National Institute of Informatics, Japan)
Makoto P. Kato (University of Tsukuba, Japan)
Yiqun Liu (Tsinghua University, China)

Last Modified: 2022-06-30