The 19th NTCIR (2025 - 2026)

NTCIR-19

Evaluation of Information Access Technologies

Conference
December 8-10, 2026
NII, Tokyo, Japan

NEWS

What's New

2025.07.17 Call for Additional Task Proposals for NTCIR-19

(due: August 8th, 2025)

2025.07.08 NTCIR-19 Kickoff Meeting will be held on the afternoon of September 3, 2025 as a hybrid meeting.

More details will delivered through the ntcir mailing list: ntcir@nii.ac.jp at a later date.

2025.06.27 The NTCIR-19 Program Committee has selected the following eleven tasks.
2025.03.27 Deadline extended: NTCIR-19 Call for Task Proposals.

(due: March 31, 2025 -> April 7, 2025)

2025.03.14 NTCIR-19 Call for Task Proposals released.

(due: March 31, 2025)

TASKS

Accepted Tasks

CORE TASKS

AEOLLM-2: Automatic Evaluation of LLMs 2

FinArg-3: Argument Quality Assessment of Financial Forward-Looking Statements

HIDDEN-RAD2: Hidden Causal Reasoning in Radiology Report Generation

Lifelog-7: Personal Lifelog Organization Retrieval Task

MedNLP-CALL: Medical Natural Language Processing for emergency Call

PILOT TASKS

CAMEO: Composed Access to Multimodal E-commerce Objects

DAGRI: Data Analytics for aGRicultural Information

FEHU: Fact-based Event-centric Human-value Understanding

R2C2: RAG Responses Confident and Correct?

RegCom: Multinational, Multilingual, Multi-Industry Regulatory Compliance Checking

SciClaimEval: Cross-modal Claim Verification in Scientific Papers

For more details on each task, we will announce as soon as it is ready.
The updates and further news will be announced through the mailing list and X (Twitter).
To subscribe NTCIR's mailing list, please write to ntc-secretariat
Please understand this will be handle manually and then it may takes for a while.

SCHEDULE

Tentative Schedule

September 3, 2025 NTCIR-19 Kick-Off Event (hybrid)
January 2026 Dataset release*
January-June 2026 Dry run*
March-July 2026 Formal run*
August 1, 2026 Evaluation results return
August 1, 2026 Task overview release (draft)
September 1, 2026 Submission due of participant papers (draft)
November 1, 2026 Camera-ready participant paper due
December 8-10, 2026 NTCIR-19 Conference (NII, Tokyo, Japan)

(* indicates that the schedule can be different for different tasks)

The latest news will be delivered through the ntcir Mailing list: ntcir
To subscribe, please send an e-mail to ntc-secretariat

CONTACT

NTCIR-19 Contact Information

Organization

General Co -chairs

Charles Clarke (University of Waterloo, Canada),
Makoto P. Kato (University of Tsukuba / National Institute of Informatics (NII), Japan),
Yiqun Liu (Tsinghua University, China)

E-mail: ntc19-gc

Program Committee Co-chairs

Qingyao Ai (Tsinghua University, China),
Chung-Chi Chen (National Institute of Advanced Industrial Science and Technology (AIST), Japan),
Shoko Wakamiya (Nara Institute of Science and Technology (NAIST), Japan)

E-mail: ntc19-pcc

Honorary Co-chair

Noriko Kando (National Institute of Informatics (NII), Japan)

General

NTCIR Project
NTCIR Project Office, National Institute of Informatics,
2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo
101-8430, JAPAN

Scientific and Technical Enquiries

E-mail: ntc-admin

Secretariat, Data application, Task registration

E-mail: ntc-secretariat

Phone: 03-4212-2750

Last Modified: 2025-07-09