NTCIR-19
Task Overview and Call for Task Participation
The 19th NTCIR (2025 - 2026)
Evaluation of Information Access Technologies
December 8-10, 2026
NII, Tokyo, Japan
Evaluation Tasks
Evaluation Tasks
The nineteenth NTCIR (NTCIR-19) Program Committee has selected the
following five Core Tasks and six Pilot Tasks.
For details
and latest information, please see below and visit each task’s
homepage.
CORE TASKS
-
Automatic Evaluation of LLMs 2 ("AEOLLM-2")
-
Argument Quality Assessment of Financial Forward-Looking Statements ("FinArg-3")
-
Hidden Causal Reasoning in Radiology Report Generation ("HIDDEN-RAD2")
-
Personal Lifelog Organization Retrieval Task ("Lifelog-7")
-
Medical Natural Language Processing for emergency Call ("MedNLP-CALL")
PILOT TASKS
-
Composed Access to Multimodal E-commerce Objects ("CAMEO")
Abstract:
TBAWebsite:
NTCIR-18 Conference Closing Slide
-
Data Analytics for aGRicultural Information ("DAGRI")
-
Fact-based Event-centric Human-value Understanding ("FEHU")
-
RAG Responses Confident and Correct? ("R2C2")
-
Multinational, Multilingual, Multi-Industry Regulatory Compliance Checking ("RegCom")
-
Cross-modal Claim Verification in Scientific Papers ("SciClaimEval")
Last Modified: 2025-07-02