NTCIR Home > NTCIR-18

NTCIR-18

The 18th NTCIR (2024 - 2025)
Evaluation of Information Access Technologies
January 2024 - June 2025
Conference: June 10-13, 2025 NII, Tokyo, Japan

The NTCIR-18 Conference ended successfully.
Thank you very much for your participation, cooperation, support, and interest.

What's New

July 7, 2025NEW: NTCIR-18 Online Proceedings are available here..

May 2, 2025: Call for participation for NTCIR-18 Conference and EVIA 2025 [Flyer]

May 1, 2024: NTCIR-18 Task Registration started.
[Flyer (May 20, 2024 Ver.)]
[Flyer (December 2, 2024 Ver.)]
Registration due of each task:
Time zone: Anywhere on Earth (AoE)
AEOLLM : November 1, 2024 January 15, 2025 (Closed)
FairWeb-2 : November 1, 2024 (Closed)
FinArg-2 : January 15, 2025 (Closed)
Lifelog-6 : January 15, 2025 (Closed)
MedNLP-CHAT : November, 2024 January 17, 2025 (Closed)
RadNLP : November 1, 2024 December 1, 2024 January 15, 2025 (Closed)
Transfer-2 : November 1, 2024 December 16, 2024 (Closed)
HIDDEN-RAD : January 8, 2025 January 15, 2025 (Closed)
SUSHI : November 15, 2024 December 20, 2024 January 24, 2025 February 6, 2025 February 20, 2025 (Closed)
U4 : November 1, 2024 December 28, 2024 (Closed)

March 29, 2024: Kickoff Event has been held.

March 11, 2024: Call for participation to the NTCIR-18 Kick-Off Event released. (Closed)

January 29, 2024: NTCIR-18 Call for Task Proposals released. (Closed)

Accepted Tasks

CORE TASKS
AEOLLM: Automatic Evaluation of LLMs
FairWeb-2: The Second Fair Web Task
FinArg-2: Temporal Inference of Financial Arguments
Lifelog-6: Personal Lifelog Organisation & Retrieval Task
MedNLP-CHAT: Medical Natural Language Processing for AI Chat
RadNLP: Natural Language Processing for Radiology
Transfer-2: Resource Transfer Based Dense Retrieval

PILOT TASKS
HIDDEN-RAD: Hidden Causality Inclusion in Radiology Report Generation
SUSHI: Searching Unseen Sources for Historical Information
U4: Unifying, Understanding, and Utilizing Unstructured Data in Financial Reports

For more details on each task, we will announce as soon as it is ready.
The updates and further news will be announced through the mailing list and X (Twitter).
To subscribe NTCIR's mailing list, please write to ntc-secretariat@nii.ac.jp.
Please understand this will be handle manually and then it may takes for a while.

Task Proposals

Call for NTCIR-18 Task Proposal (Closed)
Call for NTCIR-18 Task Proposals [CFP Flyer ]

Tentative Schedule

Feb 9, 2024
NTCIR-18 Task Proposal Submission Due (Anywhere on Earth)
Mar 2024
Acceptance Notification of Task Proposals
Mar 29, 2024
NTCIR-18 Kickoff Event
May 2024
Dataset release*
Jun-Dec 2024
Dry run*
Sep 2024-Feb 2025
Formal run*
Feb 1, 2025
Evaluation results return
Feb 1, 2025
Task overview release (draft)
Mar 15, 2025
Submission due of participant papers (draft)
May 1, 2025
Camera-ready participant paper due
Jun 10-13, 2025
NTCIR-18 Conference

(* indicates that the schedule can be different for different tasks)

The latest news will be delivered through the ntcir Mailing list: ntcir@nii.ac.jp
To subscribe, please send an e-mail to ntc-secretariat@nii.ac.jp

PAGE TOP

Contact Us

For contact to NTCIR-18, please see: 'Contact Us'
For further information, please contact NTCIR Project Office at: ntc-secretariat@nii.ac.jp

We are looking forward to your participation !


NTCIR-18 Program Committee Co-Chairs:
Qingyao Ai (Tsinghua University, China)
Chung-Chi Chen (National Institute of Advanced Industrial Science and Technology (AIST), Japan)
Shoko Wakamiya (Nara Institute of Science and Technology (NAIST), Japan)


NTCIR-18 General Chairs:
Charles Clarke (University of Waterloo, Canada)
Noriko Kando (National Institute of Informatics (NII), Japan)
Makoto P. Kato (University of Tsukuba, Japan)
Yiqun Liu (Tsinghua University, China)

Last Modified: 2025-07-07