NTCIR-16

The 16th NTCIR (2021 - 2022)
Evaluation of Information Access Technologies
January 2021 - June 2022
Conference: June 2022, NII, Tokyo, Japan
("Online presentation" will be available at the NTCIR-16 Conference.)

What's New

Jan 18, 2021NEW: The NTCIR-16 Program Committee has selected the following eight Tasks. (For more details on each task, we will announce as soon as it is ready.)
Five CORE Tasks:
 Investor's and Manager's Fine-grained Claim Detection (FinNum-3)
 Dialogue Evaluation 2 (DialEval-2)
 We Want Web 4 with CENTER (WWW-4)
 QA Lab for Politics Information-3 (QA Lab-PoliInfo-3)
 Data Search 2 (Data Search 2)
Three PILOT Tasks:
 Session Search (SS)
 Real document-based Medical Natural Language Processing (Real-MedNLP)
 Unbiased Learning to Ranking Evaluation Task (ULTRE)


Dec 21, 2020: NTCIR-16 Additional Call for Task Proposals released. (Due: Jan 15, 2021 Closed)

Oct 15, 2020: NTCIR-16 Call for Task Proposals released. (Closed)

Accepted Tasks

CORE TASKS
Investor's and Manager's Fine-grained Claim Detection (FinNum-3)
Dialogue Evaluation 2 (DialEval-2)
We Want Web 4 with CENTER (WWW-4)
QA Lab for Politics Information-3 (QA Lab-PoliInfo-3)
Data Search 2 (Data Search 2)

PILOT TASKS
Session Search (SS)
Real document-based Medical Natural Language Processing (Real-MedNLP)
Unbiased Learning to Ranking Evaluation Task (ULTRE)

For more details on each task, we will announce as soon as it is ready.

Task Proposals

Call for NTCIR-16 Task Proposal
Call for NTCIR-16 Task Proposals [CFP Flyer ] (Closed)
Call for NTCIR-16 Additional Task Proposals [CFP Flyer ] (Due: Jan 15, 2021 Closed)

Tentative Schedule

Jan 15, 2021
NTCIR-16 task proposals due
Feb 15, 2021
Acceptance Notification of Additional Task Proposal
Mar 2021
NTCIR-16 kickoff
 
Dataset Release*
 
Dry Run*
 
Formal Run*
 
Evaluation Result Release*
 
Task overview paper release (draft)
 
Submission due of participant papers
Jun 2022
NTCIR-16 Conference in NII, Tokyo

Event with * may vary across tasks.

The latest news will be delivered through the ntcir Mailing list: ntcir@nii.ac.jp
To subscribe, please send an e-mail to ntc-secretariat@nii.ac.jp

PAGE TOP

Contact Us

We are looking forward to your participation !


NTCIR-16 Program Co-Chairs:
Takehiro Yamamoto (Co-chair, University of Hyogo, Japan)
Zhicheng Dou (Co-chair, Renmin University of China)


NTCIR-16 General Chairs:
Charles Clarke (University of Waterloo, Canada)
Noriko Kando (National Institute of Informatics, Japan)
Makoto P. Kato (University of Tsukuba, Japan)
Yiqun Liu (Tsinghua University, China)


Last Modified: 2021-01-28