NTCIR

2024.08.08

Mark Sanderson is elected to the SIGIR Academy! He is an NTCIR Steering Committee member and ex-General co-chair.

Yiqun Liu is elected to the SIGIR Academy as well. He is an NTCIR Steering Committee member and General co-chair.

Yiqun Liu, Qingyao Ai, Jiaxin Mao, Weihang Su and Jia Chen are awarded SIGIR 2024 best paper award.
・Title: Scaling Laws For Dense Retrieval
・Authors: Yan Fang (Tsinghua University), Jingtao Zhan (Tsinghua University), Qingyao Ai (Tsinghua University), Jiaxin Mao (Renmin University of China), Weihang Su (Tsinghua University), Jia Chen (Xiaohongshu Inc), Yiqun Liu (Tsinghua University)
Qingyao is a Program co-chair of NTCIR-18. Jiaxin, Weihang and Jia are Task orgnaizers of NTCIR-17.

2024.05.01

NTCIR-18 Task Registration Started [Flyer]

2024.03.04

NTCIR-18 Kickoff Meeting will be held on Friday, March 29, 2024. For more information and registration, please see here.

2024.01.29

NTCIR-18 Call for Task Proposals released. (due: Feb 9, 2024)

2024.01.29

The NTCIR-17 Conference ended successfully. Thank you very much for your participation, cooperation, support, and interest.

2023.10.18

NTCIR-17 Conference is approaching soon! For the detailed information, please refer NTCIR-17 Conference Webpage. We are looking forward to welcoming all of you in Tokyo.

2023.07.12

Task participation was closed for all tasks. Thank you for your registration.

2023.01.06

NTCIR-17 Task Registration Started
(Deadline: [please see here])

2022.11.25

The videos and slides for the Tutorial at the NTCIR-16 Conference by Prof. Tetsuya Sakai are now available online.

2022.11.09

The NTCIR-17 Program Committee has accepted the following pilot task, which has been conditionally accepted.
UFO

2022.09.15

Call for participation to the NTCIR-17 Kick-Off Event released. [Registration]

2022.09.15

The NTCIR-17 Program Committee has selected the following five Tasks. One more proposals are conditionally accepted and still under review.
FinArg, MedNLP-SC, QA Lab-PoliInfo-4, FariWeb-1, Transfer.

2022.06.30

NTCIR-16 Presentation Awards page released.

2022.06.23

The NTCIR-16 Conference ended successfully. Thank you for your participation, cooperation and interest.

2022.06.14

NTCIR-16 Online Proceedings are available here.

2022.05.19

NTCIR-16 Conference Online Registration opened!

2022.05.17

NTCIR-17 Call for Task Proposals released.(due: July 8, 2022) [CFP]

2022.05.13

NTCIR-16 Conference Program at a glance released

2022.05.13

In response to the pandemic of COVID-19, NTCIR-16 Conference will be a fully online conference with the same schedule. For more details, please consult "ntcir-covid19".

2022.02.10

NTCIR-16 Paper Submission Instruction released.

2021.09.30

NTCIR-16 Conference webpage released.

2021.05.10

NTCIR-16 Task Registration Started (Deadline: [ please see here])

2021.04.01

Slides for NTCIR-16 Kick-Off Event released.

2021.03.15

Call for participation to the NTCIR-16 Kick-Off Event released. [CFP]

2021.01.28

The NTCIR-16 Program Committee has selected the following ten Tasks.
FinNum-3, DialEval-2, WWW-4, QA Lab-PoliInfo-3, Data Search 2, SS, Real-MedNLP, ULTRE, Lifelog-4, RCIR.

2020.12.21

NTCIR-16 Call for Additional Task Proposals released. (due: January 15, 2021 CLOSED) [CFP]

2020.12.21

NTCIR-15 Presentation Awards page released.

2020.12.15

The NTCIR-15 Conference ended successfully. Thank you for your participation, cooperation and interest.

2020.12.08

NTCIR-15 Online Proceedings are available here.

2020.11.26

Deadline Extended: NTCIR-16 Call for Task Proposals (due: November 27, 2020 December 4, 2020) [CFP]

2020.11.18

NTCIR-15 Conference Online Registration opened!

2020.11.16

NTCIR-15 Conference Program at a glance released

2020.11.16

A book-review for the NTCIR book is available at: https://irsg.bcs.org/informer/2020/10/book-review-evaluating-information-retrieval-and-access-tasks-ntcirs-legacy-of-research-impact/

2020.10.27

Now Publishing License Agreement for the Proceedings NTCIR-15 is available.
Please fill in the form and submit it to us electronically (scanned file with signature) by e-mail by Nov 13, 2020 (extended).

2020.10.15

NTCIR-15 Conference webpage released.

2020.10.15

In response to the pandemic of COVID-19, NTCIR-15 Conference will be a fully online conference with the same schedule. For more details, please consult "ntcir-covid19".

2020.09.24

New book on NTCIR now available from Springer - it's OPEN ACCESS!
Sakai, T., Oard, D., and Kando, N. (eds.): Evaluating Information Retrieval and Access Tasks: NTCIR’s Legacy of Research Impact, Springer, 2020. https://www.springer.com/gp/book/9789811555534

2020.08.25

NTCIR-15 Paper Submission Instruction released.

2019.11.21

NTCIR-15 Task Registration Started (Deadline: [ please see here])

2019.10.17

NTCIR-15 Task Overveiw released.

2019.10.10

Slides for NTCIR-15 Kick-Off Event released.

2019.09.12

Call for participation to the NTCIR-15 Kick-Off Event released. [CFP]

2019.08.05

The NTCIR-15 Task Selection Committee has selected the following seven Tasks.
Data Search, DialEval-1, FinNum-2, MART, QA Lab-PoliInfo-2, SHINRA2020-ML, WWW-3.

2019.07.10

The NTCIR-14 Conference and EVIA 2019 ended successfully. Thank you for your participation, cooperation and interest.

2019.06.10

NTCIR-14 and EVIA 2019 Online Proceedings are available here.

2019.05.27

NTCIR-15 Call for Task Proposals released.(due: June 6, 2019) [CFP]

2019.04.25

NTCIR-14 & EVIA 2019 Conference Online Registration opened! (Online-registration until May 31 June 3; Early registration due: May 6.)

2019.02.05

NTCIR-14 Online Proceedings Submission Instruction ・ Post-conference Proceedings Submission Instruction ・ Poster and Demo Instruction and Oral Presentations Instruction released.

2019.01.08

NTCIR-14 Task participation was closed for all tasks. Thank you for your registration.

2018.11.20

NTCIR-14 Conference webpage and EVIA 2019 CFP released.

2018.10.09

NTCIR-14 Task Registration is still possible in some tasks.

2018.08.27

NTCIR-13 Test collections (MedWeb) is available for research purposes.

2018.08.23

NTCIR-14 User Agreement Form (for Lifelog/STC/WWW/CENTRE/FinNum task) released.

2018.07.19

NTCIR-14 FinNum (new additional pilottask) : registration has started.

2018.06.08

NTCIR-14 User Agreement Form (for OpenLiveQ/QALab task) released.

2018.05.14

NTCIR-14 Task Registration Started (Deadline: [ please see here]) (CFP is here). [Flyer]

2018.04.02

Call for Additional Pilot Task Proposals for NTCIR-14 (Due: May 20, 2018) released. [CFP]

2018.04.02

NTCIR-14 Task Overveiw released.

2018.02.15

Call for Participation to the NTCIR-14 Kick-Off Event released. [CFP]

2018.01.16

The NTCIR-13 Conference and EVIA 2017 ended successfully. Thank you for your participation, cooperation and interest.

2017.08.23

NTCIR-14 Call for Task Proposals released.

2017.06.09

NTCIR-13 Task Registration is still possible in Lifelog, STC (Japanese), NAILS

2017.04.21

NTCIR-13 User Agreement Form (for MedWeb task) released

2017.01.20

NTCIR-12 Test collections (MathIR) is available for research purposes.

2017.01.18

a report on NTCIR-12 Conference for the SIGIR Forum December Edition (journal of ACM SIGIR) is now online (the report, please see here).

2016.12.16

NTCIR-13 Task Registration is still possible in each task after Dec. 15 (due vary across tasks)

2016.12.07

NTCIR-13 User Agreement Form (for ECA task) released

2016.12.02

NTCIR-13 User Agreement Form (for Lifelog task) released

2016.11.17

NTCIR-13 User Agreement Form (for AKG/OpenLiveQ/QALab task) released

2016.11.07

NTCIR-13 User Agreement Form (for STC/NAILS/WWW task) released

2016.10.14

NTCIR-13 Task Registration Started (CFP is here). [Flyer]

2016.09.27

NTCIR-12 Test collections (MedNLPDoc) is available for research purposes.

2016.09.15

NTCIR-12 Test collections (IMine,MobileClick,Temporalia,Lifelog) are available for research purposes.

2016.09.13

Call for Additional Pilot Task Proposals for NTCIR-13 (Due: Oct 31, 2016) released. [CFP]

2016.09.08

Slides for NTCIR-13 Kick-Off Event released.

2016.08.19

NTCIR-13 Task Overveiw released.

2016.08.16

Call for Participation to the NTCIR-13 Kick-Off Event released. [CFP]

2016.07.05

Photo Albums of the NTCIR-12 Conference and EVIA 2016 are available here.

2016.06.14

The NTCIR-12 Conference and EVIA 2016 ended successfully. Thank you for your participation, cooperation and interest.

2016.06.07

NTCIR-12 and EVIA 2016 Online Proceedings are available here.

2016.04.15

NTCIR-12 & EVIA 2016 Conference Online Registration opened! (Online-registration until May 27; Early registration due: May 10.)

2016.04.06

EVIA 2016 paper submission deadline extended to Apr 11.

2016.03.18

Call for Task Proposals for NTCIR-13 (Due: Apr 28, 2016) released.

2016.01.28

NTCIR-12 Conference and Paper Submission Instructions released.

2015.10.13

NTCIR-11/10 Submission Archives are available for research purposes (except some tasks).

2015.10.08

User agreement form for Yahoo! Japan Data for NTCIR-12 IMine/MobileClick Japanese Subtask participant released.

2015.10.06

NTCIR-11 MedNLP Test collection is available for research purposes.

2015.09.01

NTCIR-12 user agreement form (for MathIR) released.

2015.07.31

NTCIR-12 Task Registration is still possible in each task.

2015.07.31

NTCIR-12 MathIR (new additional coretask) : registration has started.

2015.07.31

NTCIR-12 STC Japanese subtask : registration has started.

2015.07.13

NTCIR-12 user agreement form (for IMine, MobileClick) released.　The agreement forms for NTCIR-12 Search query data will be announced separately.

2015.06.24

NTCIR-12 call for task participation deadline extension (July 31, 2015) (We will start distributing the data on July 1st as originally planned, after we receive the memorandums from your group).

2015.06.24

NTCIR-12 user agreement form (for Lifelog) released.

2015.06.16

NTCIR-12 user agreement form (for MedNLPDoc) released.

2015.05.29

NTCIR-12 user agreement form (for QA Lab) released.

2015.05.15

NTCIR-11 Temporalia Test collection is available for research purposes.

2015.04.20

NTCIR-12 Call for Additional Pilot Task Proposal released. (CFP is here.)

2015.04.10

NTCIR-12 user agreement form (for SpokenQuery&Doc, Temporalia) released.

2015.04.06

Call for Participation to the NTCIR-12 Tasks released. [Flyer]

2015.03.30

NTCIR-11 MATH Test collection is available for research purposes.

2015.03.23

Video Recordings and Slides for NTCIR-12 Kick-Off Event available.

2015.02.27

NTCIR-12 Task Registration started.

2015.02.20

NTCIR-11 IMine Test collection is available for research purposes.

2015.02.18

NTCIR-11 MobileClick Test collection is available for research purposes.

2015.02.17

NTCIR-10 1CLICK Test collection is available for research purposes.

2015.01.20

Call for Participation to the NTCIR-12 Kick-Off Event released. [CFP]

2014.12.15

Photo Albums of NTCIR-11 Conference and EVIA 2014 are available here.

2014.12.12

The NTCIR-11 Conference and EVIA 2014 ended successfully. Thank you for your participation, cooperation and interest.

2014.12.9

NTCIR-11 and EVIA 2014 Online Proceedings are available here.

2014.11.14

NTCIR-11 Conference Online Registration opened !

2014.11.07

Call for Participation: NTCIR-11 Conference released. [CFP]

2014.10.27

Call for Task Proposals for NTCIR-12 (Due: Nov.21, 2014) released. [CFP]

2014.10.10

NTCIR-10 Patent MT Test collection is available for research purposes.

2014.10.09

NTCIR-11 Copyright form released (Due: Nov. 01st).

2014.10.09

EVIA 2014 Copyright form released (Due: Oct. 22nd).

2014.09.09

EVIA 2014 Paper Submission Deadline Extended to Sep. 20.

2014.08.27

NTCIR-11 Paper Submission Instructions released.

2014.07.14

NTCIR-11 QA Lab (Ja/En subtask) user agreement form released.

2014.06.26

NTCIR-11 Conference and EVIA2014 is released.

2014.06.24

NTCIR-10 Test collection: RITE is available for research purposes.

2014.06.13

NTCIR-9 Test collection: RITE is available for research purposes.

2014.04.22

NTCIR-11 RITE-VAL (JA, EN, CN subtask) user agreement form released.

2014.04.07

The new Pilot Task: Cooking Recipe Search has just added.

2014.03.25

New NTCIR Tools for Evaluation Metrics released.

2014.02.17

NTCIR-11 MedNLP and RITE-VAL (JA subtask) user agreement form released.

2014.01.30

NTCIR-11 user agreement form (for Math, MobileClick, SpokenQuery&Doc) released.

2014.01.21

Task Registration is still possible in the some NTCIR-11 Tasks: Math, RITE-VAL, SpokenQuery&Doc, QA-Lab, some other tasks.

2014.01.14

NTCIR-11 user agreement form (for IMine, Temporalia) released.

2013.12.20

NTCIR-11 Task Registration Due Extended to 20 January, 2014

2013.11.26

NTCIR-11 Call for Additional Pilot Task Proposal released. (CFP is here.)

2013.10.31

NTCIR-11 Task Registration started

2013.10.31

NTCIR-11 Call for Participation to the NTCIR-11 Tasks released

2013.10.18

NTCIR-10 Test collection: Math is available for research purposes

2013.09.24

Slides and Video Recordings from the NTCIR-11 Kick-Off available

2013.09.19

NTCIR-10 Test collection: CrossLink is available for research purposes

2013.09.09

NTCIR-10 Test collection: INTENT, SpokenDoc are available for research purposes

2013.09.03

NTCIR-11 Task Evaluation released

2013.07.24

NTCIR-11 website and Call for Participation to the NTCIR-11 Kick-Off Event released

2013.06.24

The NTCIR-10 Conference and EVIA2013 ended successfully. Thank you for your participation, cooperation and interest.

2013.06.18

NTCIR-10 / EVIA2013 Online Proceedings released

2013.04.05

NTCIR-10 Conference Registration Open!

2013.03.26

EVIA2013 Paper Submission Deadline Extended to April 5th(Closed)

2013.03.21

Call for Task Proposals for NTCIR-11 (due May 10, 2013) released

2013.02.22

Survey for NTCIR web site

2013.02.14

NTCIR-10 Submission Instructions released

2013.01.15

ACM-TALIP Special Issue on NTCIR-9 RITE have been issued（December 2012）

2013.01.15

Tetsuya Sakai and INTENT Task Organizers received a Best Paper Award of the 8th Asian Information Retrieval Societies Conference（AIRS 2012）

2012.12.07

NTCIR-10 MedNLP Task user agreement form released

2012.11.06

NTCIR-10 The registration for the MedNLP Task has started

2012.10.19

Qrel（topics and Relevance judgements, questions and answers）are downloadable from NII/IDR

2012.09.06

WEB Test collections are available from NII/IDR

2012.08.24

NTCIR-9 Test collections（PatentMT）are available for research purposes

2012.07.24

EVIA 2013 Preliminary CFP released

2012.06.28

NTCIR-10 Task Registration Due Extended to 31 August.

2012.06.05

NTCIR-10 Call for Participation to the NTCIR-10 Task（in PDF）Released

2012.05.30

NTCIR-9 Test collection (SpokenDoc) is available for research purposes

2012.05.25

NTCIR-10 Task Registration Started（CFP is here）

2012.05.22

NTCIR-9 Test collections（Crosslink, INTENT and 1CLICK）are available for research purposes

2012.05.09

Submission deadline for IRJ Search Intents and Diversification was extended to 21 May

2012.05.06

Submission deadline for ACM-TALIP Special Issue on NTCIR-9 RITE was extended to 11 May

2012.03.22

Three Special Issues related to NTCIR:
-Natural Language Processing for Information Access and its Evaluation, Journal of the Association for Natural Language Processing, Japan- Submission Due: 27 April
（English Submission is welcome）
-ACM-TALIP Special Issue on NTCIR-9 RITE- Submission Dues: Title & Abstract: 23 April, Fulltext: 7 May（Extended to 11 May）（Sorry, it is for the task participants only）
-IRJ Search Intents and Diversification（related to NTCIR's Intent）- Submission Due: 14 May（Extended to 21 May）

2012.03.15

Video Recordings and Slides from the NTCIR-10 Kick-Off available

2012.02.28

Call for Participation to the NTCIR-10 Kick-Off Event released

2011.12.15

Photo Albums and Session Notes of NTCIR-9 Workshop/EVIA 2011meeting are available here

2012.12.12

The NTCIR-9 Workshop Meeting ended successfully. Thank you for your participation, cooperation and interest.

2011.12.06

NTCIR-9 Workshop/EVIA 2011 Online Proceedings released