NTCIR (NII Test Collection for IR Systems) Project bNTCIRbCONTACT INFORMATIONbNIIb
NTCIR HOME

NTCIR-9 HOME
-Workshop Aims
-NEWS
-Call for Participation
-Sponsors
-Program
-Keynote
-Registration
-Venue + Travel
Accomodation
Travel Support
VISA
-Submission Instruction
-Evaluation Tasks
INTENT
Vis-EX
RITE
CrossLink
GeoTime
PatentMT
SpokenDoc
Call for Task Proposals
Call for Participation
Data
-EVIA 2011
Call for Papers
-Organizers
Coordination
Program Committee
EVIA PC
-Important Dates
-Task Participation
-Contact Us
NTCIR HOME
Past NTCIRs
Data/Tools
Proceedings
FAQ


The Ninth NTCIR Workshop (2010/2011)

Evaluation of Information Access Technologies:
Information Retrieval, Question Answering, and Cross-Lingual Information Access

July 2010 -December 2011
Final Meeting: December 6-9, 2011, NII, Tokyo, Japan

Call for Participation to the NTCIR-9 Tasks
http://research.nii.ac.jp/ntcir/ntcir-9/
mJapanesen

Call for Participation [PDF]

Participation is invited from anyone interested in research on information access technologies and evaluation of them, such as retrieval of various document genres, cross-lingual information retrieval of Asian languages, question answering and cross-lingual information access. NTCIR Workshops are periodical event which are held once per one and half years.

The registration for NTCIR-9 Task Participation has just started.
Please visit: http://research.nii.ac.jp/ntcir/ntcir-9/


<Evaluation Tasks>

NTCIR-9 Task Selection Committee has selected the following four Core Tasks and three Pilot Tasks.

CORE TASKS
  • [RITE] Recognizing Inference in Text
    <http://artigas.lti.cs.cmu.edu/rite/>
    - Binary classification subtask: Judge whether Text1 entails Text2 or not.
    - Multi-class classification subtask: Judge whether (1) Text1 entails Text2; (2) Text2 entails Text1; (3) Text1 and Text2 are equivalent; (4) Text1 and Text2 are contradictory; or (5) Text1 and Text2 are independent of each other.
    - RITE4QA: extrinsic evaluation of binary classification in the context of factoid question answering.
PILOT TASKS
  • [Vis-Ex] Interactive Visual Exploration
    <http://must.c.u-tokyo.ac.jp/visex/hiki.cgi?FrontE>
    - Interactive complex question answering subtask: gather as many relevant nuggets as possible within a given time frame.
    - Summarizing trend information subtask: summarize a given time series information e.g. cabinet approval rating over a certain period.
    - Workshop: discuss and design modular evaluation for interactive information access.

<Registration for NTCIR-9 Tasks>

Please visit the 'How To Participate' page:
http://research.nii.ac.jp/ntcir/ntcir-9/howto.html


<Important Dates>
20/12/2010 Task Registration Due (Extended to 20/01/2011)
05/01/2011 Document Set Release
01-05/2011 Dry Run
03-07/2011 Formal Run
22/08/2011 Evaluation Results Due
22/08/2011 Task Overview Partial Release
20/09/2011 Participant Paper Submission Due
04/11/2011 All Camera-ready Paper Copy for the Proceedings Due
06-09/12/2011 NTCIR-9 Meeting, NII, Tokyo, Japan

<Reference>
Proceedings of the past NTCIRs:
http://research.nii.ac.jp/ntcir/publication1-en.html
Photo Albums for NTCIR-8 Meeting:
http://research.nii.ac.jp/ntcir/ntcir-ws8/meeting/photos/

<NTCIR-9 Evaluation Co-Chairs>
Hideo Joho (University of Tsukuba, Japan)
Tetsuya Sakai (Microsoft Research Asia, China)
<NTCIR-9 General Co-Chairs>
Noriko Kando (National Institute of Informatics, Japan)
Tsuneaki Kato (The University of Tokyo, Japan)
Eiichiro Sumita (National Institute of Information and Communications Technology, Japan)

You are most welcome to join us!

General co-chairs and Evaluation Co-chairs:ntc9-chairs

NTCIR Project Office: ntc-secretariat

Last Modified:2010.12.14