The 6th NTCIR Workshop

How to Participate



To participate the 6th NTCIR Workshop, please read through the Task Description, and the linked Call for Participation or task definition of each task. The information available on this site will be updated and enhanced occasionally. The major update will be announced through the mailing list, but we strongly recommend you to visit this site periodically.



In order to participate in the 6th NTCIR Workshop, firstly, please (1) register to the relevant task(s) through online registration, and, (2) send the two signed, original copies of the user agreement forms (by postal mail or courier) to the NTCIR Project Office at the address below. After receipt of the forms, we will send the data or information on how to download the data.

(1) Registration:

Please register to each of the tasks separately if you will participate in more than one task. In such case, you can use the same participating group name and group's ID across the tasks.

Email addresses specified in the registration form will be added to the following four mailing lists of the NTCIR.

  • ntcir (General information on the NTCIR projects. The members are previous workshops' participants, NTCIR collection users, anyone who are interested in NTCIR activities, etc.. Moderated)
  • ntc6-workshop (A mailing list of one or more tasks of the 6th NTCIR Workshop. Moderated)
  • open discussion list for the task
  • task's participants list

Correct email address please!: If your email address and other contact information specified in the form is not correct, you may not be able to obtain the necessary information and resources to conduct the task(s). Please fill all the information in the form(s) carefully.

Report on participation and evaluation results: The list of the the participating group names will be made public. The group's ID will be used to specify the submitted task results and evaluation results. With this ID, the evaluation results will be reported to the active task participants of the task before the NTCIR Workshop 6 Final Meeting. Using this ID, the evaluation results will be reported at the NTCIR Workshop 6 Final Meeting held in May 15-18, 2007, and published in the Proceedings of the Workshop meeting.

Participation types: There are two participation types as below. We strongly recommend "type A".

  • A. FULL: Submit results and describe the system. The correspondence between the group name and the group ID will be announced.
  • B. ANONYMOUS: Submit results. The correspondence between the group name and the group ID is not announced. This category is mainly for the participants from the companies who have troubles to participation.

Submission of reports: Regardless of the types of participation, every participating group shall submit to the Organizers; (1) task results, (2) papers for the proceedings, (3) system description form(s) which describes your system, (4) bibliographic information and a copy of all your papers when you publish papers using the NTCIR test collections, and (5) report(s) on study results. Copies of the proceedings and your papers may be sent to the copyright holders or distribution rights holders of the data as part of the report on research in NTCIR.

Publication of reports: Please understand that the above mentioned "(2) papers for proceedings"will be published as Proceedings in both the paper print form and as online as of the date of the final meeting. The Final Meeting is open to public. "(3) system description forms" may be included in the proceedings. The bibliographic information of the (4) will be made available on the NTCIR Web site. For the above mentioned "(1) task results", the submitted results will be shared by all the active participants who submit the results of the task before the final meeting, and after the final meeting the submitted results will be made available for research purpose use after exchanging the contract between NII and the researchers as part of "Submission Raw Data Archives" .

Changes after registration: When you will have to give up to continue the participation in the task(s) due to unexpected reasons and can not submit the results, please report immediately to Noriko Kando, the program chair at kando and the organizers of the task(s). If you would like to participate additional task(s) after registration, please consult Noriko Kando and the organizers of the task(s). For the change or addition of the subtask(s) in the task that you registered, please consult the task organizers. If you will need additional document data or have unnecessary document data due to the change of the subtask, please consult Noriko Kando as well. Here, "task" means any of CLIR, CLQA, PATENT, QAC and a pilot task, MuST, and "sub task" means any subtasks set in each of these tasks.

Please notice that students are not qualified as a "Principle Investigator of the group". If you are students, the principle investigator shall be your supervisor or advisor. A graduate students can be registered as a "contact person".

If you will have trouble with the online registration, please download the form, complete and return it via e-mail, fax, or postal mail to the NTCIR Project Office at the address specified below.

(2) User Agreement Forms ("Memorandum on Permission to Use NTCIR-6 Test Collections for Workshop Participants"):

Please prepare two signed copies of the form for each of the tasks that you would like to participate.

Please prepare the forms carefully. Please download the relevant form(s), make two sets of original double-sided copies, sign, and send (by postal mail or courier) to the NTCIR Project Office at the address specified below. The participating group on the form shall be a legal organization or a department/section of a legal organization. Since we need original signatures on each of the forms, the two original, signed copies of each of the forms must to be sent by postal mail or courier. After counter-signature of the forms, we will send a signed copy to you for your retention and another signed copy will be kept in the NII. Photo copies of the signed forms may be sent to the copyright holders or distribution right holders of the data.

Please read the task description of your task carefully and choose the data set(s) that you need to conduct the task registered, then tick the data sets that you are requesting in the appendix of each form. Please note that every participant must submit the signed forms to participate in the NTCIR-6 tasks. If you participated in the NTCIR-5 and obtained the permission of the use of some of the data by NII as a "NTCIR Workshop participant", the permission was only for the participation in the NTCIR-4 and you need to tick the data sets to obtain the permission for the NTCIR-6. If you have already had "permission of research purpose use" for the dataset either by NII or by the copyright holder, you are permitted to use the data sets without choosing them on this form.

For the details of the data used for each task, please consult the call for participation or task description of the task and NTCIR-6 DATA Home.

(3) WORKSHOP AIMS: [further information]

The NTCIR Workshop is a series of evaluation workshops designed to enhance research in information access technologies including information retrieval, summarization, extraction, question answering, etc. It was co-sponsored by Japan Society for Promotion of Science (JSPS) as part of JSPS "Research for Future" Program" and National Center for Science Information Systems (NACSIS) since 1997, by JSPS and the Research Center for Information Resources at the National Institute of Informatics (RCIR/NII,) in FY 2000, by RCIR/NII in FY2001, and by RCIR/NII and MEXT grand-in aid in FY2002-2005, and by NII in FY2006.

The aims are;

  1. to encourage research in information access technologies by providing large-scale infrastructure of research and evaluation.
  2. to provide a forum for research groups interested in evaluation and exchanging research ideas in an informal atmosphere
  3. to investigate evaluation methods and metrics of information retrieval and access technologies.

The main interest of us is "Speed the research in labs to real world". For this purpose, NTCIR provides the infrastructure of the research and evaluation. This is an opportunity to compare the wide variety of approaches and strategies of each participant, to exchange research ideas, and to learn each other's experience on the same data set and the same evaluation infrastructure. To do so, each participating group takes responsibility to report the experimental results carefully in details with sufficient analysis to depict why and how the proposed method worked well or not, and contribute the forum to learn each other from each others experience. Module-based examination is also important to show how and why. We do hope each of you will enjoy and utilize this opportunity to improve the researches in information access technologies. Any suggestions, advises, leads, etc., are always welcome!

If you have any questions or problems, please do not hesitate to contact us.


  • Scientific and Technical Enquiries:
Noriko Kando, NTCIR Project Leader
Phone: +81-3-4212-2529 | FAX: +81-3-3556-1916
Email: kando
  • For User Agreement Forms and Registration:

NTCIR Project Office (Rm.1309)
National Institute of Informatics
2-1-2 Hitotsubashi Chiyoda-ku,
Tokyo 102-8430, JAPAN

Phone: +81-3-4212-2750 | FAX: +81-3-4212-2751
Email: ntc-secretariat