The 4th NTCIR Workshop
How to Participate

Last update: 2003-04-11

[Japanese] [NTCIR-4]


To participate the 4th NTCIR Workshop, please read through the Task Description, and the linked Call for Participation or task definition of each task. The information available on this site will be updated and enhanced now and then. The major update will be announced through the mailing list, but we strongly recommend you to visit periodically.


In order to participate in the 4th NTCIR Workshop, firstly, please (1) register to the relevant task(s) through online registration, and, (2) send the two signed, original copies of the user agreement forms (by postal mail or courier) to the NTCIR Project Office at the address below. After receipt of the forms, we will send the data or information on how to download the data.

(1) Registration:

Please register to each of the tasks separately if you will participate in more than one task. In such case, you can use the same participating group name and group's ID across the tasks.

Email addresses specified in the registration form will be added to the following four mailing lists of the NTCIR.

Correct email address please!: If your email address and other contact information specified in the form is not correct, you may not be able to obtain the necessary information and resources to conduct the task(s). Please fill all the information in the form(s) carefully.

Report on participation and evaluation results: The list of the the participating group names will be made public. The group's ID will be used to specify the submitted task results and evaluation results. The evaluation results will be reported at the NTCIR Workshop 4 Meeting held in late May 2004, and published in the Working Notes of the Workshop meeting and the final proceedings.

Participation types: There are two participation types as below. We strongly recommend "type A".

Submission of reports: Regardless of the types of participation, every participating group shall submit the Organizers; (1) task results, (2) papers for the working notes and the workshop formal proceedings, (3) system description form(s) which describes your system, and (4) bibliographic information and a copy of all your papers when you publish papers using the NTCIR test collections . Copies of the working notes, proceedings and your papers may be sent to the copyright holders or distribution rights holders of the data as part of the report on research in NTCIR.

Changes after registration: When you will have to give up to continue the participation in the task(s) due to unexpected reasons and can not submit the results, please report immediately to Noriko Kando, the program chair at kando and the organizers of the task(s). If you would like to participate additional task(s) after registration, please consult Noriko Kando and the organizers of the task(s).@For the change or addition of the subtask(s) in the task you registered, please consult the task organizers. If you will need additional document data or have unnecessary document data due to the change of the subtask, please consult Noriko Kando as well. Here, "task" means any of CLIR, PATENT, QAC, TSC and WEB, and "sub task" means any subtasks set in each of these tasks.

Please notice that students are not qualified as a "Principle Investigator of the group". If you are students, the principle investigator shall be your supervisor or advisor. A graduate students can be registered as a "contact person".

If you will have trouble with the online registration, please download the form, complete and return it via e-mail, fax, or postal mail to the NTCIR Project Office at the address specified below.

(2) User Agreement Forms ("Memorandum on Permission to Use NTCIR-4 test collections for workshop participants"):

Please prepare two signed copies of the form for each of the tasks that you would like to participate.

Please prepare the forms carefully. Please download the relevant form(s), make two sets of original double-sided copies, sign, and send (by postal mail or courier) to the NTCIR Project Office at the address specified below. The participating group on the form shall be a legal organization or a department/section of a legal organization. Since we need original signatures on each of the forms, the two original, signed copies of each of the forms must to be sent by postal mail or courier. After counter-signature of the forms, we will send a signed copy to you for your retention and another signed copy will be kept in the NII. Photo copies of the signed forms may be sent to the copyright holders or distribution right holders of the data.

For the Xinhua Document Data used in CLIR task, please follow the instruction.

Please read the task description of your task carefully and choose the data set(s) that you need to conduct the task registered, then tick the data sets that you are requesting in the appendix of each form. Please note that every participant must submit the signed forms to participate in the NTCIR-4 tasks. If you participated in the NTCIR-3 and obtained the permission of the use of some of the data by NII as a "NTCIR Workshop participant", the permission was only for the participation in the NTCIR-3 and you need to tick the data sets to obtain the permission for the NTCIR-4. If you have already had "permission of research purpose use" for the dataset either by NII or by the copyright holder, you are permitted to use the data sets without choosing them on this form.

For the details of the data used for each task, please consult the call for participation or task description of the task and t NTCIR-4 DATA Home.

(3) WORKSHOP AIMS: [further information]

The NTCIR Workshop is a series of evaluation workshops designed to enhance research in information access technologies including information retrieval, summarization, extraction, question answering, etc. It was co-sponsored by Japan Society for Promotion of Science (JSPS) as part of JSPS "Research for Future" Program" and National Center for Science Information Systems (NACSIS) since 1997, by JSPS and the Research Center for Information Resources at the National Institute of Informatics (RCIR/NII,) in FY 2000, and by RCIR/NII in and after FY2001.

The aims are;

  1. to encourage research in information access technologies by providing large-scale data collections reusable for experiments and a common evaluation infrastructure allowing cross-system comparisons
  2. to provide a forum for research groups interested in cross-system comparison and exchanging research ideas in an informal atmosphere
  3. to investigate evaluation methods of IR and text processing techniques and methods for constructing a large-scale data set reusable for experiments.

This is an opportunity to compare the wide variety of approaches and strategies of each participant, to exchange research ideas, and to learn each other's experience on the same data set and the same evaluation infrastructure. We do hope each of you will enjoy and utilize this opportunity to improve the researches in information access technologies. Any suggestions, advises, leads, etc., are always welcome!

If you have any question or problems, please do not hesitate to contact us.

CONTACT INFORMATION: [further information]

Noriko Kando
Phone: +81-3-4212-2529 | FAX: +81-3-3556-1916
Email: kando
NTCIR Project Office
Research Center for Information Resources
National Institute of Informatics
2-1-2 Hitotsubashi Chiyoda-ku, Tokyo 102-8430, JAPAN
Phone: +81-3-4212-2750 | FAX: +81-3-4212-2751
Email: ntc-secretariat

[Japanese] [NTCIR-4]
Last modified: 2003-04-11
modified: 2003-03-03
modified: 2003-02-21
started on: 2003-02-10