What participants must do

What participants must do

  • 1. Fill out and submit a registration form and user agreement forms (See HOW TO PARTICIPATE)
  • 2. Follow the task guidelines/schedule and submit your system output ("runs") to your task organizers.
  • 3. Based on the experience on your task participation, write a paper for the NTCIR-13 Conference. Papers will be published and included in the Online Proceedings as of the date of the conference.
  • 4. Make a presentation about your work at the NTCIR-13 Conference (December 5-8, 2017 at NII, Tokyo, Japan) in the poster session, or poster and oral presentation sessions. If it is difficult for your (or your group members) to attend the NTCIR-13 Conference, your need to designate a proxy on your own and ask her/him to present your work in the poster session of the NTCIR-13 conference.
  • 5. Submit a list of your publications that used NTCIR data every year to NII.

If you find that either Duty 2 or 3 cannot be satisfied, you need to contact your task organizers and Program Co-chairs immediately to let them know about your cancellation by the submission deadline. Moreover, you may be requested to delete the provided task data in this case.


Report on participation and evaluation results

  • Participating group names will be disclosed. Anonymous participation shall not be accepted.
  • The list of the participating group names will be made public.
  • Every participating group has to submit the task results, describe the system, and submit a paper for the Proceedings of the NTCIR Conference by the set deadline.
  • Evaluation results
    • will be shared by all the active participants who submit the results of the task before the final meeting,
    • will be reported on the Proceedings of the NTCIR Conference and published.
  • Papers of the participating groups for the Proceedings will be published.


Submission of reports

Every participating group shall submit to the Organizers;

  • (1) task results
  • (2) papers for the proceedings
  • (3) system description form(s) which describes your system
  • (4) bibliographic information and a copy of all your papers when you publish papers using the NTCIR test collections
  • (5) report(s) on study results.

Copies of the proceedings and your papers may be sent to the copyright holders or distribution rights holders of the data as part of the report on research in NTCIR.


Publication of reports

Please understand that submitted materials such as papers and system descriptions will be released as follows

  • "(2) papers for proceedings" will be published online Proceedings of the date of the final meeting. The Final Meeting is open to public.
  • "(3) system description forms" may be included in the proceedings.
  • The bibliographic information of the (4) will be made available on the NTCIR Web site.
  • For the above mentioned "(1) task results", the submitted results will be shared by all the active participants who submit the results of the task before the final meeting, and after the final meeting the submitted results will be made available for research purpose use after exchanging the contract between NII and the researchers as part of "Submission Raw Data Archives".


Changes after registration

If you have absolutely no choice but to cancel your participation in the task(s) due to unexpected reasons and cannot submit the results, please report immediately to Program Co-chairs at ntc13-pcc@nii.ac.jp and the organizers of the task(s).

If you would like to participate additional task(s) after registration, please consult Program Co-chairs and the organizers of the task(s). For the change or addition of the subtask(s) in the task that you registered, please consult the task organizers. If you need additional document data or have unnecessary document data due to the change of the subtask, please consult Program Co-chairs as well. Here, "task" means any of Lifelog-2, MedWeb, OpenLiveQ, QALab-3, STC-2, AKG, ECA, NAILS and WWW and "sub task" means any subtasks set in each of these tasks.



  • Scientific and Technical Enquiries:NTCIR-13 Program Co-chairs:
    Makoto P. Kato (Kyoto University, Japan) and Yiqun Liu (Tsinghua University, China)
    Email: ntc13-pcc@nii.ac.jp
  • For User Agreement Forms and Registration:NTCIR Project Office
    National Institute of Informatics (Rm.1309)
    2-1-2 Hitotsubashi Chiyoda-ku,
    Tokyo 101-8430, JAPAN
    Phone: +81-3-4212-2750 | FAX: +81-3-4212-2751
    Email: ntc-secretariat@nii.ac.jp
  • For contact information of each task, please refer to this page: 'Task Overveiw'.

Last modified: 2016-10-14