NTCIR-19

Call for Participation to the NTCIR-19 Kick-Off Event

  1. Home
  2. NTCIR-19
  3. Kick-Off Event

September 3rd (Wednesday) 2025, 16:00 - 18:15 (JST)

National Institute of Informatics (NII), Room 1902-1903, Tokyo, Japan & Online (Zoom)

Let's participate in a collaborative activity for enhancing information access technologies!


Development of information access technologies based on techniques of information retrieval, natural language processing, and database management becomes increasingly more important for many applications (e.g., providing effective access to Web resources and text archives, and analyzing big data obtained from various kinds of sensors). It is indispensable for developing such technologies to experimentally evaluate them by using test collections constructed under collaborations of many researchers. Over the 20 years, NTCIR has been formulating the infrastructure for the evaluation, and contributing to development of the information access technologies. NTCIR has been the major forum for researchers to intensively discuss the evaluation methodology of emerging information access technologies. We would like to hold an event to introduce the NTCIR-19 and exciting new evaluation tasks. Are you researcher in information access area, a faculty member, a researcher in industry, or simply interested in informatics? Anyone is welcome for the event! Join us to share the advance of the state of the art information access research and development!

NTCIR-19 Kick-Off Envent

Date / Time September 3rd (Wednesday) 2025, 16:00 - 18:15 (JST)
Onsite Room 1902-1903, National Institute of Informatics
Online Zoom (The link will be available for participants a few days before the event.)
Fees Free
Registration

Thank you for joining us for the NTCIR-19 Kick-Off Event.
The recordings and slides are now available below.

Kickoff Event Registration

Zoom link will be sent to the registered email address before the event.

Kick-Off Envent Tentative Program

  • - Overview of NTCIR (5min)
  • - Overview of NTCIR-19 (5min)
  • - Introduction of each task (105min)
  • - How to participate in NTCIR-19 (5min)
  • - Q & A (10min)

Kick-Off Event Recordings & Slides

CORE TASKS

  • Automatic Evaluation of LLMs 2 ("AEOLLM-2")
    Recording / Slide pdf icon
  • Argument Quality Assessment of Financial Forward-Looking Statements ("FinArg-3")
    Recording / Slide pdf icon
  • Hidden Causal Reasoning in Radiology Report Generation ("HIDDEN-RAD2")
    Recording
  • Personal Lifelog Organization Retrieval Task ("Lifelog-7")
    Recording / Slide pdf icon
  • Medical Natural Language Processing for emergency Call ("MedNLP-CALL")
    Recording / Slide pdf icon
  • Tip-of-the-Tongue ("ToT")
    Recording / Slide pdf icon

PILOT TASKS

  • Instruction Generation for Agentic Search ("AgenticInstruction")
    Recording / Slide pdf icon
  • Composed Access to Multimodal E-commerce Objects ("CAMEO")
    Recording / Slide pdf icon
  • Data Analytics for aGRicultural Information ("DAGRI")
    Recording / Slide pdf icon
  • Fact-based Event-centric Human-value Understanding ("FEHU")
    Recording / Slide pdf icon
  • Pre-trained Model Retrieval ("ModelRetrieval")
    Recording / Slide pdf icon
  • RAG Responses Confident and Correct? ("R2C2")
    Recording / Slide pdf icon
  • Multinational, Multilingual, Multi-Industry Regulatory Compliance Checking ("RegCom")
    Recording / Slide pdf icon
  • Cross-modal Claim Verification in Scientific Papers ("SciClaimEval")
    Recording / Slide pdf icon

NTCIR-19 Tasks

CORE TASKS

  1. Automatic Evaluation of LLMs 2 ("AEOLLM-2")
  2. Argument Quality Assessment of Financial Forward-Looking Statements ("FinArg-3")
  3. Hidden Causal Reasoning in Radiology Report Generation ("HIDDEN-RAD2")
  4. Personal Lifelog Organization Retrieval Task ("Lifelog-7")
  5. Medical Natural Language Processing for emergency Call ("MedNLP-CALL")
  6. Tip-of-the-Tongue ("ToT")

PILOT TASKS

  1. Instruction Generation for Agentic Search ("AgenticInstruction")
  2. Composed Access to Multimodal E-commerce Objects ("CAMEO")
  3. Data Analytics for aGRicultural Information ("DAGRI")
  4. Fact-based Event-centric Human-value Understanding ("FEHU")
  5. Pre-trained Model Retrieval ("ModelRetrieval")
  6. RAG Responses Confident and Correct? ("R2C2")
  7. Multinational, Multilingual, Multi-Industry Regulatory Compliance Checking ("RegCom")
  8. Cross-modal Claim Verification in Scientific Papers ("SciClaimEval")
View Tasks Details

CONTACT INFORMATION

Organization

General Co-chairs

E-mail: ntc19-gc

Program Committee Co-chairs

E-mail: ntc19-pcc

General

NTCIR Project
NTCIR Project Office, National Institute of Informatics,
2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo
101-8430, JAPAN

Scientific and Technical Enquiries

E-mail: ntc-admin

Secretariat, Data application, Task registration

E-mail: ntc-secretariat

Phone: 03-4212-2750

Last Modified: 2025-10-10

Page Top