NTCIR-19

Task Overview and Call for Task Participation

  1. Home
  2. NTCIR-19
  3. Task Overview and Call for Task Participation

The 19th NTCIR (2025 - 2026)

Evaluation of Information Access Technologies

Conference
December 8-10, 2026
NII, Tokyo, Japan

Evaluation Tasks

Evaluation Tasks

The eighteenth NTCIR (NTCIR-19) Program Committee has selected the following five Core Tasks and six Pilot Tasks.
For details and latest information, please see below and visit each task’s homepage.

CORE TASKS

  • Automatic Evaluation of LLMs 2 ("AEOLLM-2")

    Abstract:
    TBA

  • Argument Quality Assessment of Financial Forward-Looking Statements ("FinArg-3")

    Abstract:
    TBA

  • Hidden Causal Reasoning in Radiology Report Generation ("HIDDEN-RAD2")

    Abstract:
    TBA

  • Personal Lifelog Organization Retrieval Task ("Lifelog-7")

    Abstract:
    TBA

  • Medical Natural Language Processing for AI Chat ("MedNLP-CHAT2DSM")

    Abstract:
    TBA

PILOT TASKS

  • Composed Access to Multimodal E-commerce Objects ("CAMEO")

    TBA

  • Data Analytics for aGRicultural Information ("DAGRI")

    Abstract:
    TBA

  • Fact-based Event-centric Human-value Understanding ("FEHU")

    Abstract:
    TBA

  • RAG Responses Confident and Correct? ("R2C2")

    Abstract:
    TBA

  • Multinational, Multilingual, Multi-Industry Regulatory Compliance Checking ("RegCom")

    Abstract:
    TBA

  • Cross-modal Claim Verification in Scientific Papers ("SciClaimEval")

    Abstract:
    TBA

Last Modified: 2025-06-20