[Date Prev][Date Next][Date Index]

[ntcir:158] CFP for NTCIR-5 CLQA Task

We apologize if you receive multiple copies.


                   CALL FOR PARTICIPATIONS

          Cross-Language Question Answering (CLQA) Task
             in the Fifth NTCIR Workshop (2004-2005)

The CLIR and QAC tasks have been conducted in a series of NTCIR Workshops
for 3 years.  It is right time to step forward to make an attempt to 
promote technologies of Cross-Language Question Answering (CLQA) based 
on a common test set, in addition to the CLIR and QAC tasks as continuing 
tasks. In the light of this, the NTCIR5 will initiate a pilot task, CLQA. 
>From the linguistic viewpoint, CLQA is a much more complicated challenge. 
As a result, we would like to make it much simpler in the question target. 
Only questions about Named Entities are provided in the NTCIR5 CLQA task.

CLQA Subtasks
C->C, E->C, C->E, E->J, J-> E subtasks will be provided in CLQA (J->J will 
be provided in QAC and K->K and E-K are under consideration). The score of
outputs of CLQA tasks is the fraction of responses judged correct.

Target Documents
 - Chinese: news articles spanning a period of two years (2000 and 2001)
   taken from UDN.COM (Totally 901,446 news articles)
 - Japanese: news articles spanning a period of two years (2000 and 2001)
   taken from the Yomiuri Newspaper.
 - English: news articles spanning a period of two years (2000 and 2001)
   taken from the Daily Yomiuri.
 - Korean: Pending

Scope of Answer
Each question has only one answer or no answer. Answers are restricted to
named entities; proper nouns, such as the name of a person, an organization,
various artifacts, and numerical expressions, such as money, size, date etc.

CLQA website
Please visit http://research.nii.ac.jp/ntcir/ and click "CLQA".

2004-11-01: Call for Participations
2004-11-30: Deadline for Application
      (Registrations after this date may be accepted if situations allow)
2004-12-01: Release of Document Sets
2005-01-15: Distribution of a Development Set
                    (sample questions and answers)
2005-06-12: System developments freeze
2005-06-13/17: Formal Run
2005-09-01: Delivery of Evaluation Results
2005-10-01: Deadline for Working Notes
2005-12-06/09: NTCIR Workshop 5
2006: Deadline for Papers (Formal Proceedings)

Application procedure
Please visit "http://research.nii.ac.jp/ntcir/ntcir-ws5/application5/".

Task Organizers (clqa-admin @ nii.ac.jp)
                          *please remove the spaces in the email address
     Yutaka Sasaki (ATR)
     Hsin-Hsi Chen (NTU)
     Kuang-hua Chen (NTU)