[Date Prev][Date Next][Date Index]
[ntcir:158] CFP for NTCIR-5 CLQA Task
- To: ntcir@xxxxxxxxx
- Subject: [ntcir:158] CFP for NTCIR-5 CLQA Task
- From: Yutaka Sasaki <yutaka.sasaki@xxxxxx>
- Date: Fri, 05 Nov 2004 16:29:31 +0900 (JST)
We apologize if you receive multiple copies.
============================================================
CALL FOR PARTICIPATIONS
Cross-Language Question Answering (CLQA) Task
in the Fifth NTCIR Workshop (2004-2005)
Introduction
The CLIR and QAC tasks have been conducted in a series of NTCIR Workshops
for 3 years. It is right time to step forward to make an attempt to
promote technologies of Cross-Language Question Answering (CLQA) based
on a common test set, in addition to the CLIR and QAC tasks as continuing
tasks. In the light of this, the NTCIR5 will initiate a pilot task, CLQA.
>From the linguistic viewpoint, CLQA is a much more complicated challenge.
As a result, we would like to make it much simpler in the question target.
Only questions about Named Entities are provided in the NTCIR5 CLQA task.
CLQA Subtasks
C->C, E->C, C->E, E->J, J-> E subtasks will be provided in CLQA (J->J will
be provided in QAC and K->K and E-K are under consideration). The score of
outputs of CLQA tasks is the fraction of responses judged correct.
Target Documents
- Chinese: news articles spanning a period of two years (2000 and 2001)
taken from UDN.COM (Totally 901,446 news articles)
- Japanese: news articles spanning a period of two years (2000 and 2001)
taken from the Yomiuri Newspaper.
- English: news articles spanning a period of two years (2000 and 2001)
taken from the Daily Yomiuri.
- Korean: Pending
Scope of Answer
Each question has only one answer or no answer. Answers are restricted to
named entities; proper nouns, such as the name of a person, an organization,
various artifacts, and numerical expressions, such as money, size, date etc.
CLQA website
Please visit http://research.nii.ac.jp/ntcir/ and click "CLQA".
Schedule
2004-11-01: Call for Participations
2004-11-30: Deadline for Application
(Registrations after this date may be accepted if situations allow)
2004-12-01: Release of Document Sets
2005-01-15: Distribution of a Development Set
(sample questions and answers)
2005-06-12: System developments freeze
2005-06-13/17: Formal Run
2005-09-01: Delivery of Evaluation Results
2005-10-01: Deadline for Working Notes
2005-12-06/09: NTCIR Workshop 5
2006: Deadline for Papers (Formal Proceedings)
Application procedure
Please visit "http://research.nii.ac.jp/ntcir/ntcir-ws5/application5/".
Task Organizers (clqa-admin @ nii.ac.jp)
*please remove the spaces in the email address
Yutaka Sasaki (ATR)
Hsin-Hsi Chen (NTU)
Kuang-hua Chen (NTU)
============================================================