NTCIR-10 1CLICK-2 Test Collection
April 11, 2013
by Makoto P. Kato kato[at-mark]dl.kuis.kyoto-u.ac.jp
The NTCIR-10 1CLICK-2 task is: given a query, return an X-character
textual output that aims to satisfy the user as quickly as possible.
Important pieces of information should be prioritized and the amount of
text the user has to read should be minimized.
The NTCIR-10 1CLICK-2 Test Collection is the test collection used at
the NTCIR-10 1CLICK (Once Click Access) task, which comprises:
1. English/Japanese
test queries,
2. nuggets (or iUnits) and vital strings for each English/Japanese query,
and
3. English/Japanese
evaluation data.
The NTCIR-10 1CLICK-2 Test Collection includes two folders 1CLICK-2-E
and 1CLICK-2-J, which contain English and Japanese data, respectively.
1CLICK-2-E contains the following files:
(E-1) English query list (1C2-E-queries.tsv),
(E-2) nuggets and vital strings (1C2-E-nuggets.tsv and vitalstrings.zip),
and
(E-3) English evaluation data (results.zip).
1CLICK-2-J contains the following files:
(J-1) Japanese query list (1C2-J-queries.tsv),
(J-2) iUnits and vital strings (1C2-J-iunits.tsv and 1C2-J-iunitsweight.tsv), and
(J-3) Japanese evaluation data (results.zip).
For E-1/E-2/J-1/J-2, there are available from IDR/NII soon.
For more details, please refer to the 1CLICK-2-E README and 1CLICK-2-J
README, as well as the NTCIR-10 1CLICK-2 overview paper available at the
NTCIR online proceedings: