NTCIR-11 Workshop SpokenQuery&Doc Task Formal Run Evaluation Results

[NTCIR Home]

* Evaluation Results

• Evaluation results for the Spoken Query driven Spoken Content Retrieval (SQ-SCR) task
• Slide Group Segment Retrieval Task ( five groups with 52 runs + 2 baseline runs ) [SQSCR-SGS.xlsx]
• Passage Retrieval Task ( one group with 16 runs + 2 baseline runs ) [SQSCR-PAS.xlsx]
• Evaluation results for the Spoken Query driven Spoken Term Detection (SQ-STD) task
• From spoken query terms ( nine groups with 48 runs + 5 baseline runs) [SQSTD-SPK-overview.xlsx]
• From textual query terms ( five groups with 6 runs + 5 baseline runs ) [SQSTD-TXT-overview.xlsx]

 

These results were used in the overview paper:

Tomoyosi Akiba, Hiromitsu Nishizaki, Hiroaki Nanjo, and Gareth J. F. Jones (2014) Overview of the NTCIR-11 SpokenQuery&Doc task. In Proceedings of the 11 ^th NTCIR Conference, Tokyo, December 9-12, 2014.