DAY-1 (Tuesday, May 15): EVIA, Tutorial

Registration Opens

Introduction to NTCIR, Noriko Kando (National Institute of Informatics)

Lunch

13:05-13:25 Introduction of the HTRDP Chinese IR Evaluation, Le Sun (Chinese Academy of Sciences)

13:25-13:45 Vietnamese Text Retrieval: Test Collection and First Experimentations, Ho Bao Quoc (Vietnam National University)

13:45-14:05 Initiative for Indian Language IR Evaluation, Prasenjit Majumder (Indian Statistical Institute), Mandar Mitra (Indian Statistical Institute), Swapan Parui (Indian Statistical Institute) and Pushpak Bhattacharyya (Indian Institute of Technology)

14:05-14:25 Evaluation of Web Search Engines on Thai Queries, Virach Sornlertlamvanich (Thai Computational Linguistics Laboratory)

14:25-14:45 Questions and Discussions

Coffee Break

Chair: Mark Sanderson (University of Sheffield)

15:00-15:35 A Comparison of Pooled and Sampled Relevance Judgments in the TREC 2006 Terabyte Track, Ian Soboroff (NIST)

Chair: Mark Sanderson (University of Sheffield)

15:35-16:00 On Penalising Late Arrival of Relevant Documents in Information Retrieval Evaluation with Graded Relevance, Tetsuya Sakai (NewsWatch, Inc.)

16:00-16:25 New Evaluation Measures for F-term Patent Classification, Yaoyong Li, Kalina Bontcheva and Hamish Cunningham (University of Sheffield)

16:25-16:50 WiQA: Evaluating Multi-lingual Focused Access to Wikipedia, Valentin Jijkoun and Maarten de Rijke (ISLA, University of Amsterdam)

16:50-17:15 A Proposal to Extend and Enrich the Scientific Data Curation of Evaluation Campaigns, Maristella Agosti, Giorgio Maria Di Nunzio, and Nicola Ferro (University of Padua)

17:15-18:00
Challenges to Evaluation of Multilingual Geographic Information Retrieval in GeoCLEF, Fredric Gey (University of California, Berkeley), Ray Larson (University of California, Berkeley), Mark Sanderson (University of Sheffield), Kerstin Bishoff (University of Hildesheim), Thomas Mandl (University of Hildesheim), Christa Womser-Hacker (University of Hildesheim), Diana Santos (Linguateca, SINTEF ICT), Paulo Rocha (Linguateca, SINTEF ICT), Andres Montoyo (University of Alicante), Giorgio Maria Di Nunzio (University of Padua) and Nicola Ferro (University of Padua)

An Application of the NTCIR-WEB Raw-data Archive Dataset for User Experiments, Masao Takaku (Research Organization of Information and System), Yuka Egusa (National Institute for Educational Policy Research), Hitomi Saito (Aichi University of Education) and Hitoshi Terai (Nagoya University)

User Satisfaction Task: A Proposal for NTCIR-7, Tetsuya Sakai (NewsWatch, Inc.)