EVIA2010 Table of Contents



Preface [Pdf]       Tetsuya Sakai, Mark Sanderson and William Webber
pp.i-i

Microsoft's Bing and User Behavior Evaluation [Pdf] [Abstract]
      John Nave

pp. 1-1

Estimating Pool-depth on Per Query Basis [Pdf] [Slides] [Abstract]
      Sukomal Pal, Mandar Mitra and Samaresh Maiti
pp. 2-6

The Effect of Pooling and Evaluation Depth on Metric Stability [Pdf] [Slides] [Abstract]
      William Webber, Alistair Moffat and Justin Zobel
pp.7-15

10 Years of CLEF Data in DIRECT: Where We Are and Where We Can Go [Pdf] [Slides] [Abstract]
      Maristella Agosti, Giorgio Maria Di Nunzio, Marco Dussin and Nicola Ferro
pp.16-24

Ranking Retrieval Systems without Relevance Assessments: Revisited [Pdf] [Abstract]
      Tetsuya Sakai and Chin-Yew Lin
pp.25-33

Test Collection Diagnosis and Treatment [Pdf] [Abstract]
      Ian Soboroff
pp.34-41

Simple Evaluation Metrics for Diversified Search Results [Pdf] [Abstract]
      Tetsuya Sakai, Nick Craswell, Ruihua Song, Stephen Robertson, Zhicheng Dou and Chin-Yew Lin
pp.42-50

Constructing a Test Collection with Multi-Intent Queries [Pdf] [Abstract]
      Ruihua Song, Dongjie Qi, Hua Liu, Tetsuya Sakai, Jian-Yun Nie, Hsiao-Wuen Hon and Yong Yu
pp.51-59

The Influence of Expectation and System Performance on User Satisfaction with Retrieval Systems [Pdf] [Slides] [Abstract]
      Katrin Lamm, Thomas Mandl, Christa Womser-Hacker and Werner Greve
pp.60-68

A Game-based Evaluation Method for Subjective Tasks Involving Text Content Analysis [Pdf] [Abstract]
      Keun Chan Park, Jihee Ryu, Kyung-min Kim and Sung Hyon Myaeng
pp.69-76


Table of Contents (in the printed version) [Pdf]

Author Index (in the printed version) [Pdf]