[Date Prev][Date Next][Date Index]

[ntcir:283] DEADLINE EXTENDED: EVIA 2008 (NTCIR-7 satellite workshop)

NTCIR participants, organisers and observers,
if you are working on evaluation,
please submit something to EVIA 2008,
which will be held on Day 1 of the NTCIR-7 meeting!


DEADLINE EXTENDED: EVIA 2008 (NTCIR-7 satellite workshop)

The submission deadline of EVIA 2008
(The Second International Workshop on Evaluating Information Access)
has been extended to *September 14*.

You can even submit a one-page short paper (see below) -
do submit one and join EVIA/NTCIR in Tokyo!
(Note: all papers will be reviewed by the EVIA program committee.)


*September 14, 2008 Submissions due*
October 13, 2008 Notification of acceptance
November 1, 2008 Final manuscripts due
December 16, 2008 EVIA 2008

***** CALL FOR PAPERS *****
The Second International Workshop on Evaluating Information Access
(EVIA 2008), A Satellite Workshop of NTCIR-7

Workshop Date: December 16, 2008 (Day 1 of the NTCIR-7 Meeting)
Workshop Venue: National Institute of Informatics, Tokyo, Japan.

Evaluation of Information Retrieval, Question Answering and Text
Summarisation systems has been central to Information Access research for decades. As retrieval becomes more pervasive and diverse, the need for effective and efficient evaluation has never been more important. For example, at SIGIR 2007, three sessions on Evaluation were held, along with others that also cover evaluation-related topics. Recognising a need to provide a forum for discussing the evaluation issues intensively, The First International Workshop on Evaluating Information Access (EVIA 2007) was held on May 15, 2007 -- Day 1 of the NTCIR-6 Workshop Meeting -- at the National Institute of Informatics, Tokyo, Japan. The EVIA 2007 Workshop consisted of invited paper sessions, a regular paper session and a poster session, and attracted participants from Asia, Europe and America. All the papers are available online:

Following the success of EVIA 2007, The SECOND International Workshop on Evaluating Information Access (EVIA 2008) will be held on December 16, 2008 - Day 1 of the NTCIR-7 Workshop Meeting. We will welcome papers addressing one or more of the following topics: -- Test collections, their formation, evaluation metrics and evaluation environments -- Cross-conference comparison: NTCIR, CLEF, TREC, DUC and others -- Evaluation of specific information access tasks, e.g., for education and training
-- Evaluation of query-specific approaches
-- Evaluation of multilingual, multimedia and/or mobile information access
-- Real-world search topics and/or evaluation in vivo
-- Novel information access tasks and their evaluation


We welcome two types of papers.
Both types will go through a double-blind reviewing process.

Regular papers: 6-12 pages.
Short papers: 1-4 pages.

Papers must be submitted to the EVIA 2008 submission website in pdf format.
For more details, please visit


Akiko Aizawa
James Allan
Javed Aslam
Leif Azzopardi
Nicholas Belkin
Ben Carterette
Maarten de Rijke
Norbert Fuhr
Fred Gey
Donna Harman
Djoerd Hiemstra
Gareth Jones
Noriko Kando
Jaana Kekalainen
Diane Kelly
Mounia Lalmas
Gary Geunbae Lee
Mun-Kew Leong
Iadh Ounis
Carol Peters
Ian Ruthven
Tetsuya Sakai
Mark Sanderson
Ian Soboroff
Andrew Turpin
Ross Wilkinson


Mark Sanderson (University of Sheffield, UK) and
Tetsuya Sakai (NewsWatch, Inc.)

If you have any questions, please contact:
m.sanderson@xxxxxxxxxxxxxxx and tetsuyasakai@xxxxxxx