Information Access technologies provide the interface between human information needs and digital information resources. The reliable evaluation of these technologies has been recognized for decades as central to the advancement of the field. As information retrieval becomes more pervasive, the forms of retrieval more diverse, and retrieval tools richer, the importance of effective, efficient, and innovative evaluation grows as well.

In recognition of the need for a forum dedicated to the intensive discussion of evaluation issues, we have held four successful sesquiannual International Workshops on Evaluating Information Access (EVIA2007, 2008, 2010, and 2011). Proceedings and reports can be found below:

EVIA 2007 online proceedings
EVIA 2008 online proceedings
EVIA 2010 online proceedings
EVIA 2011 online proceedings

Following these successes, we are happy to announce the Fifth International Workshop on Evaluating Information Access (EVIA2013) on June 18, 2013 (coinciding with Day 1 of the NTCIR-10Workshop Meeting) at the National Institute of Informatics (NII),Tokyo, Japan. We invite papers addressing one or more of the
following topics:

- Test collection formation, evaluation metrics, and evaluation environments
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction in information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile information access- Novel information access tasks and their evaluation- Evaluation and assessment using implicit user feedback, crowdsourcing, living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval systems

*** SUBMISSION INSTRUCTIONS ***

(1)
Submissions will be subject to double-blind reviewing. Accepted papers will be included in the EVIA 2013 online proceedings.

We invite submissions of regular papers (up to 8 pages) and short papers (up to 4 pages).
Submissions must be in the ACM Conference style and must be submitted as pdf files.

Templates are available here.

For Latex users, please use the "Option 2" style.

Submissions must be made through the EVIA2013 submission management system.

(2)
Copyright form: using the form (EVIA2013: [pdf] or [txt] ) we provide for the Proceedings.
After notification of acceptance, please fill out copyright form and send to NTCIR Project Office by Postal mail before April 30, 2013.
NTCIR Project Office:
National Institute of Informatics, Rm 1309
2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo, 101-8430 Japan
Phone: +81-3-4212-2750
Fax: +81-3-4212-2751
Email: ntc-proc


[Return to Top]

*** IMPORTANT DATES ***

- April 5, 2013	submissions due ( extended )
- April 27, 2013	notification of acceptance
- April 30, 2013	copyright form submission deadline
- May 7, 2013	final manuscripts due
- June 18, 2013	EVIA 2013@NII, Tokyo, Japan
- June 18-21, 2013	NTCIR-10@NII, Tokyo, Japan

*** EVIA 2013 PROGRAM COMMITTEE ***

Charles L. A. Clarke	University of Waterloo	Canada
Atsushi Fujii	Tokyo Institute of Technology	Japan
Donna Harman	NIST	USA
Hideo Joho	University of Tsukuba	Japan
Gareth Jones	Dublin City University	Ireland
Noriko Kando	NII	Japan
Tetsuya Sakai	Microsoft Research Asia	China
Mark Sanderson	RMIT University	Australia
Falk Scholer	RMIT University	Australia
Ian Soboroff	NIST	USA
Ruihua Song	Microsoft Research Asia	China  ( Chair )
Paul Thomas	CSIRO	Australia
William Webber	University of Maryland	USA  ( Chair )

*** EVIA 2013 CO-CHAIRS ***

William Webber (University of Maryland, United States)
wew

Ruihua Song (Microsoft Research Asia, Beijing, China)
song.ruihua

[Return to Top]