NTCIR (NII Test Collection for IR Systems) Project bNTCIRbCONTACT INFORMATIONbNIIb

-NTCIR-10 Conference
-Call for Participation
-EVIA 2013
Call for Papers
Submission Instruction
Call for Sponsors
-Venue + Travel
Travel Support
-Important Dates
NTCIR-10 Organizing Committee
EVIA Program Cairs
-Contact Us

EVIA 2013

The Fifth International Workshop on Evaluating Information
Access (EVIA 2013), a Satellite Workshop of the NTCIR-10 Conference

June 18, 2013 at National Institute of Informatics, Tokyo, Japan.

***** EVIA 2013: CALL FOR PAPERS *****

** Submission Deadline extended to April 5th, 2013 **


Submission Instructions | Important Dates | Contact

Information Access technologies provide the interface between human information needs and digital information resources. The reliable evaluation of these technologies has been recognized for decades as central to the advancement of the field. As information retrieval becomes more pervasive, the forms of retrieval more diverse, and retrieval tools richer, the importance of effective, efficient, and innovative evaluation grows as well.

In recognition of the need for a forum dedicated to the intensive discussion of evaluation issues, we have held four successful sesquiannual International Workshops on Evaluating Information Access (EVIA2007, 2008, 2010, and 2011). Proceedings and reports can be found below:
EVIA 2007 online proceedings
EVIA 2008 online proceedings
EVIA 2010 online proceedings
EVIA 2011 online proceedings

Following these successes, we are happy to announce the Fifth International Workshop on Evaluating Information Access (EVIA2013) on June 18, 2013 (coinciding with Day 1 of the NTCIR-10Workshop Meeting) at the National Institute of Informatics (NII),Tokyo, Japan. We invite papers addressing one or more of the
following topics:
- Test collection formation, evaluation metrics, and evaluation environments
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction in information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile information access- Novel information access tasks and their evaluation- Evaluation and assessment using implicit user feedback, crowdsourcing, living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval systems


Submissions will be subject to double-blind reviewing. Accepted papers will be included in the EVIA 2013 online proceedings.

We invite submissions of regular papers (up to 8 pages) and short papers (up to 4 pages).
Submissions must be in the ACM Conference style and must be submitted as pdf files.

Templates are available here.

For Latex users, please use the "Option 2" style.

Submissions must be made through the EVIA2013 submission management system.

Copyright form: using the form (EVIA2013: [pdf] or [txt] ) we provide for the Proceedings.
After notification of acceptance, please fill out copyright form and send to NTCIR Project Office by Postal mail before April 30, 2013.
NTCIR Project Office:
National Institute of Informatics, Rm 1309
2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo, 101-8430 Japan
Phone: +81-3-4212-2750
Fax: +81-3-4212-2751
Email: ntc-proc

[Return to Top]


- April 5, 2013 submissions due ( extended )
- April 27, 2013 notification of acceptance
- April 30, 2013 copyright form submission deadline
- May 7, 2013 final manuscripts due
- June 18, 2013 EVIA 2013@NII, Tokyo, Japan
- June 18-21, 2013 NTCIR-10@NII, Tokyo, Japan


Charles L. A. Clarke  University of Waterloo  Canada 
Atsushi Fujii  Tokyo Institute of Technology  Japan
Donna Harman  NIST  USA 
Hideo Joho  University of Tsukuba  Japan 
Gareth Jones  Dublin City University  Ireland 
Noriko Kando  NII  Japan 
Tetsuya Sakai  Microsoft Research Asia  China 
Mark Sanderson  RMIT University  Australia 
Falk Scholer  RMIT University  Australia 
Ian Soboroff  NIST  USA 
Ruihua Song  Microsoft Research Asia  China  ( Chair )
Paul Thomas  CSIRO  Australia 
William Webber  University of Maryland  USA  ( Chair )

*** EVIA 2013 CO-CHAIRS ***

William Webber (University of Maryland, United States)

Ruihua Song (Microsoft Research Asia, Beijing, China)

[Return to Top]

Last Modified:2013.04.30