NTCIR (NII Test Collection for IR Systems) Project bNTCIRbCONTACT INFORMATIONbNIIb
NTCIR HOME

NTCIR-9 HOME
-Workshop Aims
-NEWS
-Call for Participation
-Sponsors
-Program
-Keynote
-Registration
-Venue + Travel
Accomodation
Travel Support
VISA
-Submission Instruction
-Evaluation Tasks
INTENT
Vis-EX
RITE
CrossLink
GeoTime
PatentMT
SpokenDoc
Call for Task Proposals
Call for Participation
Data
-EVIA 2011
Call for Papers
-Organizers
Coordination
Program Committee
EVIA PC
-Important Dates
-Task Participation
-Contact Us
NTCIR HOME
Past NTCIRs
Data/Tools
Proceedings
FAQ

EVIA 2011

The Fourth International Workshop on Evaluating Information
Access (EVIA 2011), a Satellite Workshop of NTCIR-9

December 6, 2011 at National Institute of Informatics, Tokyo, Japan.


***** EVIA 2011: Final CALL FOR PAPERS *****

** NOTE: submssion deadline extended to 1st October 2011!

The Fourth International Workshop on Evaluating Information
Access (EVIA 2011), a Satellite Workshop of NTCIR-9
http://research.nii.ac.jp/ntcir/evia2011/

December 6, 2011 at NII, Tokyo, Japan

****************************************

Information Access technologies provide the interface between human information needs and digital information resources. The reliable evaluation of these technologies has been recognized for decades as central to the advancement of the field. As information retrieval becomes more pervasive, the forms of retrieval more diverse, and retrieval tools richer, the importance of effective, efficient, and innovative evaluation grows as well.

In recognition of the need for a forum dedicated to the intensive discussion of evaluation issues, we have held three successful sesquiannual International Workshops on Evaluating Information Access (EVIA 2007, 2008, and 2010). Proceedings and reports can be found below:
EVIA 2007 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings6/EVIA/
EVIA 2008 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings7/toc_evia.html
EVIA 2010 online proceedings:
http://research.nii.ac.jp/ntcir/workshop/OnlineProceedings8/EVIA/index.html

SIGIR Forum Report on EVIA 2007:
http://sigir.org/forum/2007D/2007d_sigirforum_sanderson.pdf
SIGIR Forum Report on EVIA 2008:
http://sigir.org/forum/2009J/2009j-sigirforum-sakai.pdf
SIGIR Forum Report on EVIA 2010:
http://www.sigir.org/forum/2010D/othwksp/2010d_sigirforum_webber.pdf
Following these successes, we are happy to announce the Fourth International Workshop on Evaluating Information Access (EVIA 2011) on December 6, 2011 (coinciding with Day 1 of the NTCIR-9 Workshop Meeting) at the National Institute of Informatics (NII), Tokyo, Japan. We invite papers addressing one or more of the following topics:
- Test collection formation, evaluation metrics, and evaluation environments
- Statistical issues in retrieval evaluation
- User studies and the evaluation of human-computer interaction in information retrieval (HCIR)
- Evaluation methods for multilingual, multimedia, or mobile information access
- Novel information access tasks and their evaluation
- Evaluation and assessment using implicit user feedback, crowdsourcing, living labs, or inferential methods
- Evaluation issues in industrial and enterprise retrieval systems

*** SUBMISSION INSTRUCTIONS ***

Submissions will be subject to double-blind reviewing. Accepted papers will be included in the EVIA 2011 online proceedings, and summarized in a report to SIGIR Forum.

We invite submissions of regular papers (up to 8 pages) and short papers (up to 4 pages). Submissions must be in the ACM Conference style and must be submitted as pdf files.

Templates are available at:

http://www.acm.org/sigs/publications/proceedings-templates

For Latex users, please use the "Option 2" style.

Submissions must be made through the EVIA 2011 submission management system at:

https://www.easychair.org/conferences/?conf=evia2011

*** IMPORTANT DATES ***

- October 1, 2011 *submissions due*
- October 15, 2011 notification of acceptance
- October 31, 2011 final manuscripts due
- December 6, 2011 EVIA 2011@NII, Tokyo, Japan
- December 6-9, 2011 NTCIR-9@NII, Tokyo, Japan

*** EVIA 2011 PROGRAM COMMITTEE ***

Nicholas Belkin Rutgers University USA
Hsin-Hsi Chen National Taiwan University Taiwan
Charlie Clarke University of Waterloo Canada
Georges Dupret Yahoo! Research Chile
Atsushi Fujii Tokyo Institute of Technology Japan
Donna Harman NIST USA
Hideo Joho University of Tsukuba Japan
Gareth Jones Dublin City University Ireland
Noriko Kando NII Japan
Evangelos Kanoulas University of Sheffield UK
Kazuaki Kishida Keio University Japan
Tetsuya Sakai Microsoft Research Asia China
Mark Sanderson RMIT University Australia
Falk Scholer RMIT University Australia
Ian Soboroff NIST USA
Ruihua Song Microsoft Research Asia China
Paul Thomas CSIRO Australia
William Webber University of Melbourne Australia
Emine Yilmaz Microsoft Research Cambridge UK

*** EVIA 2011 CO-CHAIRS ***

Kazuaki Kishida (Keio University, Japan)
kishida
Mark Sanderson (RMIT University, Australia)
mark.sanderson
William Webber (University of Melbourne, Australia)
wew

Last Modified:2011.09.15