[ntcir:286] Call for VERY SHORT papers at EVIA 2008 (NTCIR-7 Day1)

["Tetsuya Sakai (home)" <tetsuyasakai@xxxxxxxxxxxxxxxx>]

#########################################################
CALL FOR NONREFEREED "VERY SHORT" PAPERS AT EVIA 2008

The Second International Workshop on Evaluating Information Access
(EVIA 2008) will take place on Day 1 of the NTCIR-7 Meeting (Dec 16)
at NII, Tokyo. Six regular papers and five short papers have been accepted
and will be presented at the workshop (SEE BELOW).

In addition, we would like to organise a session
consisting of *five-minute talks*, to provide an opportunity for:
(a) NTCIR participants who would like to discuss some specific evaluation
issues
(metrics, data, methods);
(b) ANYONE (including non-NTCIR participants) who would like to
discuss possible future NTCIR tasks, evaluation issues in general,
and/or present late-breaking results on evaluation.

All NTCIR participants are expected to describe their *systems*
at the main NTCIR sessions. Whereas the focus of EVIA
is on *how to evaluate* those systems.

If you would like to contribute to this session,
please submit a "very short" paper (up to TWO pages)
to
https://www.softconf.com/s08/EVIA2008/
by *November 2*.

Please use the latex style file available at:
http://ntcir.nii.ac.jp/index.php/EVIA-2008/
otherwise your paper will not be included in the session.
A word template is also available at
http://research.nii.ac.jp/ntcir/ntcir-ws7/meeting/proceedings.html

Unlike the regular and short papers,
these "very-short" papers will NOT be reviewed.
However, we will NOT accept papers that
do not match either of Categories (a) and (b) shown above.
Late submissions, as well as those that do not conform to
the style guidelines and the page limit, will not be accepted either.


For further questions, please contact the EVIA chairs:
Mark Sanderson (m.sanderson@xxxxxxxxxxxxxxx)
and
Tetsuya Sakai (tetsuyasakai@xxxxxxx).


### ACCEPTED REGULAR PAPERS ###

Modelling A User Population for Designing Information Retrieval Metrics
Tetsuya Sakai and Stephen Robertson

Evaluating Answer Validation in Distributed Question Answering
Alvaro Rodrigo, Anselmo Penas and Felisa Verdejo

A methodology for building a patent test collection for prior art search
Erik Graf and Leif Azzopardi

Measuring User Relevance Criteria
Falk Scholer, Andrew Turpin and Mingfang Wu

Stability of INEX 2007 Evaluation Measures
Sukomal Pal, Mandar Mitra and Arnab Chakraborty

Information Access Tasks and Evaluation from Personal Information Archives
Gareth Jones, Cathal Gurrin, Liadh Kelly, Daragh Byrne and Yi Chen

### ACCEPTED SHORT PAPERS ###

A First Investigation on Mongolian Information Retrieval
Guanglai Gao and Hongxu Hou

Component Analysis of a Chinese Factoid Question-Answering System
Kui-Lam Kwok

Visualization of User Eye Movements for Search Result Pages
Yuka Egusa, Masao Takaku, Hitoshi Terai, Hitomi Saito, Noriko Kando and
Makiko Miwa

Relevance Levels for Patent Mining
Fredric Gey and Ray Larson

The CHORUS gap analysis on User-centered methodology for design and
evaluation of multi-media information access systems
Jussi Karlgren

#########################################################