[ntcir:219] Final CFP: NTCIR-6 Pre-Meeting Workshop

[Tetsuya Sakai <tetsuya.sakai@xxxxxxxxxxxxx>]

		FINAL CALL FOR PAPERS
	NTCIR-6 Pre-Meeting Workshop (PMW)
	on Information Access Evaluation
	May 15, 2007 @ NII, Tokyo, Japan.

	PMW Co-Chairs:
	Tetsuya Sakai (Toshiba Corporate R&D Center, Japan) and
	Mark Sanderson (University of Sheffield, UK)

	PMW CFP Webpage:
	http://research.nii.ac.jp/ntcir/ntcir-ws6/pmw-en.html

Evaluation of Information Retrieval, Question Answering and Text
Summarisation systems has been central to Information Access research
for decades. As retrieval has become more pervasive and diverse, the
need for effective and efficient evaluation has never been more important.
Following the success of Open Submission Sessions over the last two
years, NTCIR will hold a Pre-Meeting Workshop (PMW) on evaluation in
Information Access, which will run the day before the main sessions of
NTCIR start. We welcome submissions of high-quality papers from
participants and non-participants, especially those addressing one or
more of the following topics:

- Test collections, their formation, evaluation metrics and evaluation
environments
- Cross-conference comparison: NTCIR, CLEF, TREC, DUC and others
- Evaluation of specific information access tasks, e.g., for education
and training
- Evaluation of query-specific approaches
- Evaluation of multilingual, multimedia and/or mobile information access
- Real-world search topics and/or evaluation in vivo
- Novel information access tasks and their evaluation

The submitted papers will be blind-reviewed and those accepted will be
presented orally at the Workshop on May 15, 2007. The accepted papers
will be included in the online and printed versions of NTCIR-6
Proceedings. We expect the PMW to be more competitive than the previous
Open Submission Sessions held at NTCIR-4 and 5.

IMPORTANT DATES:
December 15, 2006: Submissions due
February 15, 2007: Notifications of acceptance
March 15, 2007: Final manuscripts due
May 15, 2007 (Day 1 of the NTCIR-6 Workshop Meeting): PMW takes place

SUBMISSION GUIDELINES:
Please use latex8.sty and sample tex source file
(ntcir_author.tex) available at the NTCIR-5 website (not NTCIR-6)
http://research.nii.ac.jp/ntcir-ws5/proceedings.html
but for the NTCIR-6 PMW please note that the following special
instructions apply:

- NUMBER OF PAGES:
We allow up to 12 pages because some evaluation papers may
involve lots of results and analyses.

- ANONYMIZE!
To facilitate blind reviewing, do NOT include the author names in your
manuscript, and "anonymize" your own citations to the best of your ability.

- PAPER SUBMISSION URL:
https://www.softconf.com/starts/ntcir6-pmw/submit.html
You can also revise your submission at the above site.
The submission site can also be reached via our PMW CFP webpage.

Finally, please note that DUPLICATE SUBMISSIONS, if detected, will be
rejected unconditionally. That is, submitting the same paper to the PMW
and to another conference simultaneously is strictly prohibited.

If you have any questions, please contact:
Tetsuya Sakai (tetsuya.sakai@xxxxxxxxxxxxx) or
Mark Sanderson (m.sanderson@xxxxxxxxxxxxxxx).

	*	*	*

NTCIR is an evaluation exercise with an Asian language focus. Last year,
NTCIR-5 attracted over 100 groups from 15 countries, the Sixth NTCIR
will be held at the National Institute of Informatics, Tokyo, Japan, May
15-17, 2007. The meeting will bring together researchers working on
information access technologies such as Monolingual/Multilingual
Information Retrieval and Question Answering, to sum up their
one-year evaluation efforts for the NTCIR-6 tracks. A number of NTCIR-6
participants will be given a chance to present their "site reports"
at the regular sessions; All participants will present their results
at the poster sessions to exchange ideas and views.