[Date Prev][Date Next][Date Index]

[ntcir:268] CFP: FIRE (Forum for Information Retrieval Evaluation)





FIRE
(Forum for Information Retrieval Evaluation)
Workshop
Kolkata, India
12-14th December 2008

http://www.isical.ac.in/~fire

The success of TREC, CLEF, and NTCIR has clearly established
the importance of building reusable, large-scale standard
test collections in Information Access research. The aim of
FIRE is to encourage research in Indian language Information
Access by creating a similar platform for Indian languages
that provides the data and a common forum for comparing
models and techniques.



The Tasks:
==========
1) Ad-hoc monolingual document retrieval in six Indian
languages viz. Hindi, Bangla, Marathi, Tamil, Telugu, Punjabi.

2) Ad-hoc cross-lingual document retrieval
a) from Hindi, Bangla, Marathi, Tamil, Telugu, Punjabi to
English and Hindi.
b) from English to any of the six Indian languages
(Hindi, Bangla, Marathi, Tamil, Telugu, Punjabi).


The Time Line:
==============
Training data released May 31 2008
Test data released July 1 2008
Ad-Hoc monolingual run submission September 15 2008
Ad-hoc cross-lingual run submission September 15 2008
Relevance judgements released December 1 2008
Workshop December 12-14 2008


Task Co-ordinators: (mono- and cross-lingual)
===================
Hindi: Pushpak Bhattacharyya (pb@xxxxxxxxxxxxxx)
Bangla: Mandar Mitra (mandar@xxxxxxxxxxxx)
Marathi: Om Damani (damani@xxxxxxxxxxxxxx)
Tamil: L. Sobha (sobha@xxxxxxxxxx)
Telugu: Vasudev Verma (vv@xxxxxxxxxx)
Punjabi: Karunesh Arora (karunesharora@xxxxxxxxxxxx)

Overall co-ordinators:
Mandar Mitra, Prasenjit Majumder
Indian Statistical Institute, Kolkata
{mandar,prasenjit_t}@isical.ac.in


International Advisory Committee for FIRE:
Ricardo Baeza-Yates, Yahoo! Research Labs, Spain
Hsin-Hsi Chen, National Taiwan University, Taipei, Taiwan
Tat-Seng Chua, National University of Singapore, Singapore
Christian Fluhr, CEA, France
Norbert Fuhr, University of Duisburg, Germany
Donna Harman, National Institute of Standards and Technology, USA
Noriko Kando, National Institute of Informatics, Tokyo, Japan
Krishna Kummamuru, IBM Research Lab, India
Mun Kew Leong, Institute for Infocomm Research, Singapore
Paul McNamee, Johns Hopkins University, USA
Sung Hyon Myaeng, Information and Communications University, South Korea
Hwee Tou Ng, National University of Singapore, Singapore
Doug Oard, University of Maryland, USA
Iadh Ounis, University of Glasgow, UK
Lim Ee Peng, Nanyang Technological University, Singapore
Carol Peters, ISTI-CNR, Italy
Stephen Robertson, Microsoft Research, Cambridge, UK
Tetsuya Sakai, NewsWatch Inc., Japan
Mark Sanderson, University Of Sheffield, UK
Jacques Savoy, University of Neuchatel, Switzerland
Fabrizio Sebastiani, ISTI-CNR, Italy
Amit Singhal, Google Fellow, USA
Ian Soboroff, National Institute of Standards and Technology, USA
Ellen Voorhees, National Institute of Standards and Technology, USA