Contents

Supplement Volume 1 : WEB Task (WEB)

Overview of WEB Task at NTCIR-4 [paper]

Koji Eguchi, Keizo Oyama, Akiko Aizawa and Haruko Ishikawa

Overview of the Informational Retrieval Task at NTCIR-4 WEB [paper]

Koji Eguchi, Keizo Oyama, Akiko Aizawa and Haruko Ishikawa

An Evaluation Method of Web Search Engines based on User's Sense [paper]

Takashi Ohtsuka, Koji Eguchi and Hayato Yamana

Overview of the NTCIR-4 WEB Navigational Retrieval Task 1 [paper]

Keizo Oyama, Koji Eguchi, Haruko Ishikawa and Akiko Aizawa

Preliminary Workshop on Evaluation of Geographic Information Retrieval Systems for Web Documents [paper]

Masatoshi Arikawa, Takeshi Sagara, Kouzou Noaki and Hideyuki Fujita

Overview of the Topical Classification Task at NTCIR-4 WEB [paper]

Koji Eguchi

Web Searching Using Term Entropy and Query Independent Importance in NTCIR-4 Web Task [paper] [talk]

Yinghui Xu and Kyoji Umemura

Study on the Combination of Probabilistic and Boolean IR Models for WWW Documents Retrieval [paper] [talk] [poster]

Masaharu Yoshioka and Makoto Haraguchi

R²D² at NTCIR-4 Web Retrieval Task [paper]

Teruhito Kanazawa, Tomonari Masada, Atsuhiro Takasu and Jun Adachi

NTCIR-4 WEB Experiments at Osaka Kyoiku University - Static/Dynamic Scoring Using Link Structure Analysis and Web Page Grouping - [paper]

Hitoshi Nakakubo, Peng Zhang and Takashi Sato

Experiments on Web Retrieval Driven by Spontaneously Spoken Queries [paper]

Tomoyosi Akiba, Atsushi Fujii, Katunobu Itou and Tetsuya Ishikawa

Navigation Retrieval with Site Anchor Text [paper] [talk]

Hideki Kawai, Kenji Tateishi and Toshikazu Fukushima

Overlapping Clustering Method Using Local and Global Importance of Feature Terms at NTCIR-4 Web Task [paper-revised version] [erratum]

Manabu Ohta, Hirokazu Narita and Shigeyoshi Ohno

A Web Search Result Classification System based on the degree of Suitability for Specialists [paper]

Masanobu Tsuruta, Yoshiyuki Umemura, Hiroyuki Sakai and Shigeru Masuyama

Giving an Upperbound of the Number of Clusters and Relevant Words in Hierarchical Document Clustering based on BIC [paper]

Yoshio Fukushige

Web Document Clustering using Threshold Selection Partitioning [paper]

Minoru Sasaki and Hiroyuki Shinnou

Document Clustering at NTCIR-4 Workshop: Limiting Search Space of the K-means method using Word Occurrence [paper]

Yuji Kaneda, Naonori Ueda and Kazumi Saito

Contents

Supplement Volume 2 : Open Submission and Invited Talks

<Open Submission>

[Main Talk]

Looking for a Few Good Metrics: ROUGE and its Evaluation [paper]

Chin-Yew Lin

New Performance Metrics based on Multigrade Relevance: Their Application to Question Answering [paper]

Tetsuya Sakai

Towards Innovative Evaluation Methodologies for Speech Translation [paper]

Michael Paul, Hiromi Nakaiwa and Marcello Federico

Aligning Patent Claims with Detailed Descriptions for Readability [paper]

Akihiro Shinmori and Manabu Okumura

Evaluating ADM on a Four-Level Relevance Scale Document Set from NTCIR [paper] [talk]

Vincenzo Della Mea, Luca Di Gaspero and Stefano Mizzaro

[Appendix]

ANOTHER APPENDIX TO New Performance Metrics based on Multigrade Relevance: Their Application to Question Answering [appendix]

Tetsuya Sakai

<Invited Talks>

A Tale of Two Evaluations: TREC and RIA [title] [talk]

Donna Harman

Cross-Language Evaluation Forum: From CLEF 2003 to CLEF 2004 [title] [talk]

Carol Peters , Martin Braschler and Jacques Savoy