NTCIR Project Web HOME


PROGRAM: NTCIR-5 [PDF FILE]
========================================================

Pre-Conference Sessions: Tuesday, December. 6, 2005

9:00-10:30 CLIR task organizer meeting <NII's meeting room #1208-#1210 (on the 12th floor, NII)>
Closed :only CLIR task organizer

10:30-12:00 Opinion Workshop< NII's meeting room #1208-#1210 (on the 12th floor, NII) >
The attendace is open.
Chair: Hsin-Hsi Chen (National Taiwan University)
Chin-Yew Lin (University of Southern California)
Noriko Kando (National Institute of Informatics)


12:00-17:30 Registration <Entrance Lobby>

13:00-14:00 (Tutorial) Introduction to NTCIR < Mid-Conference Hall 2.3.4>
Noriko Kando (National Institute of Informatics)
* This is mainly for new comers and non-participants. Explaining brief history of NTCIR, how to use NTCIR collections, evaluation metrics and analysis, etc.


14:00-14:15 Break


14:15-15:35 Open Submission Session 1　< Mid-Conference Hall 2.3.4>
Chair: Hsin-Hsi Chen (National Taiwan University)

14:15-14:20 Welcome
Hsin-Hsi Chen

14:20-14:45
The Effect of Topic Sampling on Sensitivity Comparisons of Information Retrieval Metrics
Tetsuya Sakai

14:45-15:10Construction of an Evaluation Corpus for Opinion Extraction
Lun-Wei Ku, Tung-Ho Wu, Li-Ying Lee and Hsin-Hsi Chen

15:10-15:35
Multi-Document Summarization Reflecting Information Needs on Subjectivity
Yohei Seki, Koji Eguchi, Noriko Kando and Masaki Aono


15:35-15:50　Coffee Break


15:50-17:30 Open Submission Session 2　< Mid-Conference Hall 2.3.4>
Chair: Takashi Koga　(National Institute of Informatics)

15:50-16:15
A Two-Stage Incremental Annotation Approach to Constructing a Network Informal Language Corpus
Yunqing Xia, Kam-Fai Wong and Robert Luk

16:15-16:40
The Relationship between Answer Ranking and User Satisfaction in a Question Answering System
Tomoharu Kokubu, Tetsuya Sakai, Yoshimi Saito, Hideki Tsutsui, Toshihiko Manabe, Makoto Koyama and Hiroko Fujii

16:40-17:05
An Analysis of Question Processing of English and Chinese for the NTCIR 5 Cross-Language Question Answering Task
John Judge, Yuqing Guo, Gareth J. F. Jones and Bin Wang

Report from NTCIR-5 Pilot Workshop:
17:05-17:30
MuST: A Workshop on Multimodal Summarization for Trend Information
Tsuneaki Kato, Mitsunori Matsushita and Noriko Kando


===================================================

Main Conference　DAY 1: Wednesday, Dec. 7, 2005


9:00 Registration Open<Hitotsubashi Memorial Hall Lobby>
9:00- 9:30 Light Refreshment

9:30- 9:45 Welcome <Hitotsubashi Memorial Hall >


9:45- 10:45 Overview of NTCIR-5 <Hitotsubashi Memorial Hall >
Noriko Kando


10:45-11:00 Break


11:00-12:30 Session 1: CLIR-1 <Hitotsubashi Memorial Hall >　
Chair: Sukhoon Lee (Chungnum National University)

11:00-11:40
Overview of CLIR Task at the Fifth NTCIR Workshop
Kazuaki Kishida, Kuang-hua Chen, Sukhoon Lee, Kazuko Kuriyama, Noriko Kando, Hsin-Hsi Chen and Sung Hyon Myaeng

11:40-12:00
Word or Bi-gram for Effective Search with Asian Languages
Jacques Savoy

12:00-12:20
POSTECH at NTCIR-5: Combining Evidences of Multiple Term Extractions for Mono-Lingual and Cross-Lingual Retrieval in Korean and Japanese
Seung-Hoon Na, In-Su Kang and Jong-Hyeok Lee

12:20-12:30
Discussion


12:30-13:30 Lunch < Mid-Conference Hall 1.2.3.4>


13:30-15:20 Session 2: CLQA <Hitotsubashi Memorial Hall >
Chair: Chuan-Jie Lin (National Taiwan Ocean University)

13:30-13:52
Overview of the NTCIR-5 Cross-Lingual Question Answering Task (CLQA1)
Yutaka Sasaki, Hsin-Hsi Chen, Kuang-hua Chen and Chuan-Jie Lin

13:52-14:14
NTT's Japanese-English Cross-Language Question Answering System
Hideki Isozaki, Katsuhito Sudoh and Hajime Tsukada

14:14-14:36
CMU JAVELIN System for NTCIR5 CLQA1
Frank Lin, Hideki Shima, Mengqiu Wang and Teruko Mitamura

14:36-14:58
NTCIR-5 English-Chinese Cross-Language Question Answering Experiments using PIRCS
Kui-Lam Kwok, Peter Deng, Norbert Dinstl and Sora Choi

14:58-15:20
ASQA: Academia Sinica Question Answering System for NTCIR-5 CLQA
Cheng-Wei Lee, Cheng-Wei Shih, Min-Yuh Day, Tzong-Han Tsai, Tian-Jian Jiang, Chia-Wei Wu, Cheng-Lung Sung, Yu-Ren Chen, Shih-Hung Wu and Wen-Lian Hsu


15:20-15:40 Coffee Break


15:40-17:30 Session 3: PATENT <Hitotsubashi Memorial Hall >
Chair: Atsushi Fujii (University of Tsukuba)

15:40-16:02
Overview of　Patent Retrieval Task at NTCIR-5
Atsushi Fujii, Makoto Iwayama and Noriko Kando

16:02-16:24
Overview of Classification Subtask at NTCIR-5 Patent Retrieval Task
Makoto Iwayama, Atsushi Fujii and Noriko Kando

16:24-16:46
NTCIR-5 Patent Retrieval Experiments at Hitachi
Hisao Mase, Tadataka Matsubayashi, Yuichi Ogawa, Takaaki Yayoi, Yusuke Sato and　Makoto Iwayama

16:46-17:08
Patent Document Retrieval and Classification at KAIST
Jae-Ho Kim, Jin-Xia Huang, Ha-Yong Jung and Key-Sun Choi

17:08-17:30
Justsystem at NTCIR-5 Patent Classification
Tetsuya Tashiro, Masaki Rikitoku and Takashi Nakagawa


18:00-20:00 Banquet < Mid-Conference Hall 1.2.3.4>

==============================================

Main Conference　DAY 2: Thursday, December. 8, 2005


9:00 Registration Open　<Hitotsubashi Memorial Hall Lobby>
9:00- 9:30 Light Refreshment


9:30- 11:20 Session 4: WEB <Hitotsubashi Memorial Hall >
Chair: Masaharu Yoshioka (Hokkaido University)

9:30-10:05
Overview of the NTCIR-5 WEB Navigational Retrieval Subtask 2 (Navi-2)
Keizo Oyama, Masao Takaku, Haruko Ishikawa, Akiko Aizawa and Hayato Yamana

10:05-10:30
Exploiting Anchor Text for the Navigational Web Retrieval at NTCIR-5
Atsushi Fujii, Katunobu Itou, Tomoyosi Akiba and Tetsuya Ishikawa

10:30-10:55
Verification of Effective Retrieval Method for Anchor Text on Navigational Retrieval
Kenji Tateishi, Hideki Kawai, Dai Kusui and Toshikazu Fukushima

10:55-11:20
Overview of the NTCIR-5 WEB Query Term Expansion Subtask
Masaharu Yoshioka


11:20-11:50 Coffee Break


11:50-12:20 Boasting 1 (short presentation for DP): CLQA, PATENT, WEB
Chair: Takashi Koga (National Institute of Informatics)


12:20-14:50 Lunch & Digital Poster 1: CLQA, PATENT, WEB < Mid-Conference Hall 1.2.3.4>


CLIR

MIRACLE Retrieval Experiments with East Asian Languages
Julio Villena-Roman, Jose Miguel Goni-Menoyo, Jose C. Gonzalez-Cristobal and Jose Luis Martinez-Fernandez

CLQA

NTT's Japanese-English Cross-Language Question Answering System
Hideki Isozaki, Katsuhito Sudoh and Hajime Tsukada

CMU JAVELIN System for NTCIR5 CLQA1
Frank Lin, Hideki Shima, Mengqiu Wang and Teruko Mitamura

ASQA: Academia Sinica Question Answering System for NTCIR-5 CLQA
Cheng-Wei Lee, Cheng-Wei Shih, Min-Yuh Day, Tzong-Han Tsai, Tian-Jian Jiang, Chia-Wei Wu, Cheng-Lung Sung, Yu-Ren Chen, Shih-Hung Wu and Wen-Lian Hsu

NTCIR-5 English-Chinese Cross-Language Question Answering Experiments using PIRCS
Kui-Lam Kwok, Peter Deng, Norbert Dinstl and Sora Choi

A Method of Cross-Language Question Answering Based on Machine Translation and Transliteration -- Yokohama National University at NTCIR-5 CLQA1 ---
Tatsunori Mori and Masami Kawagishi

Japanese-to-English and English-to-Japanese Cross-Language Question Answering System Using Decreased Adding with Multiple Answers at NTCIR-5
Masaki Murata, Masao Utiyama and Hitoshi Isahara

Baseline Systems for NTCIR-5 CLQA1: An Experimentally Extended QBTE Approach
Yutaka Sasaki

Bi-directional Cross-Language Question Answering using a Single Monolingual QA System
Kei Shimizu, Tomoyosi Akiba, Atsushi Fujii and Katunobu Itou

Chinese QA and CLQA: NTCIR-5 QA Experiments at UNT
Jiangping Chen, Rowena Li, Ping Yu, He Ge, Pok Chin, Fei Li and Cong Xuan

System Description of NTOUA Group in CLQA1
Chuan-Jie Lin, Yu-Chun-Tzeng, and Hsin-Hsi Chen.

Chinese Question Answering using the DLT System at NTCIR 2005
Richard F. E. Sutcliffe, Jia Xu and Michael Mulcahy

LCC-DCU C-C Question Answering Task at NTCIR-5
Bin Wang and Gareth J.F. Jones

PATENT

A Patent Retrieval Method Using a Hierarchy of Clusters at TUT
Hironori Doi, Yohei Seki and Masaki Aono

Document Structure Analysis for the NTCIR-5 Patent Retrieval Task
Atsushi Fujii and Tetsuya Ishikawa

NTCIR-5 Patent Retrieval Experiments at RICOH
Hideo Itoh

POSTECH at NTCIR-5 Patent Retrieval: Smoothing Experiments in a Language Modeling Approach to Patent Retrieval
In-Su Kang, Seung-Hoon Na, Jun-Ki Kim and Jong-Hyeok Lee

Patent Document Retrieval and Classification at KAIST
Jae-Ho Kim, Jin-Xia Huang, Ha-Yong Jung and Key-Sun Choi

Query Terms Extraction from Patent Document for Invalidity Search
Kazuya Konishi

NTCIR-5 Patent Retrieval Experiments at Hitachi
Hisao Mase, Tadataka Matsubayashi, Yuichi Ogawa, Takaaki Yayoi, Yusuke Sato and Makoto Iwayama

Using the K Nearest Neighbor Method and BM25 in the Patent Document Categorization Subtask at NTCIR-5
Masaki Murata, Toshiyuki Kanamaru, Tamotsu Shirado and Hitoshi Isahara

Experiments on Patent Retrieval at NTCIR-5 Workshop
Hironori Takeuchi, Naohiko Uramoto and Koichi Takeda

A Distributed Retrieval System for NTCIR-5 Patent Retrieval Task
Hiroki Tanioka and Kenichi Yamamoto

Justsystem at NTCIR-5 Patent Classification
Tetsuya Tashiro, Masaki Rikitoku and Takashi Nakagawa

Automatic Categorization of Japanese Patents based on Surrogate Texts
Yuen-Hsien Tseng, Da-Wei Juang and Chi-Jen Lin

Evaluation of the Document Categorization in "Fixed-point Observatory"
Yoshihiro Ueda, Mamiko Oka, Katsunori Houchi and Akio Yamashita

WEB

Exploiting Anchor Text for the Navigational Web Retrieval at NTCIR-5
Atsushi Fujii, Katunobu Itou, Tomoyosi Akiba and Tetsuya Ishikawa

Verification of Effective Retrieval Method for Anchor Text on Navigational Retrieval
Kenji Tateishi, Hideki Kawai, Dai Kusui and Toshikazu Fukushima

NTCIR-5 WEB Navi-2 Experiments at Osaka Kyoiku University
-- Page, Anchor and Title Indexing, and In-link Count, Inter Page and Inter Site Link Analyses --
Takashi Sato and Hitoshi Nakakubo

A Distributed Retrieval System for NTCIR-5 WEB Task
Hiroki Tanioka, Kenichi Yamamoto and Takashi Nakagawa

OASIS at NTCIR-5: Web Navigation Retrieval Subtask
Vitaly Klyuev

Search Result Clustering Method at NTCIR-5 Web Query Expansion Subtask
Hiroyuki Toda and Ryoji Kataoka

Improving Web Search by Query Expansion with a Small Number of Terms
Tomonari Masada, Atsuhiro Takasu and Jun Adachi

NTCIR-5 Query Expansion Experiments using Term Dependence Models
Koji Eguchi

OPEN SUBMISSION

A Unified Approach to Japanese and English Question Answering
E.W.D. Whittaker, J. Hamonic and S. Furui


14:50-15:10 Coffee Break


15:10-17:00 Session 5: QAC <Hitotsubashi Memorial Hall >
Chair: Tsuneaki Kato (Tokyo University)

15:10-15:30
An Overview of NTCIR-5 QAC3
Tsuneaki Kato, Jun'ichi Fukumoto and Fumito Masui

15:30-16:00
Answering Questions of IAD Task using Reference Resolution of Follow-up Questions
Megumi Matsuda and Jun'ichi Fukumoto

16:00-16:30
Question Answering Experiments at NTCIR-5: Acquisition of Answer Evaluation Patterns and Context Processing using Passage Retrieval
Yuichi Murata, Tomoyosi Akiba, Atsushi Fujii and Katunobu Itou

16:30-17:00
Answering Contextual Questions Based on the Cohesion with the Knowledge -- Yokohama National University at NTCIR-5 QAC3 --
Tatsunori Mori and Shinpei Kawaguchi


17:00-18:30 CLQA1 Round table meeting <NII's meeting room #1208-#1210>
Closed: NTCIR-5 CLQA Participants only
===========================================

Main Conference　DAY 3: Friday, December. 9, 2005


9:00 Registration Open
9:00- 9:15 Light Refreshment


9:15- 10:15 Invited Talk <Hitotsubashi Memorial Hall > Hand out [PDF}

9:15-9:45
Cross Language Evaluation Forum: CLEF 2005
Gareth Jones and Carol Peters

9:45-10:15
Evaluation and Applications of Automatic Text Summarization
Chin-Yew Lin


10:15-10:20 Break


10:20-12:10 Session 6: CLIR-2 <Hitotsubashi Memorial Hall >
Chair: Kuang-hua Chen (National Taiwan University)

10:20-10:40
A Decade after TREC-4 -- NTCIR-5 CLIR-J-J Experiments at Yahoo!Japan
Sumio Fujita

10:40-11:00
I2R at NTCIR5
Yang Lingpeng and Ji Donghong

11:00-11:20
Using the Web for Translation Disambiguation: RMIT University at NTCIR-5 Chinese-English CLIR
Ying Zhang and Phil Vines

11:20-11:40
Toshiba BRIDJE at NTCIR-5 CLIR: Evaluation using Geometric Means
Tetsuya Sakai, Toshihiko Manabe, Akira Kumano, Makoto Koyama and Tomoharu Kokubu

11:40-12:00
How Similar are Chinese and Japanese for Cross-Language Information Retrieval?
Fredric C. Gey

12:00-12:10
Discussion

12:10-12:40 Boasting 2: CLIR, QAC
Chair: Fumito Masui (Mie University)


12:40-15:10 Lunch & Digital Poster 2: CLIR, QAC < Mid-Conference Hall 1.2.3.4>


CLIR

Single Language Information Retrieval at NTCIR-5
Qing Ma, Koichi Nakao, Kousuke Enomoto and Masaki Murata

Report on CLIR Task for the NTCIR-5 Evaluation Campaign
Samir Abdou and Jacques Savoy

I2R at NTCIR5
Yang Lingpeng and Ji Donghong

Toshiba BRIDJE at NTCIR-5 CLIR: Evaluation using Geometric Means
Tetsuya Sakai, Toshihiko Manabe, Akira Kumano, Makoto Koyama and Tomoharu Kokubu

Chinese Information Retrieval Based on Related Term Group
Tingting He, Guozhong Qu, Xinhui Tu and Donghong Ji

Using the Web for Translation Disambiguation: RMIT University at NTCIR-5 Chinese-English CLIR
Ying Zhang and Phil Vines

Applying Multiple Characteristics and Techniques in the NICT Information Retrieval System in NTCIR-5
Masaki Murata, Qing Ma and Hitoshi Isahara

NTCIR-5 CLIR Experiments at QUT
David Lu, Shlomo Geva, Yue Xu and Yuefeng Li

Thomson Legal and Regulatory at NTCIR-5: Japanese and Korean Experiments
Isabelle Moulinier and Ken Williams

NTCIR-5 Chinese, English, Korean Cross Language Information Retrieval Experiments using PIRCS
Kui-Lam Kwok, Sora Choi, Norbert Dinstl and Peter Deng

POSTECH at NTCIR-5: Combining Evidences of Multiple Term Extractions for Mono-lingual and Cross-lingual Retrieval in Korean and Japanese
Seung-Hoon Na, In-Su Kang and Jong-Hyeok Lee

NTCIR-5 CLIR Experiments at Oki
Tetsuji Nakagawa

MIMOR @ NTCIR 5: A Fusion-based Approach to Japanese Information Retrieval
Nina Kummer, Christa Womser-Hacker and Noriko Kando

Some Experiments with Blind Feedback and Re-ranking for Chinese Information Retrieval
Y. Xiao, R.W.P. Luk, K.F. Wong and K.L. Kwok

ISCAS in English-Chinese CLIR at NTCIR-5
Jinming Min, Le Sun and Junlin Zhang

A Decade after TREC-4 --NTCIR-5 CLIR-J-J Experiments at Yahoo!Japan
Sumio Fujita


The University of Amsterdam at NTCIR-5
Jaap Kamps, Michiel van der Bruggen and Maarten de Rijke

Comparison of Global Term Expansion Methods for Text Retrieval
Yuen-Hsien Tseng, Yu-Chin Tsai and Chi-Jen Lin

CJK Experiments with Hummingbird SearchServerTM at NTCIR-5
Stephen Tomlinson

Chinese Information Retrieval Using Lemur: NTCIR-5 CIR Experiments at UNT
Jiangping Chen, Rowena Li and Fei Li

How Similar are Chinese and Japanese for Cross-Language Information Retrieval?
Fredric C. Gey


QAC

Synthesis of Multiple Answer Evaluation Measures using a Machine Learning Technique for a QA System
Yasuharu Matsuda and Takashi Yukawa

Japanese Question-Answering System using Decreased Adding with Multiple Answers at NTCIR 5
Masaki Murata, Masao Utiyama and Hitoshi Isahara

Answering Contextual Questions Based on the Cohesion with the Knowledge -- Yokohama National University at NTCIR-5 QAC3 --
Tatsunori Mori and Shinpei Kawaguchi

Question Answering Experiments at NTCIR-5: Acquisition of Answer Evaluation Patterns and Context Processing using Passage Retrieval
Yuichi Murata, Tomoyosi Akiba, Atsushi Fujii and Katunobu Itou

Three Systems and One Verifier -- HOKUM's Participation in QAC3 of NTCIR-5
Yasutomo Kimura, Kenji Ishida, Hirotaka Imaoka, Fumito Masui, Marcin Skowron, Rafal Rzepka and Kenji Araki

Question Answering System with Fine Grain Answer Types and Search Refinement
David Ramamonjisoa

Answering Questions of IAD Task using Reference Resolution of Follow-up Questions
Megumi Matsuda and Jun'ichi Fukumoto


15:10-15:50 Break Out Session
(discussion of each task/each new task application)


15:50-16:10 Coffee Break


16:10-16:40 Wrap up <Hitotsubashi Memorial Hall >

Report out of the break-out session
Schedule after this meeting
Closing

17:30- NTCIR Advisory Board Meeting<NII's meeting room #1208-#1210 (on the 12th floor, NII)>
Closed: only Board member