NTCIR Home > NTCIR-10 > NTCIR-10 Conference > Program

The 10th NTCIR Conference

Program

DAY-1 June 18 Tuesday: Breakout Sessions & EVIA 2013

9:30 - Registration Open (9:30-17:00)
10:00 - 12:00 Breakout Sessions Schedule & Room Guide (DAY1 and DAY3)



12:00 - 13:00 Lunch break (your own)*

13:00 - 17:00 The 5th International Workshop on Evaluating Information Access (EVIA 2013)
Co-Chairs: Ruihua Song, William Webber
13:00 - 14:20 Session 1: Metrics and Measures
Session Chair: Ian Soboroff (National Institute of Standards and Technology, USA)
  13:00 - 13:25  The Unreusability of Diversified Search Test Collections
Tetsuya Sakai (Microsoft Research Asia, P.R.China)
  13:25 - 13:50  A Subtopic Taxonomy-Aware Framework for Diversity Evaluation
Fei Chen, Yiqun Liu, Min Zhang, Shaoping Ma and Lei Chen (Tsinghua University, P.R.China)
  13:50 - 14:05  Nugget-Based Computation of Graded Relevance
Charles Clarke (University of Waterloo, Canada) 
  14:05 - 14:20 User Perception of Search Task Differentiation
Seyedeh Sargol Sadeghi, Mark Sanderson and Falk Scholer (RMIT University Melbourne, Australia)
14:20 - 14:45   Coffee Break 
14:45 - 15:40  Session 2: Designing and Evaluating Collections
Session Chair: Charles Clarke (University of Waterloo, Canada)
  14:45 - 15:10  Extrinsic Evaluation of Patent MT: Review and Commentary
Douglas Oard (University of Maryland College Park, USA) and Noriko Kando (National Institute of Informatics Tokyo, Japan)
  15:10 - 15:25 Creation of a New Medical Information Retrieval Evaluation Benchmark Targeting Patients Needs
Lorraine Goeuriot, Liadh Kelly, Gareth J F Jones (Dublin City University, Ireland), Guido Zuccon (CSIRO, Australia), Hanna Suominen (National ICT Australia and the Australian National University, Australia), Allan Hanbury (Vienna University of Technology, Austria), Henning Muller (HES–SO, Switzerland) and Johannes Leveling (Dublin City University, Ireland)
  15:25 - 15:40 Biomedical Test Collection with Multiple Query Representation
Borim Ryu and Jinwook Choi (Seoul National University, Korea)
 15:40 - 16:00   Coffee Break 
16:00 - 16:55  Session 3: Novel Tasks 
Session Chair: Tetsuya Sakai (Microsoft Research Asia, P.R.China)
  16:00 - 16:25 Evaluating Flowchart Recognition for Patent Retrieval
Mihai Lupu, Florina Piroi and Allan Hanbury (Vienna University of Technology, Austria)
  16:25 - 16:40 Evaluating Contextual Suggestion
Adriel Dean-Hall, Charles Clarke (University of Waterloo, Canada), Paul Thomas (CSIRO, Austria) and Jaap Kamps (University of Amsterdam, Netherlands)
  16:40 - 16:55  Evaluation Metrics for Nuclear Forensics Search
Fredric Gey, Charles Wang, Chloe Reynolds, Ray Larson and Electra Sutton (University of California, USA)

* Lunch is not provided

PAGE TOP

DAY-2 June 19 Wednesday: NTCIR-10 Conference

8:45 -Registration Open (8:45-17:00)
9:20 - 9:45Welcome & Introduction
Noriko Kando (National Institute of Informatics Tokyo, Japan)
Session Chair: Hideo Joho (University of Tsukuba, Japan) & Tetsuya Sakai (Microsoft Research Asia, P.R.China)
9:45 - 10:30Overview of NTCIR-10
Hideo Joho (University of Tsukuba, Japan)
Session Chair: Tetsuya Sakai (Microsoft Research Asia, P.R.China)
10:30 - 10:40Ten minutes break
10:40 - 11:30Keynote1
Title:Knowledge in Search
Shashidhar (Shashi) Thakur, Google
Session Chair: Noriko Kando (National Institute of Informatics Tokyo, Japan)
11:30 - 12:30Task Overview-1 (RITE, CrossLink)
Session Chair: Hideo Joho (University of Tsukuba, Japan)

Overview of the Recognizing Inference in Text (RITE-2) at NTCIR-10
Yotaro Watanabe (Tohoku University, Japan), Yusuke Miyao (National Institute of Informatics, Japan), Junta Mizuno (Tohoku University, Japan), Tomohide Shibata (Kyoto University, Japan), Hiroshi Kanayama (IBM Research – Tokyo, Japan), Cheng-Wei Lee (Academia Sinica, Taiwan), Chuan-Jie Lin (National Taiwan Ocean University, Taiwan), Shuming Shi (Microsoft Research Asia, P.R.China), Teruko Mitamura (Carnegie Mellon University, U.S.A), Noriko Kando (National Institute of Informatics, Japan), Hideki Shima (Carnegie Mellon University, U.S.A), Kohichi Takeda (IBM Research – Tokyo, Japan)

Overview of the NTCIR-10 Cross-Lingual Link Discovery Task
Ling-Xiang Tang (Queensland University of Technology, Australia), In-Su Kang (Kyungsung University, South Korea), Fuminori Kimura (Ritsumeikan University, Japan), Yi-Hsun Lee (Academia Sinica, Taiwan), Andrew Trotman (University of Otago, New Zealand), Shlomo Geva, Yue Xu (Queensland University of Technology, Australia)

12:30 - 13:50BUFFET LUNCH with POSTERs & DEMO1: CrossLink and RITE [Poster List]

13:50 - 14:40Keynote2
Title:Time-Biased Gain
Charles Clarke, University of Waterloo, Canada
Session Chair: Douglas Oard (University of Maryland College Park, USA)
14:40 - 15:40Task Overview-2 (INTENT, 1CLICK)
Session Chair: Mark Sanderson (RMIT University, Australia)

Overview of the NTCIR-10 INTENT-2 Task
Tetsuya Sakai, Zhicheng Dou (Microsoft Research Asia, P.R.China), Takehiro Yamamoto (Kyoto University, Japan) Yiqun Liu, Min Zhang (Tsinghua University, P.R.China) and Ruihua Song (Microsoft Research Asia, P.R.China)

Overview of the NTCIR-10 1CLICK-2 Task
Makoto P. Kato (Kyoto University, Japan), Matthew Ekstrand-Abueg, Virgil Pavlu (Northeastern University, USA), Tetsuya Sakai (Microsoft Research Asia, P.R.China), Takehiro Yamamoto (Kyoto University, Japan) and Mayu Iwata (Osaka University, Japan)
15:40 - 16:00Twenty minutes break
16:00 - 18:00 Task Overview-3 (MATH, MedNLP, SpokenDoc, PatentMT)
Session Chair: Tsuneaki Kato (The University of Tokyo, Japan)

NTCIR-10 Math Pilot Task Overview
Akiko Aizawa (National Institute of Informatics, Japan), Michael Kohlhase (Jacobs University Bremen, Germany) and Iadh Ounis (University of Glasgow, UK)

Overview of the NTCIR-10 MedNLP Task
Mizuki Morita (The University of Tokyo, Japan), Yoshinobu Kano (JST PRESTO, Japan) , Tomoko Ohkuma (Fuji Xerox Co. Ltd., Japan), Mai Miyabe (The University of Tokyo, Japan) and Eiji Aramaki (The University of Tokyo, Japan)

Overview of the NTCIR-10 SpokenDoc-2 Task
Tomoyosi Akiba (Toyohashi University of Technology, Japan), Hiromitsu Nishizaki (University of Yamanashi, Japan), Kiyoaki Aikawa (Tokyo University of Technology, Japan) , Xinhui Hu (National Institute of Information and Communications Technology, Japan), Yoshiaki Itoh (Iwate Prefectural University, Japan), Tatsuya Kawahara (Kyoto University, Japan), Seiichi Nakagawa (Toyohashi University of Technology, Japan), Hiroaki Nanjo (Ryukoku University, Japan) and Yoichi Yamashita (Ritsumeikan University, Japan)

Overview of the Patent Machine Translation Task at the NTCIR-10 Workshop
Isao Goto (National Institute of Information and Communications Technology, Japan), Ka Po Chow (Hong Kong Institute of Education, Hong Kong), Bin Lu (City University of Hong Kong, Hong Kong), Eiichiro Sumita (National Institute of Information and Communications Technology, Japan) and Benjamin K. Tsou (Hong Kong Institute of Education, Hong Kong)

19:00 - 21:00Banquet ( at Gakushi-kaikan )

PAGE TOP

DAY-3 June 20 Thursday: NTCIR-10 Conference

9:00- 11:40:
13:00-17:00:

8:45 - Registration Open (8:45-17:00)

9:20 - 11:40 Parallel Session A-1: NTCIR-10 SpokenDoc Task (SpokenDoc)
Session Chair: Tomoyosi Akiba (Toyohashi University of Technology, Japan)
  Using Multiple Speech Recognition Results to Enhance STD with Suffix Array on the NTCIR-10 SpokenDoc-2 Task
Kouichi Katsurada, Koudai Katsuura, Kheang Seng , Yurie Iribe (Toyohashi University of Technology, Japan) and Tsuneo Nitta (Waseda University, Japan) 
  An STD system for OOV query terms integrating multiple STD results of various subword units
Kazuma Kon'no, Hiroyuki Saito, Shirou Narumi, Kenta Sugawara, Kesuke Kamata, Manabu Kon'no, Jinki Takahashi and Yoshiaki Itoh (Iwate Prefectural University, Japan) 
  Spoken Content Retrieval Using Distance Combination and Spoken Term Detection Using Hash Function for NTCIR10 SpokenDoc2 task
Satoru Tsuge (Daido University, Japan), Ken Ichikawa, Norihide Kitaoka, Kazuya Takeda (Nagoya University, Japan), and Kenji Kita (The University of Tokushima, Japan) 
  Break 
  DCU at NTCIR-10 SpokenDoc2 Passage Retrieval Task
Maria Eskevich and Gareth J. F. Jones (Dublin City University, Ireland) 
  Spoken document retrieval using extended query model and web documents
Kiichi Hasegawa, Masanori Takehara, Satoshi Tamura and Satoru Hayamizu (Gifu University, Japan) 
  Spoken Document Retrieval Experiments for SpokenDoc-2 at Ryukoku University (RYSDT)
Hiroaki Nanjo, Tomohiro Nishio and Takehiko Yoshimi (Ryukoku University, Japan) 

9:20 - 11:40 Parallel Session B-1: NTCIR-10 MedNLP Task (MedNLP)
Session Chair: Yoshinobu Kano (JST PRESTO, Japan) and Tomoko Ohkuma (Fuji Xerox Co. Ltd., Japan)
   Overview of the NTCIR-10 MedNLP Task
Mizuki Morita (The University of Tokyo, Japan), Yoshinobu Kano (JST PRESTO, Japan), Tomoko Ohkuma (Fuji Xerox Co. Ltd., Japan), Mai Miyabe, Eiji Aramaki (The University of Tokyo, Japan)
   NTCIR-10 MedNLP Task Baseline System
Hiroto Imachi, Mizuki Morita and Eiji Aramaki (The University of Tokyo, Japan)
  UT-FX at NTCIR-10 MedNLP: Incorporating Medical Knowledge to Enhance Medical Information Extraction
Yasuhide Miura, Tomoko Ohkuma, Hiroshi Masuichi (Fuji Xerox Co., Ltd., Japan), Emiko Yamada Shinohara (The University of Tokyo Hospital, Japan), Eiji Aramaki (The University of Tokyo, Japan) and Kazuhiko Ohe (The University of Tokyo Hospital, Japan) 
   NECLA at the Medical Natural Language Processing Pilot Task (MedNLP)
Pierre-Francois Laquerre and Christopher Malon (NEC Laboratories America, USA)
   HCRL at NTCIR-10 MedNLP Task
Osamu Imaichi, Toshihiko Yanase and Yoshiki Niwa (Hitachi, Ltd., Japan)
   Improvement Recall of NTCIR-MedNLP using Hierarchical Bayesian Language Models
Ryo Fujii (Keio University, Japan), Masashi Tada and Hisao Kuroda (Mathematical Systems, Inc., Japan)
  Clinical Entity Recognition Using Cost-Sensitive Structured Perceptron for NTCIR-10 MedNLP
Shohei Higashiyama, Kazuhiro Seki and Kuniaki Uehara (Kobe University, Japan)
  Identifying Symptoms and Diseases in MedNLP Japanese Materials Using Chinese Resources
Lun-Wei Ku (Academia Sinica, Taiwan), Edward T.-H. Chu, Cheng-Wei Sun and Wan-Lun Li (National Yunlin University of Science and Technology, Taiwan)
  Medical Information Extracting System by Bootstrapping of NTTDRDH at NTCIR-10 MedNLP Task
Yuji Nomura, Takashi Suenaga, Daisuke Satoh, Megumi Ohki and Toru Takaki (NTT DATA Corporation, Japan)
  Complaint and Diagnosis Extraction System Utilizing Rule-based Term Extraction System
Koichi Takeuchi, Shozaburo Minamoto and Motoki Yamasaki (Okayama University, Japan) 
  A Simple Approach to NTCIR-10 MedNLP task
Yuka Tateisi (National Institute of Informatics, Japan) and Takashi Okumura (National Institute of Public Health, Japan) 
  Discussions: Next Challenge for MedNLP 

11:40 - 13:00 BUFFET LUNCH with POSTERs & DEMO2 : INTENT, MedNLP and SpokenDoc [Poster List]

13:00 - 17:00 Parallel Session A-2: NTCIR-10 Recognizing Inference in Text Task (RITE)
Session Chair: Yotaro Watanabe (Tohoku University, Japan)
Local Graph Matching with Active Learning for Recognizing Inference in Text at NTCIR-10
Tsuyoshi Okita (Dublin City University, Ireland)
Team SKL’s Strategy and Experience in RITE2
Shohei Hattori and Satoshi Sato (Nagoya University, Japan)
BnO at NTCIR-10 RITE: A Strong Shallow Approach and an Inference-based Textual Entailment Recognition System
Ran Tian, Yusuke Miyao, Takuya Matsuzaki (National Institute of Informatics, Japan) and Hiroyoshi Komatsu (Tokai University Bosei Senior High School, Japan)
FLL: Local Alignments based Approach for NTCIR-10 RITE-2
Takuya Makino, Seiji Okajima and Tomoya Iwakura (Fujitsu Laboratories Ltd., Japan)
IASL RITE System at NTCIR-10
Cheng-Wei Shih, Chad Liu , Cheng-Wei Lee and Wen-Lian Hsu (Academia Sinica, Taiwan)
The WHUTE System in NTCIR-10 RITE Task
Han Ren, Hongmiao Wu, Chen Lv, Donghong Ji and Jing Wan (Wuhan University, P.R.China)
Coffee Break
Detecting Contradiction in Text by Using Lexical Mismatch and Structural Similarity
Daniel Andrade, Masaaki Tsuchida, Takashi Onishi and Kai Ishikawa (NEC Corporation, Japan)
Expanded Dependency Structure based Textual Entailment Recognition System of NTTDATA for NTCIR10-RITE2
Megumi Ohki , Takashi Suenaga, Daisuke Satoh , Yuji Nomura and Toru Takaki (NTT DATA Corporation, Japan)
BCMI-NLP Labeled-Alignment-Based Entailment System for NTCIR-10 RITE-2 Task
Xiao-Lin Wang, Hai Zhao and Bao-Liang Lu (Shanghai Jiao Tong University, P.R. China)
   IMTKU Textual Entailment System for Recognizing Inference in Text at NTCIR-10 RITE2
Min-Yuh Day, Chun Tu, Shih-Jhen Huang, Hou-Cheng Vong and Sih-Wei Wu (Tamkang University, Taiwan)
   overall discussion 

13:00 - 14:55 Parallel Session B-2: NTCIR-10 Intent Task (INTENT)
Session Chair: Tetsuya Sakai (Microsoft Research Asia, P.R.China)
THUIR at NTCIR-10 INTENT-2 Task
Yufei Xue, Fei Chen, Aymeric Damien, Cheng Luo, Xin Li , Shuai Huo, Min Zhang, Yiqun Liu and Shaoping Ma (Tsinghua University, P.R.China)
Understanding the Query: THCIB and THUIS at NTCIR-10 Intent Task
Junjun Wang , Guoyu Tang, Yunqing Xia, Qiang Zhou, Fang Zheng (Tsinghua University, P.R.China), Qinan Hu, Sen Na and Yaohai Huang (Canon Information Technology (Beijing) Co. Ltd., P.R.China)
HULTECH at the NTCIR-10 INTENT-2 Task: Discovering User Intents through Search Results Clustering
Jose Moreno and Gaël Dias (University of Caen Lower-Normandy,France)
The KLE’s Subtopic Mining System for the NTCIR-10 INTENT-2 Task
Se-Jong Kim and Jong-Hyeok Lee (Pohang University of Science and Technology, Korea)
Microsoft Research Asia at the NTCIR-10 Intent Task
Kosetsu Tsukuda (Kyoto University, Japan), Zhicheng Dou and Tetsuya Sakai ( Microsoft Research Asia, P.R.China)
Discussions: No More Diversified Search Tasks?
14:55 - 17:10 Parallel Session B-3: NTCIR-10 Cross-lingual Link Discovery Task (CrossLink)
Session Chair: Shlomo Geva (Queensland University of Technology, Australia)
Simple Yet Effective Methods for Cross-Lingual Link Discovery (CLLD) - KMI @ NTCIR-10 CrossLink-2
Petr Knoth and Drahomira Herrmannova (The Open University,UK)
  Osaka Kyoiku University at NTCIR-10 CrossLink
Takashi Sato (Osaka Kyoiku University,Japan)
KECIR at NTCIR-10 Cross-Lingual Link Discovery Task
Jianxi Zheng, Yu Bai , Cheng Guo and Dongfeng Cai (Shenyang Aerospace University, P.R.China)
   Coffee break
  UKP at CrossLink2: CJK-to-English Subtasks
Jungi Kim and Iryna Gurevych (Technische Universität Darmstadt, Germany)
  NTHU at NTCIR-10 CrossLink-2: An Approach toward Semantic Features
Yu-Lan Liu, Joanne Boisson and Jason S. Chang (National Tsing Hua University, Taiwan)
   Discussions: Future CLLD

PAGE TOP

DAY-4 June 21 Friday

9:00-12:00:
8:45 - Registration Open (8:45-15:00)
9:00 - 12:00 Parallel Session A: NTCIR-10 Patent Machine Translation Task (PatentMT)
Session Chair: Isao Goto (National Institute of Information and Communications Technology, Japan)
BBN's Systems for the Chinese-English Sub-task of the NTCIR-10 PatentMT Evaluation
Zhongqiang Huang, Jacob Devlin and Spyros Matsoukas (Raytheon BBN Technologies,USA)
NTT-NII Statistical Machine Translation for NTCIR-10 PatentMT
Katsuhito Sudoh, Jun Suzuki , Hajime Tsukada, Masaaki Nagata (NTT Communication Science Laboratories, Japan), Sho Hoshino and Yusuke Miyao (National Institute of Informatics, Japan)
*The System Combination RWTH Aachen - SYSTRAN for the NTCIR-10 PatentMT Evaluation
Minwei Feng Markus Freitag, Hermann Ney (RWTH Aachen University, Germany), Bianka Buschbeck, Jean Senellart (SYSTRAN S.A., France) and Jin Yang (SYSTRAN Software, France)
*The RWTH Aachen System for NTCIR-10 PatentMT
Minwei Feng, Christoph Schmidt, Joern Wuebker, Markus Freitag and Hermann Ney (RWTH Aachen University,Germany)
(RWSYS and RWTH will jointly make one presentation.)
SRI's Submissions to Chinese-English PatentMT NTCIR10 Evaluation
Bing Zhao, Jing Zheng, Wen Wang, and Nicolas Scheffer (SRI International, USA)
10 minutets Break
The HDU Discriminative SMT System for Constrained Data PatentMT at NTCIR10
Patrick Simianer, Gesa Stupperich, Laura Jehl , Katharina Wäschle, Artem Sokolov, and Stefan Riezler (Heidelberg University, Germany)
FUN-NRC: Paraphrase-augmented Phrase-based SMT Systems for NTCIR-10 PatentMT
Atsushi Fujita (Future University Hakodate, Japan) and Marine Carpuat (the National Research Council, Canada)
Machine translation system for patent documents combining rule-based translation and statistical postediting applied to the NTCIR-10 PatentMT Task
Terumasa Ehara (Yamanashi Eiwa College, Japan)
The TRGTK's System Description of the PatentMT Task at the NTCIR-10 Workshop
Hao Xiong and Weihua Luo (Torangetek Inc., P.R.China)

9:00 - 10:35 Parallel Session B-1: NTCIR-10 One Click Access Task (1CLICK)
Session Chair: Makoto P. Kato (Kyoto University, Japan)
TTOKU Summarization Based Systems at NTCIR-10 1CLICK-2 task
Hajime Morita, Ryohei Sasano, Hiroya Takamura and Manabu Okumura (Tokyo Institute of Technology, Japan)
MSRA at NTCIR-10 1CLICK-2
Kazuya Narita (Tohoku University, Japan), Tetsuya Sakai , Zhicheng Dou (Microsoft Research Asia, P.R.China)and Young-In Song (NHN Corporation, Korea)
An API-based Search System for One Click Access to Information
Dan Ionita, Niek Tax and Djoerd Hiemstra (University of Twente, Netherlands)
Hunter Gatherer: UdeM at 1CLICK-2
Pablo Duboue, Jing He and Jian-Yun Nie (Université de Montréal, Canada)
XML Element Retrieval@1CLICK-2
Atsushi Keyaki, Jun Miyazaki (Nara Institute of Science and Technology, Japan), Kenji Hatano (Doshisha University, Japan), Goshiro Yamamoto, Takafumi Taketomi and Hirokazu Kato (Nara Institute of Science and Technology, Japan)
  Discussion  
10:35 - 10:45 Ten minutes Break
10:45 - 12:00 Parallel Session B-2: NTCIR-10 Math Task (MATH)
Session Chair: Akiko Aizawa (National Institute of Informatics, Japan)
  The Abject Failure of Keyword IR for Mathematics Search: Berkeley at NTCIR-10 Math
Ray R Larson, Chloe J Reynolds and Fredric C Gey (University of California, USA)
  Querying large Collections of Mathematical Publications- NTCIR10 Math Task -
Moritz Schubotz, Marcus Leich and Volker Markl (Technische Universität Berlin, Germany)
  MathWebSearch at NTCIR-10
Michael Kohlhase and Corneliu Prodescu (Jacobs University Bremen, Germany)
The MCAT Math Retrieval System for NTCIR-10 Math Track
Goran Topić, Giovanni Yoko Kristianto, Minh-Quoc Nghiem and Akiko Aizawa (National Institute of Informatics, Japan)
   Similarity Search for Mathematics: Masaryk University team at the NTCIR-10 Math Task
Martin Líška, Petr Sojka and Michal Růžička (Masaryk University, Czech Republic)
  Discussion 

12:00 - 13:20 BUFFET LUNCH with POSTERs & DEMO3: Math, 1CLICK and PatentMT [Poster List] 
13:30 - 13:50 Report from MediaEval
Gareth Jones (Dublin City University, Ireland)
Session Chair: Hideo Joho (University of Tsukuba, Japan) & Tetsuya Sakai (Microsoft Research Asia, P.R.China)
13:50 - 14:10  Report from TREC/TAC
Ian Soboroff (NIST, USA)
Session Chair: Hideo Joho (University of Tsukuba, Japan) & Tetsuya Sakai (Microsoft Research Asia, P.R.China)
 14:10 - 15:20 NTCIR-11 task presentations with Q&A (10 mins each if 7 tasks)
Session Chair: Hideo Joho (University of Tsukuba, Japan) & Tetsuya Sakai (Microsoft Research Asia, P.R.China)
15:20 - 15:50 Wrap up  

We are looking forward to seeing you soon!

Last modified: 2013-06-17