NTCIR Home > NTCIR-11 > NTCIR-11 Conference > Program

The 11th NTCIR Conference

Program

DAY-1 December 9 Tuesday: Breakout Sessions & EVIA 2014

9:30 - Registration Open (9:30-17:00)
10:00 - 12:00 Break-out Session Breakout Sessions Schedule & Room Guide (DAY1 and DAY3)
-QA Lab: 9:00-11:00, at NII Seminar Rm. 1509 (floor 15)



12:00 - 13:00 Lunch break (your own)*

13:00 - 18:00 The 6th International Workshop on Evaluating Information Access (EVIA 2014) (at Room 2 & 3 & 4)
Co-Chairs: Stefano Mizzaro, Ruihua Song
13:00 - 14:30 Paper Session
Session Chair: Douglas W. Oard (University of Maryland, USA)
(20 min) Topic Set Size Design with Variance Estimates from Two-Way ANOVA
Tetsuya Sakai (Waseda University, Japan)
(20 min) Magnitudes of Relevance – Relevance Judgements, Magnitude Estimation, and Crowdsourcing
Falk Scholer (RMIT University, Australia), Eddy Maddelena (University of Udine, Italy), Stefano Mizzaro (University of Udine, Italy), Andrew Turpin (The University of Melbourne, Australia)
(20 min) Axiometrics: Axioms of Information Retrieval Effectiveness Metrics
Eddy Maddalena (University of Udine, Italy), Stefano Mizzaro(University of Udine, Italy)
(15 min) Computing confidence intervals for common IR measures
Ian Soboroff (National Institute of Standards and Technology, USA)
(15 min) Assessing Contextual Suggestion
Adriel Dean-Hall (University of Waterloo, Canada), Charles L. A. Clarke (University of Waterloo, Canada)
14:30 - 14:45  Coffee Break
14:45 - 15:45  Community Session
Session Chair: Tetsuya Sakai (Waseda University, Japan)
(15 min) TREC/TAC
Ian Soboroff (National Institute of Standards and Technology, USA)
(15 min) CLEF
Nicola Ferro (University of Padova, Italy)
(15 min) MediaEval
Gareth Jones (Dublin City University, Ireland)
(15 min) FIRE
Mandar Mitra (ISI Kolkata, India), Prasenjit Majumder (DAIICT Gandhinagar, India), Hideo Joho (University of Tsukuba, Japan)
15:45 - 16:45  NTCIR-12 Task Proposal
Session Chair: Kazuaki Kishida
16:45 - 17:00  Coffee Break 
 17:00 - 18:00  Panel Session
Mobile information retrieval and evaluation
Charles L. A. Clarke (University of Waterloo, Canada) Tetsuya Sakai (Waseda University, Japan), Ian Soboroff (National Institute of Standards and Technology, USA), Mark Sanderson (RMIT University, Australia), Koji Yatani (The University of Tokyo, Japan)

* Lunch is not provided

PAGE TOP

DAY-2 December 10 Wednesday: NTCIR-11 Conference

8:45 -Registration Open (8:45-17:00)
9:20 - 9:30Welcome ( at Hitotsubashi Hall )
Noriko Kando (National Institute of Informatics Tokyo, Japan)
Session Chair: Hideo Joho (University of Tsukuba, Japan) and Kazuaki Kishida (Keio University, Japan)
9:35 - 10:20Overview of NTCIR-11 ( at Hitotsubashi Hall )
Hideo Joho (University of Tsukuba, Japan)
Session Chair: Kazuaki Kishida(Keio University, Japan)
10:20 - 10:3515 minutets Coffee break
10:35 - 11:35Keynote ( at Hitotsubashi Hall )
Title:Personalized Search: Potential and Pitfalls
Susan T. Dumais, Microsoft Research
Session Chair: Mark Sanderson (RMIT University, Australia)
11:35 - 11:40 5 minutets Break
11:40 - 12:40 Session Chair: Kazuaki Kishida ( at Hitotsubashi Hall )
Task Overview-1 (IMine)
Overview of the NTCIR-11 IMine Task
Yiqun Liu(Tsinghua University, China), Ruihua Song (Microsoft Research Asia, China), Min Zhang (Tsinghua University, China), Zhicheng Dou (Renmin Univeristy of P.R.China, China), Takehiro Yamamoto (Kyoto University, Japan), Makoto Kato (Kyoto University, Japan), Hiroaki Ohshima (Kyoto University, Japan) and Ke Zhou (Yahoo! Labs London, UK)

Task Overview-2 (QALab)
Overview of the NTCIR-11 QA-Lab Task
Hideyuki Shibuki, Kotaro Sakamoto (Yokohama National University, Japan), Yoshinobu Kano (Shizuoka University, Japan), Teruko Mitamura (Carnegie Mellon University, USA), Madoka Ishioroshi, Kelly Itakura (National Institute of Informatics, Japan), Di Wang (Carnegie Mellon University, USA), Tatsunori Mori (Yokohama National University, Japan) and Noriko Kando (National Institute of Informatics, Japan)

12:40 - 14:10BUFFET LUNCH with POSTERs & DEMO1: IMine , Temporalia and QALab [Poster List] (at Room 2 & 3)

14:10 - 16:10Session Chair:Kazuaki Kishida ( at Hitotsubashi Hall )
Task Overview 3: RITE-VAL
Overview of the NTCIR-11 Recognizing Inference in TExt and Validation (RITE-VAL) Task
Suguru Matsuyoshi (University of Yamanashi, Japan), Yusuke Miyao (National Institute of Informatics, Japan), Tomohide Shibata (Kyoto University, Japan), Chuan-Jie Lin (National Taiwan Ocean University, Taiwan), Cheng-Wei Shih (Academia Sinica, Taiwan), Yotaro Watanabe (NEC Corporation, Japan) and Teruko Mitamura (Carnegie Mellon University, USA)

Task Overview 4: MATH-2
NTCIR-11 Math-2 Task Overview
Akiko Aizawa (National Institute of Informatics, Japan), Michael Kohlhase (Jacobs University Bremen, Germany), Iadh Ounis (University of Glasgow, UK) and Moritz Schubotz (TU Berlin, Germany)

Task Overview 5: Temporalia
Overview of NTCIR-11 Temporal Information Access (Temporalia) Task
Hideo Joho (University of Tsukuba, Japan), Adam Jatowt (Kyoto University, Japan), Roi Blanco (Yahoo Labs, Spain), Hajime Naka (University of Tsukuba, Japan) and Shuhei Yamamoto (University of Tsukuba, Japan)

Task Overview 6: SpokenQuery& Doc
Overview of the NTCIR-11 SpokenQuery&Doc Task
Tomoyosi Akiba (Toyohashi University of Technology, Japan), Hiromitsu Nishizaki (University of Yamanashi, Japan), Hiroaki Nanjo (Ryukoku University, Japan) and Gareth J. F. Jones (Dublin City University, Ireland)
16:10 - 16:2515 minutets Break
16:25 - 17:55 Session Chair:Kazuaki Kishida ( at Hitotsubashi Hall )
Task Overview 7: MedNLP-2
Overview of the NTCIR-11 MedNLP-2 Task
Eiji Aramaki (Kyoto University, Japan), Mizuki Morita (The University of Tokyo, Japan), Yoshinobu Kano (Shizuoka University, Japan) and Tomoko Ohkuma (Fuji Xerox, Japan)

Task Overview 8: MobileClick
Overview of the NTCIR-11 MobileClick Task
Makoto P. Kato (Kyoto University, Japan), Matthew Ekstrand-Abueg (Northeastern University, USA), Virgil Pavlu (Northeastern University, USA), Tetsuya Sakai (Waseda University, Japan), Takehiro Yamamoto (Kyoto University, Japan) and Mayu Iwata (KDDI Corporation, Japan)

Task Overview 9: RecipeSearch
Overview of the NTCIR-11 Cooking Recipe Search Task
Michiko Yasukawa (Gunma University, Japan), Fernando Diaz (Microsoft, USA), Gregory Druck (Yummly, USA) and Nobu Tsukada (Kagawa Nutrition University, Japan)

19:00 - 21:00Banquet ( at Gakushi-kaikan )

PAGE TOP

DAY-3 December 11 Thursday: NTCIR-11 Conference & Break-out Sessions

9:00- 11:40:
14:00-16:05:
16:05-18:00:
18:00-21:00:

8:45 - Registration Open (8:45-17:00)

9:20 - 12:35 Parallel Session A (at Room 1): NTCIR-11 Recognizing Inference in TExt and Validation Task (RITE-VAL)
Session Chair: Chuan-Jie Lin (National Taiwan Ocean University, Taiwan) and Tomohide Shibata (Kyoto University, Japan)
(40min) III&CYUT Chinese Textual Entailment Recognition System for NTCIR-11 RITE-VAL
Shih-Hung Wu, Li-Jen Hsu, Hua-Wei Lin, Pei-Kai Liao (Chaoyang University of Technology, Taiwan), Liang-Pu Chen and Tsun Ku (Institute for Information Industry, Taiwan)
(25min) Recognizing Textual Entailment Using Multiple Features and Filters
Yongmei Tan, Minda Wang and Xiaohui Wang (Beijing Univesty of Posts and Telecommunications, China)
(25min) WUST at NTCIR-11 RITE-VAL System Validation Task
Maofu Liu, Yue Wang and Limin Wang (Wuhan University of Science and Technology, China)
(15min) 15 minutets Break
(30min) NUL System at NTCIR RITE-VAL Tasks
Chikara Hoshino, Ai Ishii, Hiroshi Miyashita and Mio Kobayashi (Nihon Unisys, Ltd., Japan)
(30min) KSU Team's System and Experience at the NTCIR-11 RITE-VAL Task
Tasuku Kimura and Hisashi Miyamori (Kyoto Sangyo University, Japan)
(30min) A Surface-Similarity Based Two-Step Classifier for RITE-VAL
Shohei Hattori and Satoshi Sato (Nagoya University, Japan)

9:20 - 10:50 Parallel Session B-1 (at Room 4): NTCIR-11 Mathematical Information Access Task (Math-2)
Session Chair: Akiko Aizawa (National Institute of Informatics, Japan), Michael Kohlhase (Jacobs University Bremen, Germany)
(10min) Evaluation of Similarity-Measure Factors for Formulae based on the NTCIR-11 Math Task
Moritz Schubotz (TU Berlin, Germany), Abdou Youssef (The George Washington University, USA), Volker Markl (TU Berlin, Germany), Howard S. Cohl (NIST, USA) and Jimmy J. Li (Richard Montgomery H.S., USA)
(10min) MathWebSearch at NTCIR-11
Radu Hambasan, Michael Kohlhase and Corneliu Prodescu (Jacobs University Bremen, Germany)
(10min) The MCAT Math Retrieval System for NTCIR-11 Math Track
Giovanni Yoko Kristianto (The University of Tokyo, Japan), Goran Topić ( (National Institute of Informatics, Japan), Florence Ho (Institut National Polytechnique Toulouse, France) and Akiko Aizawa (National Institute of Informatics, Japan)
(10min) 10 minutets Break
(10min) Math Indexer and Searcher under the Hood: History and Development of a Winning Strategy
Michal Růžička, Petr Sojka, Martin Líška (Masaryk University, Czech Republic)
(10min) Combining TF-IDF Text Retrieval with an Inverted Index over Symbol Pairs in Math Expressions: The Tangent Math Search Engine at NTCIR 2014
Nidhin Pattaniyil, Richard Zanibbi (Rochester Institute of Technology, USA)
(10min) TUW-IMP at the NTCIR-11 Math-2
Aldo Lipani, Linda Andersson, Florina Piroi, Mihai Lupu, Allan Hanbury (Vienna University of Technology, Austria)
(20min) Discussions 
11:05 - 12:35  Parallel Session B-2 (at Room 4): NTCIR-11 Temporal Information Access Task (Temporalia)
Session Chair: Hideo Joho (University of Tsukuba, Japan), Adam Jatowt (Kyoto University, Japan)
(10min) Overview of NTCIR-11 Temporal Information Access (Temporalia) Task
Hideo Joho (University of Tsukuba, Japan), Adam Jatowt (Kyoto University, Japan), Roi Blanco (Yahoo Labs, Spain), Hajime Naka (University of Tsukuba, Japan) and Shuhei Yamamoto (University of Tsukuba, Japan)
(20min) Using Machine Learning to Predict Temporal Orientation of Search Engines' Queries in the Temporalia Challenge
Michele Filannino and Goran Nenadic (School of Computer Science The University of Manchester, UK)
(20min) MPI-INF at the NTCIR-11 Temporal Query Classification Task
Robin Burghartz and Klaus Berberich (Max Planck Institute for Informatics, Germany)
(20min) TUTA1 at the NTCIR-11 Temporalia Task
Hai-Tao Yu, Xin Kang* and Fuji Ren (The University of Tokushima, Japan) *(Electronics and Information, Tongji University, P.R. China)
(20min) HITSZ-ICRC at NTCIR-11 Temporalia Task
Yongshuai Hou, Cong Tan, Jun Xu, Youcheng Pan, Qingcai Chen and Xiaolong Wang (Harbin Institute of Technology Shenzhen Graduate School, China)

12:35 - 14:05 BUFFET LUNCH with POSTERs & DEMO2 : RITE-VAL and MATH [Poster List] (at Room 2 & 3)

14:05 - 16:05 Parallel Session A-2 (at Room 1): NTCIR-11 Search Intent and Task Mining Task (IMine)
Session Chair: Yiqun LIU (Tsinghua University, China), Takehiro Yamamoto (Kyoto University, Japan)
(15 min) Université de Montréal at the NTCIR-11 IMine Task
Arbi Bouchoucha, Jian-Yun Nie, Xiaohua Liu (University of Montreal, Canada)
(15 min) TUTA1 at the NTCIR-11 IMine Task
Haitao Yu, Fuji Ren (The University of Tokushima, Japan)
(15 min) KUIDL at the NTCIR-11 IMine Task
Takehiro Yamamoto, Makoto. P. Kato, Hiroaki Ohshima, Katsumi Tanaka (Kyoto University, Japan)
(15 min) THUSAM at NTCIR-11 IMine Task
Cheng Luo, Xin Li, Alisher Khodzhaev, Fei Chen (Tsinghua University, China), Keyang Xu (Beihang University, China), Yujie Cao, Yiqun Liu, Min Zhang, Shaoping Ma (Tsinghua University, China)
(15 min) The KLE's Subtopic Mining System for the NTCIR-11 IMine Task
Se-Jong Kim, Jaehun Shin, Jong-Hyeok Lee (POSTECH, Korea)
(15min) 15 minutets Break
(15 min) University of Hyogo at NTCIR-11 TaskMine by Dependency Parsing
Takayuki Yumoto (University of Hyogo, Japan)
(15 min) InteractiveMediaMINE at the NTCIR-11 Imine Search Task
Shohei Mine, Takuma Matsumoto, Tomofumi Yoshida, Takuya Shinohara, Daisuke Kitayama (Kogakuin University, Japan)

14:05 - 16:05 Parallel Session B-3 (at Room 4): NTCIR-11 QA Lab for Entrance Exam Task (QALab)
Session Chair: Hideyuki Shibuki (Yokohama National University, Japan), Teruko Mitamura (Carnegie Mellon University, USA)
(24 min) The Question Answering System of DCUMT in NTCIR-11 QALab
Tsuyoshi Okita and Qun Liu
(24 min) Solving History Exam by Keyword Distribution: KJP System at NTCIR-11 QALab Task
Yoshinobu Kano
(24 min) Question Answering System Using Basic Element at NTCIR-11 QA-Lab Task
Kotaro Sakamoto, Hyogo Matsui, Eisuke Matsunaga, Takahisa Jin, Hideyuki Shibuki, Tatsunori Mori, Madoka Ishioroshi and Noriko Kando
(24 min) FLL: Answering World History Exams by Utilizing Search Results with Handcrafted Rules and Supervised Learning
Takuya Makino, Seiji Okura, Seiji Okajima, Shuangyong Song, Hiroko Suzuki, Tomoya Iwakura, Yuchang Cheng, Satoko Shiga, Masaru Fuji and Nobuyuki Igata
(24 min) CMU Multiple-choice Question Answering System at NTCIR-11 QA-Lab
Di Wang, Leonid Boytsov, Jun Araki, Alkesh Patel, Jeff Gee, Zhengzhong Liu, Eric Nyberg and Teruko Mitamura)

16:05 - 18:00 Break-out Session - Break-out Session Schedule & Room Guide (DAY1 and DAY3)
- MATH: 16:05-18:00, at NII Seminar Rm. 2006, floor 20
- MobileClick: 16:05-18:00, at NII Seminar Rm. 1904, floor 19
- Temporalia : 16:05-18:00, at NII Seminar Rm. 2001A, floor 20 )
- QALab(2) : 16:05-18:00, at Room 4 (floor 2 the same room of session)
18:00 - 21:00 Extended Steering Committee NII Seminar Rm. 2004, 2005 (Floor 20)

PAGE TOP

DAY-4 December 12 Friday

9:20-12:30:
8:45 - Registration Open (8:45-15:00)
9:20 - 11:20 Parallel Session A-1 (at Room 1): NTCIR-11 Spoken Query and Spoken Document Retrieval Task (SqpokenQuery&Doc)
Session Chair: Tomoyosi Akiba (Toyohashi University of Technology, Japan), Hiromitsu Nishizaki (University of Yamanashi, Japan)
(10 min) Introduction
Session Chairs
(20 min) Spoken Document Retrieval Experiments for SpokenQuery&Doc at Ryukoku University (RYSDT)
Hiroaki Nanjo, Takehiko Yoshimi, Sho Maeda and Tomohiro Nishio (Ryukoku University, Japan)
(20 min) Spoken Term Detection and Spoken Content Retrieval: Evaluations on NTCIR 11 SpokenQuery&Doc Task
Sz-Rung Shiang, Po-Wei Chou and Lang-Chi Yu (National Taiwan University, Taiwan)
(20 min) DCU at the NTCIR-11 SpokenQuery&Doc Task
David N. Racca, Gareth J.F. Jones (Dublin City University, Ireland)
(20 min) An IWAPU STD System for OOV Query Terms and Spoken Queries
Jinki Takahashi, Takumi Hashimoto, Ryota Kon'no, Shota Sugawara, Kazuki Ouchi, Satoshi Oshima, Takahiro Akyu, Yoshiaki Itoh (Iwate Prefectural University, Japan)
(20 min) STD method based on Hash Function for NTCIR-11 SpokenQuery&Doc task
Satoru Tsuge (Daido University, Japan), Norihide Kitaoka (University of Tokushima, Japan), Kazuya Takeda (Nagoya University, Japan), Kenji Kita (University of Tokushima, Japan)
(10 min) Free discussion
Session Chairs
11:20 - 11:35 15 minutets Break 
11:35 - 12:35 Parallel Session A-2 (at Room 1): NTCIR-11 Mobile Information Access Task (MobieClick)
Session Chair: Makoto P. Kato (Kyoto University, Japan)
(15 min)  Improving iUnit Retrieval with Query Classification and Multi-Aspect iUnit Scoring: The IISR System at NTCIR-11 MobileClick Task
Chia-Tien Chang, Yu-Hsuan Wu (Yuan Ze University, Taiwan), Yi-Lin Tsai (National Tsinghua University, Taiwan) and Richard Tzong-Han Tsai (National Central University, Taiwan)
(15 min) Description of the NTOU MobileClick System at NTCIR-11
Chi-Ting Liu and Chuan-Jie Lin (National Taiwan Ocean University, Taiwan)
(15 min) Udel @ NTCIR-11 MobileClick Track
Ashraf Bah Rabiou and Ben Carterette (University of Delaware, USA)
(15 min) KPNM at the NTCIR-11 MobileClick Task
Dong Zhou, Zhao Wang, Ziyi Zeng and Tuo Peng (Hunan University of Science and Technology, China)

9:20 - 11:20 Parallel Session B-1 (at Room 4): NTCIR-11 Medical Natural Language Processing Task (MedNLP)
Session Chair: Eiji Aramaki (Kyoto University, Japan), Mizuki Morita (The University of Tokyo, Japan), Yoshinobu Kano (Shizuoka University, Japan) and Tomoko Ohkuma (Fuji Xerox, Japan)
(10 min) Task 1 Overview
Eiji Aramaki, Mizuki Morita, Yoshinobu Kano and Tomoko Ohkuma
(10 min) HCRL at NTCIR-11 MedNLP-2 Task
Osamu Imaichi, Masakazu Fujio, Toshihiko Yanase, Yoshiki Niwa (Hitachi, Ltd., Central Research Laboratory, Japan)
(10 min) HokuMed in NTCIR-11 MedNLP-2: Automatic extraction of medical complaints from Japanese health records using machine learning and rule-based methods
Magnus Ahltorp (Hokkaido University, Japan), Hideyuki Tanushi （Karolinska University Hospital, Japan), Shiho Kitajima, Maria Skeppstedt, Rafal Rzepka, Kenji Araki (Hokkaido University, Japan)
(15 min) Discussion and Short Break
(10 min) Task 2 Overview
Eiji Aramaki, Mizuki Morita, Yoshinobu Kano and Tomoko Ohkuma
(10 min) SCT-D3 at the NTCIR-11 MedNLP-2 Task
Akinori Fujino, Jun Suzuki, Tsutomu Hirao, Hisashi Kurasawa, Katsuyoshi Hayashi (NTT, Japan)
(10 min) NCU IISR System for NTCIR-11 MedNLP-2 Task
Sheng-Wei Chen (Yuan-Ze University, Taiwan), Po-Ting Lai, Yi-Lin Tsai (National Tsing-Hua University, Taiwan), Jay Kuan-Chieh Chung (Yuan-Ze University, Taiwan), Sherry Shih-Huan Hsiao (National Taiwan University Hospital, Taiwan), Richard Tzong-Han Tsai (National Central University, Taiwan)
(10 min) Incorporating Unsupervised Features into CRF based Named Entity Recognition
Yuki Tawara, Mai Omura, Mirai Miura (Nara Institute of Science and Technology, Japan)
(20 min) Short Talks
All participants other than featured talks
(15 min) Discussion
11:20 - 11:35 15 minutes Break
11:35 - 12:35 Parallel Session B-2 (at Room4): NTCIR-11 Cooking Recipe Search Task (RecipeSearch)
Session Chair: Michiko Yasukawa (Gunma University, Japan)
(15min) OPU at NTCIR-11 RecipeSearch - Japanese Recipe Pairing by Naive Bayes Estimation with Names of Ingredients
Yasuhiro Tajima, Genichiro Kikui, Megumi Kubota and Rikako Inoue (Okayama Prefectural University, Japan)
(15min) OKSAT at NTCIR-11 RecipeSearch - Categorization and Expansion of Search Terms in Topics
Takashi Sato, Shingo Aoki and Yuta Morishita (Osaka Kyoiku University, Japan)
(15min) Hiroshima City University at NTCIR-11 Cooking Recipe Search Task
Hidetsugu Nanba (Hiroshima City University, Japan)
(15min) Gunma University, Kiryu University, and RMIT University at the NTCIR-11 Cooking Recipe Search Task
Michiko Yasukawa (Gunma University, Japan), Hiroji Ishii (Kiryu University, Japan) and Falk Scholer (RMIT University, Australia)

12:35 - 14:05 BUFFET LUNCH with POSTERs & DEMO3 : MedNLP, MobileClick, SpokenQuery&Doc, and RecipeSearch [Poster List] (at Room 2 & 3)

14:05 - 14:20 Wrap up  (at Hitotsubashi Hall) 

We are looking forward to seeing you soon!

Last modified: 2014-12-11