NTCIR Home > NTCIR-14 > NTCIR-14 Conference > Program

The 14th NTCIR Conference

Program

DAY-1: Jun 10 (Mon) DAY-2: Jun 11 (Tue) DAY-3: Jun 12 (Wed) DAY-4: Jun 13 (Thu)
EVIA 2019 NTCIR-14 NTCIR-14 NTCIR-14
9:00 QALab-PoliInfo WWW-2 CENTRE OpenLiveQ-2
9:30 Welcome & Overview
10:00 Coffee Break Poster
(STC, Lifelog, CENTRE, OpenLiveQ)
Keynote
(Speaker: Charles L. A. Clarke)
FinNum
10:30
11:00
Coffee Break
11:30 Task Overview: CENTRE, STC-3, OpenLiveQ-2 Panel
Lunch Break
Extended Steering Committee (invited only)
12:00 EVIA 2019
12:30 Wrap up
13:00 Lunch Break Break-out Session
(FinNum)		 Break-out Session
(OpenLiveQ-2)
Poster
(QALab-PoliInfo, WWW, FinNum)
13:30
14:00 Break-out Session
(MART)
14:30 Task Overview: QALab-PoliInfo,
FinNum, Lifelog
WWW
Break
15:00 Break-out session (QALab-PoliInfo) STC-3
15:30
16:00
16:30 Coffee Break Lifelog-3
17:00 Invited Talk (Speakers: Nicola Ferro and Gareth Jones)
17:30
18:00
18:30 Banquet (at The GAKUSHIKAIKAN)
19:00

* ALL lunch is not provided


DAY-1 June 10 Monday: EVIA 2019



10:00 -Registration Open (10:00 - 17:00)

12:00 - 18:00The 9th International Workshop on Evaluating Information Access (EVIA 2019)

Co-chairs: Nicola Ferro (University of Padua), Ian Soboroff(NIST) and Min Zhang (Tsinghua University, China)
13:00 - 13:15Welcome and Opening
Nicola Ferro
13:15 - 14:15EVIA Keynote
Title: How to turn the noise down in test collection measurement
Mark Sanderson (RMIT University, Australia)
14:15 - 15:00Session 1: Evaluation methodology
Length Normalization in the Era of Neural Rankers
Charles Clarke
Evaluation Methods of Emotional Expression in Short Text Conversation
Shih-Hung Wu, Wen-Feng Shih and Sheng-Lun Chien
15:00 - 15:30Coffee Break
15:30 - 16:15NTCIR book introduction
Celebrating 20 Years of NTCIR: The Book.
Douglas W. Oard, Tetsuya Sakai and Noriko Kando
Graded Relevance Assessments and Graded Relevance Measures of NTCIR
Tetsuya Sakai
Q&A and discussions
16:15 - 17:00Session 2: New Information Access task
Stance or insults?
Simona Frenda, Noriko Kando, Viviana Patti and Paolo Rosso
Surprise Languages: Rapid-Response Cross-Language IR
Douglas Oard, Marine Carpuat, Petra Galuscakova, Joseph Barrow, Suraj Nair, Xing Niu, Han-Chin Shing, Weijia Xu, Elena Zotkina, Kathleen McKeown, Smaranda Muresan, Efsun Kayi, Ramy Eskander, Chris Kedzie, Yan Virin, Dragomir Radev, Rui Zhang, Mark Gales, Anton Ragni and Kenneth Heafield
17:00 - 17:30CLEF introduction
17:30 - 18:00Discussions and Closing Remarks

PAGE TOP

DAY-2 Jun 11 Tuesday: NTCIR-14 Conference (at Hitotsubashi Hall)

8:45 -Registration Open (8:45 - 17:00)
9:30 - 10:10Welcome & Overview (at Hitotsubashi Hall )

Welcome
Noriko Kando
NTCIR-14 Overview
Makoto P. Kato and Yiqun Liu
10:10 - 11:10Keynote (at Hitotsubashi Hall )
Title:An Academic in a Data Wonderland: Five Lessons from Commercial Search
Charles L. A. Clarke（University of Waterloo, Canada)
11:10 - 11:30 Coffee Break
11:30 - 13:00 Task Overview: CENTRE, STC-3, OpenLiveQ-2 (at Hitotsubashi Hall )
Session Chairs: Yiqun Liu and Makoto P. Kato

11:30 - 12:00
CENTRE
Tetsuya Sakai, Nicola Ferro, Ian Soboroff, Zhaohao Zeng, Peng Xiao and Maria Maistro

12:00 - 12:30
STC-3
Yaoqin Zhang and Minlie Huang, Zhaohao Zeng, Sosuke Kato and Tetsuya Sakai

12:00 - 13:00
OpenLiveQ-2
Makoto P. Kato, Akiomi Nishida, Tomohiro Manabe, Sumio Fujita and Takehiro Yamamoto

13:00 - 14:30Lunch Break (on your own)

14:30 - 16:30Task Overview: QALab-PoliInfo, FinNum, Lifelog-3 and WWW-2 (at Hitotsubashi Hall )
Session Chairs: Yiqun Liu and Makoto P. Kato

14:30 - 15:00
QALab-PoliInfo
Yasutomo Kimura, Hideyuki Shibuki, Hokuto Ototake, Yuzu Uchida, Keiichi Takamaru, Kotaro Sakamoto, Madoka Ishioroshi, Teruko Mitamura, Noriko Kando, Tatsunori Mori, Harumichi Yuasa, Satoshi Sekine and Kentaro Inui

15:00 - 15:30
FinNum
Chung-Chi Chen, Hen-Hsen Huang, Hiroya Takamura and Hsin-Hsi Chen

15:30 - 16:00
Lifelog-3
Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, Van-Tu Ninh, Tu-Khiem Le, Rami Albatal, Duc-Tien Dang-Nguyen and Graham Healy

16:00 - 16:30
WWW-2
Jiaxin Mao, Tetsuya Sakai, Cheng Luo, Peng Xiao, Yiqun Liu and Zhicheng Dou
16:30 - 17:00 Coffee Break
17:00 - 18:00 Invited Talk (at Hitotsubashi Hall )

Title: Evaluation Measures Scales: From Theory to Experimentation
Nicola Ferro (University of Padua, Italy)

Title: MediaEval 2019 Multimedia Benchmarking Initiative
Gareth Jones (Dublin City University, Ireland)

PAGE TOP

DAY-3 Jun 12 Wednesday: NTCIR-14 Conference

8:45 - Registration Open (8:45 - 17:00)


9:00 - 11:40, Session A-1: NTCIR-14 Question Answering Lab for Political Information (QALab-PoliInfo)

9:00 - 9:10Yasutomo Kimura. Overview of the NTCIR-14 QALab-PoliInfo Task
9:10 - 9:30Jiawei Yong, Shintaro Kawamura, Katsumi Kanasaki, Shoichi Naitoh and Kiyohiko Shinomiya. RICT at the NTCIR-14 QALab-PoliInfo Task
9:30 - 9:50Tasuku Kimura, Ryo Tagami, Hikaru Katsuyama, Sho Sugimoto and Hisashi Miyamori. KSU Systems at the NTCIR-14 QA Lab--PoliInfo Task
9:50 - 10:10Satoshi Hiai, Yuka Otani, Takashi Yamamura and Kazutaka Shimada. KitAi-PI: Summarization System for NTCIR-14 QA Lab-PoliInfo
10:10 - 10:20 Coffee Break (10min)
10:20 - 10:40Yasuhiro Ogawa, Michiaki Satou, Takahiro Komamizu and Katsuhiko Toyama. nagoy Team's Summarization System at the NTCIR-14 QA Lab PoliInfo
10:40 - 11:00Kazuki Terazawa, Daiki Shirato, Tomoyoshi Akiba and Shigeru Masuyama. AKBL at the NTCIR-14 QA Lab-PoliInfo Task
11:00 - 11:20Minoru Sasaki and Tetsuya Nogami. Ibrk at the NTCIR-14 QA Lab-PoliInfo Classification Task
11:20 - 11:40Toshiki Tomihira and Yohei Seki. CUTKB at NTCIR-14 QALab-PoliInfo Task

9:00 - 10:00, Session B-1: NTCIR-14 We Want Web-2 (WWW-2)

9:00 - 9:10Jiaxin Mao, Tetsuya Sakai, Cheng Luo, Peng Xiao, Yiqun Liu and Zhicheng Dou. Overview of the NTCIR-14 We Want Web Task
9:10 - 9:20Andrew Yates. MPII at the NTCIR-14 WWW-2 Task
9:20 - 9:30Xue Yang, Shuqi Lu, Shijun Wang, Han Zhang and Zhicheng Dou. RUCIR at the NTCIR-14 We Want Web-2 Task
9:30 - 9:40Yukun Zheng, Zhumin Chu, Xiangsheng Li, Jiaxin Mao, Yiqun Liu, Min Zhang and Shaoping Ma. THUIR at the NTCIR-14 WWW-2 Task
9:40 - 10:00Panel Discussion

10:00 - 10:15 Coffee Break (15min)

10:15 - 11:45, Session B-2: NTCIR-14 Fine-Grained Numeral Understanding in Financial Tweet (FinNum)

10:15 - 10:25 Chung-Chi Chen, Hen-Hsen Huang, Hiroya Takamura, and Hsin-Hsi Chen. Overview of the NTCIR-14 FinNum Task
10:25 - 10:35 Abderrahim Ait Azzi and Houda Bouamor. Fortia1 @ the NTCIR-14 FinNum Task: Enriched Sequence Labeling for Numeral Classification
10:35 - 10:45 Alan Spark. BRNIR at NTCIR-14 FinNum Task: Scalable feature extraction technique for numeral classification
10:45 - 10:55 Chao-Chun Liang and Keh-Yih Su. ASNLU at the NTCIR-14 FinNum Task: Incorporating Knowledge into DNN for Financial Numeral Classification
10:55 - 11:05 Break
11:05 - 11:15 Qianhui Wu, Guoxin Wang, Yuying Zhu, Haoyan Liu, and B¨orje F. Karlsson. DeepMRT at the NTCIR-14 FinNum Task: A Hybrid Neural Model for Numeral Type Classification in Financial Tweets
11:15 - 11:25 Ke Tian and Zi Jun Peng. aiai at NTCIR-14 FinNum Task: Financial Numeral Tweets Fine-Grained Classification Using Deep Word and Character Embedding-Based Attention Model
11:25 - 11:35 Wei Wang, Maofu Liu, and Zhenlian Zhang. WUST at FinNum Task in NTCIR-14
11:35 - 11:45 Task Organizers and Participants Discussion and The Next Step of FinNum


11:45 - 13:15 Extended Steering Committee (invited only) (at NII 19F 1901,1902 and 1903)


13:15 - 14:45 Poster
QALab-PoliInfo, WWW and FinNum [Poster List]


Break-out Sessions

15:00 - 16:30QALab-PoliInfo (at Conference Room 1)


16:30 - 18:00, Session A-3: NTCIR-14 Lifelog Search Task (Lifelog-3)

16:30 - 16:40Cathal Gurrin, Hideo Joho, Frank Hopfgartner, Liting Zhou, Van-Tu Ninh, Tu-Khiem Le, Rami Albatal, Duc-Tien Dang-Nguyen and Graham Healy. Overview of the NTCIR-14 Lifelog-3 Task
16:40 - 16:50Nguyen-Khang Le, Dieu-Hien Nguyen, Trung-Hieu Hoang, Thanh-An Nguyen, Thanh-Dat Truong, Duy-Tung Dinh, Quoc-An Luong, Viet-Khoa Vo-Ho, Vinh-Tiep Nguyen and Minh-Triet Tran. HCMUS at the NTCIR-14 Lifelog-3 Task
16:50 - 17:00Tokinori Suzuki and Daisuke Ikeda. Smart Lifelog Retrieval System with Habit-based Concepts and Moment Visualization
17:00 - 17:10Van-Tu Ninh, Tu-Khiem Le, Liting Zhou, Graham Healy, Kaushik Venkataraman, Minh-Triet Tran, Duc-Tien Dang-Nguyen, Sinead Smyth and Cathal Gurrin. A Baseline Interactive Retrieval Engine for the NTICR-14 Lifelog-3 Semantic Access Task
17:10 - 17:20Min-Huan Fu, Chia-Chun Chang, Hen-Hsen Huang and Hsin-Hsi Chen. Incorporating External Textual Knowledge for Life Event Recognition and Retrieval
17:20 - 17:30Isadora Nguyen Van Khan, Pranita Shrestha, Min Zhang, Yiqun Liu and Shaoping Ma. THUIR at the NTCIR-14 Lifelog-3 Task: How does Lifelog help the user’s status recognition
17:30 - 18:00Tasks Organisers and Participants Discussion on the next steps of Lifelogging Research


15:00 - 18:00, Session B-3: NTCIR-14 Short Text Conversation-3 (STC-3)

15:00 - 15:15Zhaohao Zeng, Sosuke Kato and Tetsuya Sakai. Overview of the NTCIR-14 Short Text Conversation Task: Dialogue Quailty and Nugget Detection Subtasks
15:15 - 15:28Kai Cong and Wai Lam. CUIS at the NTCIR-14 STC-3 DQ Subtask
15:28 - 15:41Sosuke Kato, Rikiya Suzuki, Zhaohao Zeng and Tetsuya Sakai . SLSTC at the NTCIR-14 STC-3 Dialogue Quality and Nugget Detection Subtasks
15:41 - 15:54Hsiang-En Cherng and Chia-Hui Chang. Dialogue Quality and Nugget Detection for Short Text Conversation (STC-3) based on Hierarchical Multi-Stack Model with Memory Enhance Structure
15:54 - 16:11Yaoqin Zhang and Minlie Huang. Overview of the NTCIR-14 Short Text Generation Subtask: Emotion Generation Challenge
16:11 - 16:24Sébastien Montella, Chia-Hui Chang and Frederic Lassabe. Emotionally-Triggered Short Text Conversation (STC-3) using Attention-Based Sequence Generation Model
16:24 - 16:37Chih-Chien Wang, Min-Yuh Day, Wei-Jin Gao, Yen-Cheng Chiu, and Chun-Lian Wu. AI-NTPU Emotional Chatting Machine at the NTCIR-14 STC-3 CECG Task
16:37 - 16:50Yi-Lin Xie and Wei-Yun Ma. CKIP at the NTCIR-14 STC-3 Task
16:50 - 17:03Min-Yuh Day, Chi-Sheng Hung, Jhih-Yi Chen, Yi-Jun Xie, Yu-Ling Kuo and Jian-Ting Lin. IMTKU Emotional Dialogue System for Short Text Conversation at NTCIR-14 STC-3 (CECG) Task
17:03 - 17:16Yan-Chun Hsing, Chien-Hung Chen, and Yung-Chun Chang. TMUNLP System at the NTCIR-14 STC3 Task
17:16 - 17:29Wei Shih-Chieh, Cheng Chi-Bin, Cao Guangzhongyi, Chiang Yi-Jing, Wu Chin-Yi, Lin Shih-Hsiang and Tsai Kun-Li. TKUIM at NTCIR-14 STC-3 CECG task
17:29 - 17:42Yangyang Zhou, Zheng Liu, Xin Kang, Yunong Wu, and Fuji Ren. TUA1 at the NTCIR-14 STC-3 Task
17:42 - 17:55Xiaohe Li, Jiaqing Liu, Weihao Zheng, Xiangbo Wang, Yutao Zhu, and Zhicheng Dou. RUCIR at NTCIR-14 STC-3 Task



18:30 - 20:30 Banquet (at The GAKUSHIKAIKAN)

PAGE TOP


DAY-4 Jun 13 Thursday: NTCIR-14 Conference

8:45 - Registration Open (8:45 - 11:00)


9:00 - 10:00, Session A-4: NTCIR-14 CLEF/NTCIR/TREC REproducibility (CENTRE)

9:00 - 9:35Tetsuya Sakai. NTCIR-14 CENTRE task overview
9:35 - 10:00Andrew Yates. MPII at the NTCIR-14 CENTRE Task


9:00 - 10:00, Session B-4: NTCIR-14 Open Live Test for Question Retrieval (OpenLiveQ-2)

9:00 - 9:10Overview
9:10 - 9:22Hiroki Tanioka. AITOK at the NTCIR-14 OpenLiveQ-2 Task
9:22 - 9:34Tomohiro Manabe, Sumio Fujita and Akiomi Nishida. YJRS at the NTCIR-14 OpenLiveQ-2 Task
9:34 - 9:46Takashi Sato, Yuki Nagase and Masato Uraji. OKSAT at NTCIR-14 OpenLiveQ-2 Task -Reorder Questions by Using White and Black Words-
9:46 - 9:58Piyush Arora and Gareth Jones. DCU at the NTCIR-14 OpenLiveQ-2 Task
9:58 - 10:00Closing


10:00 - 11:30 Poster
STC-3, Lifelog-3, CENTRE and OpenLiveQ-2 [Poster List]


11:30 - 12:30 Panel
12:30 - 13:00 Wrap Up


Break-out Sessions
13:00 - 13:30 FinNum (at NII 19F 1902)
13:00 - 14:00 OpenLiveQ-2 (at NII 19F 1903)
14:00 - 15:00 MART(Micro-activity Retrieval Task) (at NII 19F 1902)

We are looking forward to seeing you soon!

Last modified: 2019-06-11