Program
*Extended Steering Committee was postponed to Jan. 7th, 2021.
JST | GMT | EST | |
---|---|---|---|
10:15 - 11:00 | 1:15 - 2:00 | 20:15 - 21:00 |
Welcome & Overview (Live) Session Chair: Yiqun Liu (Tsinghua University) 10:15 - 10:30 Welcome & Overview of the NTCIR Noriko Kando 10:30 - 11:00 Overview of the NTCIR-15 Yiqun Liu, Makoto P. Kato (University of Tsukuba) and Noriko Kando (National Institute of Informatics) |
11:00 - 12:00 | 2:00 - 3:00 | 21:00 - 22:00 |
Keynote 1 (Live) Title: From Offline to Online Experimentation: Considerations from Experiences at Spotify Ben Carterette (Spotify, ACM SIGIR chair) Session Chair: Charles L. A. Clarke (University of Waterloo) |
12:00 - 13:00 | 3:00 - 4:00 | 22:00 - 23:00 |
Networking |
JST | GMT | EST | |
---|---|---|---|
19:30 - 20:15 | 10:30 - 11:15 | 5:30 - 6:15 |
Welcome & Overview (Recorded) Session Chair: Yiqun Liu (Tsinghua University) |
20:15 - 21:15 | 11:15 - 12:15 | 6:15 - 7:15 |
Keynote 1 (Recorded) Title: From Offline to Online Experimentation: Considerations from Experiences at Spotify Ben Carterette (Spotify, ACM SIGIR chair) Session Chair: Charles L. A. Clarke (University of Waterloo) |
JST | GMT | EST | |
---|---|---|---|
13:00 - 13:05 | 4:00 - 4:05 | 23:00 - 23:05 |
Overview of the NTCIR-15 We Want Web with CENTRE (WWW-3) Task Tetsuya Sakai, Sijie Tao, Zhaohao Zeng, Yukun Zheng, Jiaxin Mao, Zhumin Chu, Yiqun Liu, Maria Maistro, Zhicheng Dou, Nicola Ferro and Ian Soboroff |
13:05 - 13:18 | 4:05 - 4:18 | 23:05 - 23:18 |
SLWWW at the NTCIR-15 WWW-3 Task Masaki Muraoka, Zhaohao Zeng and Tetsuya Sakai |
13:18 - 13:31 | 4:18 - 4:31 | 23:18 - 23:31 |
The Technion at the WWW-3 Task: Cluster-Based Document Retrieval Fiana Raiber and Oren Kurland |
13:31 - 13:44 | 4:31 - 4:44 | 23:31 - 23:44 |
ESTUCeng at the NTCIR-15 Task: Experimenting with new document quality features Ahmet Aydın, Gökhan Göksel, Ahmet Arslan and Bekir Taner Dinçer |
13:44 - 13:57 | 4:44 - 4:57 | 23:44 - 23:57 |
THUIR at the NTCIR-15 WWW-3 Task Zhumin Chu, Jingtao Zhan, Xiangsheng Li, Jiaxin Mao, Yiqun Liu, Min Zhang and Shaoping Ma |
13:57 - 14:10 | 4:57 - 5:10 | 23:57 - 0:10 |
MPII at the NTCIR-15 WWW-3 Task Canjia Li and Andrew Yates |
14:10 - 14:23 | 5:10 - 5:23 | 0:10 - 0:23 |
KASYS at the NTCIR-15 WWW-3 Task Kohei Shinden, Atsuki Maruta and Makoto P. Kato |
14:23 - 14:30 | 5:23 - 5:30 | 0:23 - 0:30 |
Discussion |
JST | GMT | EST | |
---|---|---|---|
13:00 - 13:16 | 4:00 - 4:16 | 23:00 - 23:16 |
Overview of SHINRA2020-ML Task Satoshi Sekine, Masako Nomoto, Kouta Nakayama, Asuka Sumida, Koji Matsuda, and Maya Ando |
13:16 - 13:23 | 4:16 - 4:23 | 23:16 - 23:23 |
Cross-lingual Extended Named Entity Classification of Wikipedia Articles The Viet Bui and Phuong Le-Hong |
13:23 - 13:30 | 4:23 - 4:30 | 23:23 - 23:30 |
Priberam Labs at the NTCIR-15 SHINRA2020-ML: Classification Task Rúben Cardoso, Afonso Mendes and Andre Lamurias |
13:30 - 13:37 | 4:30 - 4:37 | 23:30 - 23:37 |
Vasudeva Varma and Manish Gupta, Rehoboam at the NTCIR-15 SHINRA2020-ML Task Tushar Abhishek, Ayush Agarwal, Anubhav Sharma |
13:37 - 13:44 | 4:37 - 4:44 | 23:37 - 23:44 |
UOM-FJ at the NTCIR-15 SHINRA2020-ML Task Hiyori Yoshikawa, Chunpeng Ma, Aili Shen, Qian Sun, Chenbang Huang, Guillaume Pelat, Akiba Miura, Daniel Beck, Timothy Baldwin and Tomoya Iwakura |
13:44 - 13:51 | 4:44 - 4:51 | 23:44 - 23:51 |
LIAT Team’s Wikipedia Classifier at NTCIR-15 SHINRA2020-ML: Classification Task Kouta Nakayama and Satoshi Sekine |
13:51 - 13:58 | 4:51 - 4:58 | 23:51 - 23:58 |
Studio Ousia at the NTCIR-15 SHINRA2020-ML Task Sosuke Nishikawa and Ikuya Yamada |
13:58 - 14:05 | 4:58 - 5:05 | 23:58 - 0:05 |
HUKB at SHINRA2020-ML task Masaharu Yoshioka and Yoshiaki Koitabashi |
14:05 - 14:30 | 5:05 - 5:30 | 0:05 - 0:30 |
Task Organizers and Participants Discussion |
JST | GMT | EST | |
---|---|---|---|
15:00 - 15:05 | 6:00 - 6:05 | 1:00 - 1:05 |
Opening |
15:05 - 15:10 | 6:05 - 6:10 | 1:05 - 1:10 |
akbl at the NTCIR-15 QA Lab-PoliInfo-2 Tasks Takanori Nekomoto, Ryoto Ohsugi, Tomoyosi Akiba, Shigeru Masuyama and Daiki Shirato |
15:10 - 15:15 | 6:10 - 6:15 | 1:10 - 1:15 |
knlab Team: NTCIR-15 QA Lab-PoliInfo Stance Classification Task Kazuhiro Atsumi and Yoshinobu Kano |
15:15 - 15:20 | 6:15 - 6:20 | 1:15 - 1:20 |
WER99 at the NTCIR-15 QA Lab-PoliInfo-2 Classification Task Yuichi Sasazawa and Naoaki Okazaki |
15:20 - 15:25 | 6:20 - 6:25 | 1:20 - 1:25 |
Ibrk at the NTCIR-15 QA Lab-PoliInfo-2 Ryo Kato and Minoru Sasaki |
15:25 - 15:30 | 6:25 - 6:30 | 1:25 - 1:30 |
Forst: A Challenge to the NTCIR-15 QA Lab-PoliInfo-2 Task Hiromu Onogi, Kiichi Kondo, Younghun Lim, Xinnan Shen, Madoka Ishioroshi, Hideyuki Shibuki, Tatsunori Mori and Noriko Kando |
15:30 - 15:35 | 6:30 - 6:35 | 1:30 - 1:35 |
HUHKA at the NTCIR-15 QA Lab-PoliInfo-2 Entity Linking Task Takuma Himori, Yasutomo Kimura and Kenji Araki |
15:35 - 15:40 | 6:35 - 6:40 | 1:35 - 1:40 |
selt Team’s Entity Linking System at the NTCIR-15 QA Lab-PoliInfo2 Yuji Naraki and Tetsuya Sakai |
15:40 - 15:45 | 6:40 - 6:45 | 1:40 - 1:45 |
Forst: A Challenge to the NTCIR-15 QA Lab-PoliInfo-2 Task Hiromu Onogi, Kiichi Kondo, Younghun Lim, Xinnan Shen, Madoka Ishioroshi, Hideyuki Shibuki, Tatsunori Mori and Noriko Kando |
15:45 - 16:05 | 6:45 - 7:05 | 1:45 - 2:05 |
Discussion |
16:05 - 16:10 | 7:05 - 7:10 | 2:05 - 2:10 |
akbl at the NTCIR-15 QA Lab-PoliInfo-2 Tasks Takanori Nekomoto, Ryoto Ohsugi, Tomoyosi Akiba, Shigeru Masuyama and Daiki Shirato |
16:10 - 16:15 | 7:10 - 7:15 | 2:10 - 2:15 |
Ibrk at the NTCIR-15 QA Lab-PoliInfo-2 Ryo Kato and Minoru Sasaki |
16:15 - 16:20 | 7:15 - 7:20 | 2:15 - 2:20 |
NUKL at the NTCIR-15 QA Lab-PoliInfo-2 Task Yasuhiro Ogawa, Yuta Ikari, Takahiro Komamizu and Katsuhiko Toyama |
16:20 - 16:25 | 7:20 - 7:25 | 2:20 - 2:25 |
NTCIR-15 QA Lab-PoliInfo2 Topic Detection based on LDA and Argument Structure Graph Yuya Hirai, Yo Amano and Kazuhiro Takeuchi |
16:25 - 16:30 | 7:25 - 7:30 | 2:25 - 2:30 |
akbl at the NTCIR-15 QA Lab-PoliInfo-2 Tasks Takanori Nekomoto, Ryoto Ohsugi, Tomoyosi Akiba, Shigeru Masuyama and Daiki Shirato |
16:30 - 16:35 | 7:30 - 7:35 | 2:30 - 2:35 |
LIAT Team’s Extractive Summarizer at NTCIR-15 QALab PoliInfo-2 Kouta Nakayama and Satoshi Sekine |
16:35 - 16:40 | 7:35 - 7:40 | 2:35 - 2:40 |
JRIRD at the NTCIR-15 QA Lab-PoliInfo-2 Task: An Abstractive Dialog Summarization System for Japanese Assembly Minutes Kazuma Kadowaki |
16:40 - 16:45 | 7:40 - 7:45 | 2:40 - 2:45 |
NUKL at the NTCIR-15 QA Lab-PoliInfo-2 Task Yasuhiro Ogawa, Yuta Ikari, Takahiro Komamizu and Katsuhiko Toyama |
16:45 - 16:55 | 7:45 - 7:55 | 2:45 - 2:55 |
Forst: A Challenge to the NTCIR-15 QA Lab-PoliInfo-2 Task Hiromu Onogi, Kiichi Kondo, Younghun Lim, Xinnan Shen, Madoka Ishioroshi, Hideyuki Shibuki, Tatsunori Mori and Noriko Kando |
16:55 - 17:00 | 7:55 - 8:00 | 2:55 - 3:00 |
Summarizing Utterances from Japanese Assembly Minutes using Political Sentence-BERT-based Method for QA Lab-PoliInfo-2 Task of NTCIR-15 Daiki Shirafuji, Hiromichi Kameya, Rafal Rzepka and Kenji Araki |
17:00 - 17:05 | 8:00 - 8:05 | 3:00 - 3:05 |
wfrnt Team at the NTCIR-15 QA Lab-PoliInfo-2 Task Ken-Ichi Yokote |
17:05 - 17:25 | 8:05 - 8:25 | 3:05 - 3:25 |
Discussion |
17:25 - 17:30 | 8:25 - 8:30 | 3:25 - 3:30 |
Closing |
JST | GMT | EST | |
---|---|---|---|
15:00 - 15:10 | 6:00 - 6:10 | 1:00 - 1:10 |
Overview of the NTCIR-15 Data Search Task Makoto P. Kato, Hiroaki Ohshima, Ying-Hsang Liu and Hsin-Liang Chen |
15:10 - 15:20 | 6:10 - 6:20 | 1:10 - 1:20 |
KSU Systems at the NTCIR-15 Data Search Task Taku Okamoto and Hisashi Miyamori |
15:20 - 15:30 | 6:20 - 6:30 | 1:20 - 1:30 |
STIS at the NTCIR-15 Data Search Task: Document Retrieval Re-ranking Lya Hulliyyatus Suadaa, Lutfi Rahmatuti Maghfiroh, Isfan Nur Fauzi and Siti Mariyah |
15:30 - 15:40 | 6:30 - 6:40 | 1:30 - 1:40 |
NII Table Linker at the NTCIR-15 Data Search Task: Re-ranking with Pre-trained Contextualized Embeddings, Data Content, Entity-centric, and Cluster-based approaches Phuc Nguyen, Kazutoshi Shinoda, Taku Sakamoto, Diana Petrescu, Hung-Nghiep Tran, Atsuhiro Takasu, Akiko Aizawa and Hideaki Takeda |
15:40 - 15:50 | 6:40 - 6:50 | 1:40 - 1:50 |
Uhai at the NTCIR-15 Data Search task Ryota Mibayashi, Huulong Pham, Naoaki Matsumoto, Takehiro Yamamoto and Hiroaki Ohshima |
15:50 - 16:00 | 6:50 - 7:00 | 1:50 - 2:00 |
Discussion |
JST | GMT | EST | |
---|---|---|---|
16:30 - 16:40 | 7:30 - 7:40 | 2:30 - 2:40 |
Overview of NTCIR-15 MART Graham Healy, Tu-Khiem Le, Hideo Joho, Frank Hopfgartner and Cathal Gurrin |
16:40 - 16:50 | 7:40 - 7:50 | 2:40 - 2:50 |
THUIR at the NTCIR-15 Micro-activity Retrieval Task Jiayu Li, Ziyi Ye, Weizhi Ma, Min Zhang, Yiqun Liu and Shaoping Ma |
16:50 - 17:00 | 7:50 - 8:00 | 2:50 - 3:00 |
DCU team at the NTCIR-15 Micro-Activity Retrieval Task Tu-Khiem Le, Manh-Duy Nguyen, Ly-Duyen Tran, Van-Tu Ninh, Cathal Gurrin and Graham Healy |
17:00 - 17:10 | 8:00 - 8:10 | 3:00 - 3:10 |
NLP301 at the NTCIR-15 Micro-activity Retrieval Task: Incorporating Region of Interest Features into Supervised Encoder Tai-Te Chu, Yi-Ting Liu, Chia-Chung Chang, An-Zi Yen, Hen-Hsen Huang and Hsin-Hsi Chen |
17:10 - 17:20 | 8:10 - 8:20 | 3:10 - 3:20 |
Behavioral Classification Using Feature Selection in the Micro Activity Retrieval Task Takuma Yoshimura, Pham Huulong, Ryota Mibayashi, Rui Kimura and Hiroaki Ohshima |
17:20 - 17:30 | 8:20 - 8:30 | 3:20 - 3:30 |
TMU19 at the NTCIR-15 Micro-activity Retrieval Task Duy-Duc Le Nguyen, Yu-Chi Lang and Yung-Chun Chang |
JST | GMT | EST | |
---|---|---|---|
17:45 - 19:15 | 8:45 - 10:15 | 3:45 - 5:15 |
Poster WWW-3, SHINRA-2020, Data Search and MART |
JST | GMT | EST | 20:00 - 21:00 | 11:00 - 12:00 | 6:00 - 7:00 |
Keynote 2 (Live) Title: Reproducibility, Replicability and Reliability: Reflections of a Statistician and a Data Science Editor Xiao-li Meng (the Whipple V. N. Jones Professor of Statistics, Harvard University, and the Founding Editor-in-Chief of Harvard Data Science Review) Session Chairs: Noriko Kando, Makoto P. Kato and Yiqun Liu |
---|
JST | GMT | EST | |
---|---|---|---|
13:00 - 13:10 | 4:00 - 4:10 | 23:00 - 23:10 |
Opening |
13:10 - 13:22 | 4:10 - 4:22 | 23:10 - 23:22 |
TLR at the NTCIR-15 FinNum-2 Task: Improving Text Classifiers for Numeral Attachment in Financial Social Data Jose Moreno, Emanuela Boros and Antoine Doucet |
13:22 - 13:34 | 4:22 - 4:34 | 23:22 - 23:34 |
MIG at NTCIR-15: Use the transfer learning and feature engineering for the FinNum-2 task Yu-Yu Chen and Chao-Lin Liu |
13:34 - 13:46 | 4:34 - 4:46 | 23:34 - 23:46 |
TMUNLP at the NTCIR-15 FinNum-2 Yu-Chi Liang, Yi-Hsuan Huang, Yu-Ya Cheng and Yung-Chun Chang |
13:46 - 13:58 | 4:46 - 4:58 | 23:46 - 23:58 |
CYUT at the NTCIR-15 FinNum-2 Task: Tokenization and Fine-tuning Techniques for Numeral Attachment in Financial Tweets Mike Tian-Jian Jiang, Yi-Kun Chen and Shih-Hung Wu |
13:58 - 14:10 | 4:58 - 5:10 | 23:58 - 0:10 |
Discussion |
14:10 - 14:15 | 5:10 - 5:15 | 0:10 - 0:15 |
Closing |
JST | GMT | EST | |
---|---|---|---|
13:00 - 13:05 | 4:00 - 4:05 | 23:00 - 23:05 |
Overview of the NTCIR-15 DialEval-1 Task |
13:05 - 13:18 | 4:05 - 4:18 | 23:05 - 23:18 |
TMUDS at the NTCIR-15 DialEval-1 Task Yen Chun Huang, Yi Hsuan Huang, Yu Ya Cheng, Jung Y Liao and Yung-Chun Chang |
13:18 - 13:31 | 4:18 - 4:31 | 23:18 - 23:31 |
SKYMN at the NTCIR-15 DialEval-1 Task Junjie Wang, Yuxiang Zhang, Tetsuya Sakai and Hayato Yamana |
13:31 - 13:44 | 4:31 - 4:44 | 23:31 - 23:44 |
TUA1 at the NTCIR-15 DialEval-1 Task Xin Kang, Yunong Wu and Fuji Ren |
13:44 - 13:57 | 4:44 - 4:57 | 23:44 - 23:57 |
RSLNV at the NTCIR-15 DialEval-1 Task Ting Cao, Fan Zhang, Haoxiang Shi, Zhaohao Zeng, Sosuke Kato, Tetsuya Sakai, Injae Lee, Kyungduk Kim and Inho Kang |
13:57 - 14:10 | 4:57 - 5:10 | 23:57 - 0:10 |
NKUST at the NTCIR-15 DialEval-1 Task Tao-Hsing Chang, Jian-He Chen and Chi-Chia Chen |
14:10 - 14:23 | 5:10 - 5:23 | 0:10 - 0:23 |
IMTKU at the NTCIR-15 DialEval-1 Task Mike Tian-Jian Jiang, Zhao-Xian Gu, Cheng-Jhe Chiang, Yueh-Chia Wu, Yu-Chen Huang, Cheng-Han Chiu, Sheng-Ru Shaw and Min-Yuh Day |
14:23 - 14:30 | 5:23 - 5:30 | 0:23 - 0:30 |
Discussion |
JST | GMT | EST | |
---|---|---|---|
15:00 - 16:30 | 6:00 - 7:30 | 1:00 - 2:30 |
Poster QA Lab-PoliInfo-2, FinNum-2 and DialEval-1 |
JST | GMT | EST | |
---|---|---|---|
17:00 - 18:00 | 8:00 - 9:00 | 3:00 - 4:00 |
Invited Talks: Report out from Other Evaluations and Shared Tasks
Session Chair: Yiqun Liu 17:00- 17:05 Introduction by the session chair 17:05 - 17:15 Title: TREC in 2020 Ellen Voorhees (NIST, ACM Fellow) 17:15 - 17:25 Title: What's happening in CLEF and what's the Covid-19 @ MLIA Initiative Nicola Ferro (University of Padua) 17:25 - 17:35 Title: MediaEval 2020 Multimedia Benchmarking Initiative Gareth Jones (Dublin City University) 17:35 - 17:55 Title: NTCIR-Lifelog - A Journey in Collaborative Benchmarking Cathal Gurrin (Dublin City University) |
18:00 - 19:00 | 9:00 - 10:00 | 4:00 - 5:00 |
Closing |
Date: January 7th, 2020 Time: 22:00 Melbourne, 20:00 JST, 19:00 Beijing & Taiwan, 11:00 GMT, 6:00 EST |
---|
Extended Steering Committee (invited only) Duration: 2 hours |
We are looking forward to seeing you soon!
Last modified: 2020-12-17