Yi YU Ph.D.
Department of Informatics, The Graduate University for Advanced Studies (SOKENDAI)
yiyu at nii.ac.jp
2-1-2 Hitotsubashi, Chiyoda-ku, 101-8430 Tokyo, Japan
Secretary: Shiho Iwasawa (contact shiho at nii.ac.jp)
Yi Yu is an assistant professor in National Institute of Informatics (NII). Before joining NII, she was a senior research fellow at School of Computing, National University of Singapore. Her research interests include multimodal learning, large-scale multimedia/music/educational data mining, and multimedia/music analysis (see ongoing works). She has been working with lots of researchers (see students, collaborators, and photo1, photo2) with different research backgrounds. She and her team are awarded best paper runner up in APWeb-WAIM 2017, recognized as finalist of the World’s FIRST 10K best paper award in ICME17, won the 2nd prize in Yahoo Flickr grand challenge 2015, were in the top winners (out of 29 teams) awarded by ACM SIGSPATIAL GIS Cup 2013, and received a best paper award from IEEE ISM 2012.
Selected Publications (Full)
1. Yi Yu, Suhua Tang, Kiyoharu Aizawa, Akiko Aizawa, “Category-Based Deep CCA for Fine-Grained Venue Discovery from Multimodal Data,” https://ieeexplore.ieee.org/document/8432497/, accepted by IEEE Transactions on Neural Networks and Learning Systems (TNNLS).
2. Yi Yu, Suhua Tang, Francisco Raposo, Lei Chen, “Deep Cross-Modal Correlation Learning for Audio and Lyrics in Music Retrieval,” accepted by ACM Transaction on Multimedia Computing Communication and Applications (ACMTOMM).
3. Junjun Jiang, Yi Yu, Zheng Wang, Xianming Liu, Jiayi Ma, “Graph-Regularized Locality-Constrained Joint Dictionary and Residual Learning for Face Sketch Synthesis,”, accepted by IEEE Transactions on Image Processing, 2018.
4. Junjun Jiang, Yi Yu, Suhua Tang, Jiayi Ma, Akiko Aizawa, Kiyoharu Aizawa, “Context-Patch Face Hallucination based on Thresholding Locality-constrained Representation and Reproducing Learning,”, accepted by IEEE Transactions on Cybernetics 2018.
5. Zheng Wang, Ruimin Hu, Chen Chen, Yi Yu, Junjun Jiang, Chao Liang, Shin’ichi Satoh, “Person Re-identiﬁcation via Discrepancy Matrix and Matrix Metric”, accepted by IEEE Transactions on Cybernetics 2017.
6. Zhifeng Bao, Yi Yu, Jian Shen, Zhangjie Fu, “A Query Refinement Framework for Xml Keyword Search”, Journal of World Wide Web (2017). doi:10.1007/s11280-017-0447-z, https://link.springer.com/article/10.1007/s11280-017-0447-z.
7. Junjun Jiang, Chen Chen, Yi Yu, Xinwei Jiang, Jiayi Ma, “Spatial-Aware Collaborative Representation for Hyperspectral Remote Sensing Image Classification”, accepted by IEEE Geoscience and Remote Sensing Letters 2017, http://ieeexplore.ieee.org/document/7820148/, DOI: 10.1109/LGRS.2016.2645708.
8. Mang Ye, Chao Liang, Yi Yu, Zheng Wang, “Person Re-identification via Ranking Aggregation of Similarity Pulling and Dissimilarity Pushing”, IEEE Transactions on Multimedia, Vol. 18, No. 12, pp.2553-2566, 2016.
Shah, Yi Yu, Akshay
Verma, Suhua Tang, Anwar Dilawar Shaikhe, Roger
Zimmermann, “Leveraging Multimodal Information for Event Summarization and
Concept-level Sentiment Analysis”, Journal of Knowledge-Based Systems
(2016), pp. 102-109,DOI information: http://dx.doi.o
10. Zheng Wang, Ruimin Hu, Chao Liang, Yi Yu, Junjun Jiang, Many Ye, Jun Chen, Qingming Leng, “ Zero-shot Person Re-identification visa Cross-view Consistency”, IEEE Transaction on Multimedia, Vol. 18, No. 2, pp.260-272, 2016.
11. Yifang Yin, Yi Yu, and Roger Zimmermann, “On Generating Content-Oriented Geo Features for Sensor-Rich Outdoor Video Search”, IEEE Transaction on Multimedia, Vol. 17, No. 10, pp.1760-1772, 2015.
12. Suhua Tang, Yi Yu, Roger Zimmermann, and Sadao Obana, “Efficient Geo-fencing via Hybrid Hashing: A combination of Bucket Selection and In-bucket Binary Search,’’ Pdf, ACM Transactions on Spatial Algorithms and Systems, Volume 1 Issue 2, Article No. 5, 2015.
13. Yi Yu, Roger Zimmermann, and Suhua Tang, “Social Interactions over Location-Aware Multimedia Systems”, Pdf, a chapter in the book “Multimedia data mining and analytics—disruptive innovation,” (edited by A. Baughman, J. Gao, J.-Y. Pan, V. Petrushin, Springer), pp.117-146, 2015.
14. Yi Yu, Roger Zimmermann, Ye Wang, and Vincent Oria, “Scalable Content-Based Music Retrieval Using Chord Progression Histogram and Tree-Structure LSH” Pdf, IEEE Transaction on Multimedia, Vol. 15, No. 8, pp.1969-1981, 2013. (Codes and Data are available)
15. Zhonghua Li, Bingjun Zhang, Yi Yu, Jialie Shen, Ye Wang, “Query-Document-Dependent Fusion: a Case Study of Multimodal Music Retrieval”, IEEE Transaction on Multimedia, Vol. 15, No. 8, pp.1830-1942, 2013.
16. Sein Minn, Yi Yu, Michel Desmarais, Feida Zhu, and Jill-Jenn Vie, “Deep Knowledge Tracing and Dynamic Student Classification for Knowledge Tracing”, accepted by the 2018 IEEE International Conference on Data Mining (ICDM'18).
17. Junjun Jiang,Yi Yu, Jinhui Hu, Suhua Tang, Jiayi Ma, “Deep CNN Denoiser and Multi-layer Neighbor Component Embedding for Face Hallucination”, accepted by International Joint Conference on Artificial Intelligence (IJCAI) 2018.
18. Junjun Jiang, Yi Yu, Zheng Wang, Jiayi Ma, “Residual Learning for Face Sketch Synthesis”, accepted by ICASSP2018.
19. Wenjun Huang, Chao Liang, Yi Yu, Zheng Wang, Weijian Ruan, Ruimin Hu, “Video-based Person Re-identification Self Paced Weighting”, accepted by AAAI 2018.
20. Yi Yu, Suhua Tang, Kiyoharu Aizawa, Akiko Aizawa, “VenueNet: Fine-Grained Venue Discovery by Deep Correlation Learning,” accepted by IEEE ISM2017.
21. Zheng Wang, Ruimin Hu, Yi Yu, Junjun Jiang, Jiayi Ma, Shin'Ichi Satoh, “Statistical Inference of Gaussian-Laplace Distribution for Person Verification”, accepted by ACM Multimedia (MM) 2017.
22. Chunlin Zhong, Yi Yu, Suhua Tang, Shin’ichi Satoh, Kai Xing, “Deep Multi-Label Hashing for Large-Scale Visual Search Based on Semantic Graph,” accepted by APWeb-WAIM Joint Conference on Web and Big Data 2017 (best paper runner up).
23. Junjun Jiang, Yi Yu, Suhua Tang, Jiayi Ma, Guo-Jun Qi, Akiko Aizawa, “Context-Patch based Face Hallucination via Thresholding Locality-Constrained Representation with Reproducing Learning”, accepted by IEEE International Conference on Multimedia and Expo (ICME) 2017 (finalist of the World’s First 10K best paper award).
24. Soo-Chang Pei, Mei-Shuo Chen, Yi Yu, Suhua Tang, Chunlin Zhong, “Compact LBP and WLBP Descriptor with Magnitude and Direction Difference for Face Recognition”, accepted by IEEE International Conference on Image Processing (ICIP) 2017.
25. Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang, and Chen Chen, “TAICHI Distance for Person Re-identification,” accepted by IEEE International Conference on Acoustics, Speech and Signal Processing 2017.
27. Rajiv Ratn Shah, Yi Yu, Suhua Tang, Shin’ichi Satoh, Akshay Verma, Roger Zimmermann, “Concept-Level Multimodal Ranking of Flickr Photo Tags via Recall Based Weighting”, Multimedia COMMONS Workshop at ACM Multimedia 2016, pp.19-26.
28. Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang. “Scale-adaptive Low-resolution Person Re-identification via Learning a Discriminating Surface”, the 25th International Joint Conference on Artificial Intelligence (IJCAI), 2016, pp.2669-2675.
29. Rajiv Ratn Shah, Anupam Samanta, Deepak Gupta, Yi Yu, Suhua Tang, Roger Zimmermann, “PROMPT: Personalized User Tag Recommendation for Social Media Photos Leveraging Personal and Social Contexts”, IEEE International Symposium on Multimedia, 2016, pp.486-492.
30. Amir Hossein Nabizadeh Rafsanjani, Alípio Mário Guedes Jorge, Suhua Tang, and Yi Yu, “Predicting User Preference Based on Matrix Factorization by Exploiting Music Attributes”, accepted by Ninth International C* Conference on Computer Science & Software Engineering (C3S2E), 2016, pp.61-66.
31. Subhasree Basu, Yi Yu, and Roger Zimmermann, “Fuzzy Clustering of Lecture Videos Based on Topic Modeling”, 14th Workshop on Content-Based Multimedia Indexing (CBMI), 2016, pp.1-6.
32. Subhasree Basu, Yi Yu, Vivek K. Singh, and Roger Zimmermann, “VIDEOPEDIA: Lecture Video Recommendation for Educational Blogs Using Topic Modeling”, The 22th International Conference on Multimedia Modeling (MMM’16), 2016, pp.238-250.
33. Rajiv Ratn Shah, Mohamed Hefeeda, Roger Zimmermann, Khaled Harras, Cheng-Hsin Hsu, and Yi Yu, “NEWSMAN: Uploading Videos over Adaptive Middleboxes to News Servers InWeak Network Infrastructures”, The 22th International Conference on Multimedia Modeling (MMM’16), 2016, pp.100-113.
34. Wenxin Huang, Ruimin Hu, Chao Liang, Yi Yu, Zheng Wang, Xian Zhong, Chunjie Zhang, “Camera network based person re-identification by leveraging spatial-temporal constraint and multiple cameras relations”, The 22th International Conference on Multimedia Modeling (MMM’16), 2016, pp.174-186.
35. Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang, and Wenxin Huang, “Multi-Level Fusion for Person Re-identification with Incomplete Marks”, ACM international conference on Multimedia (ACM MM’15), 2015, pp.1267-1270.
36. Rajiv Ratn Shah, Anwar Shaikh, Yi Yu, Wenjing Geng, Roger Zimmermann, and Gangshan Wu, “EventBuilder: Real-time Multimedia Event Summarization by Visualizing Social Media”, accepted by ACM international conference on Multimedia (ACM MM’15), 2015, pp.185-188. Runner up in Yahoo Flickr Grand Challenge 2015.
37. Rajiv Ratn Shah, Yi Yu, Anwar Shaikh, and Roger Zimmermann, “TRACE: A linguistic-based approach for automatic lecture video segmentation leveraging Wikipedia texts”, The IEEE International Symposium on Multimedia, 2015, pp.217-220.
38. Lei Yao, Jun Chen, Yi Yu, Zheng Wang, Wenxin Huang, Mang Ye, and Ruimin Hu, “Adaptive Margin Nearest Neighbor for Person Re-identification”, Pacific-Rim conference on Multimedia (PCM’15), 2015, pp.75-84.
39. Rajiv Ratn Shah, Yi Yu, and Roger Zimmermann. “ADVISOR - Personalized Video Soundtrack Recommendation by Late Fusion with Heuristic Rankings”, Pdf, ACM international conference on Multimedia (ACM MM’14), 2014, pp.607-616. (Codes are available)
40. Yi Yu, Suhua Tang, Roger Zimmermann, and Kiyoharu Aizawa. “Empirical Observation of User Activities: Check-ins, Venue Photos and Tips in Foursquare”, Pdf, WISMM in ACM MM, 2014, pp.31-34. (Codes and Data are available) Tips (NYC, LA) (Singapore and Nanjing)
41. Subhasree Basu, Yi Yu, and Roger Zimmermann. “Student Performance Evaluation of Multimodal Learning via a Vector Space Model”, Pdf, WISMM in ACM MM, 2014, pp.27-30. (Codes are available)
42. Rajiv Ratn Shah, Yi Yu, Anwar Shaikh, Suhua Tang, and Roger Zimmermann. “ATLAS: Automatic Temporal Segmentation and Annotation of Lecture Videos based on Modelling Transition Time”, Pdf, ACM international conference on Multimedia (ACM MM’14), 2014, pp.209-212.
43. Rajiv Ratn Shah, Yi Yu, and Roger Zimmermann. “User Preference-Aware Video Generation Based on Modeling Scene Moods”, in Proc. ACM MMSys 2014, 2014, pp.156-159.
44. Yi Yu, Kiyoharu Aizawa, Toshihiko Yamasaki and Roger Zimmermann. “Emerging Topics on Personalized and Localized Multimedia Information Systems”, Pdf, a full-day tutorial in ACM international conference on Multimedia (ACM MM’14), pp.1233-1234.
45. Roger Zimmermann, Yi Yu. “WISMM14 -- First International Workshop on Internet-Scale Multimedia Management”, ACM MM, 2014, pp.1257-1258. Workshop summary
46. Yi Yu, Suhua Tang, Roger Zimmermann. “Edge-Based Locality Sensitive Hashing for Efficient Geo-Fencing Application”, Pdf, pp.576-579, in Proc. ACM SIGSPATIAL GIS 2013 (ACM GIS Cup 13). Slides
47. Yi Yu, Roger Zimmermann, Ye Wang, and Vincent Oria, “Recognition and Summarization of Chord Progressions and Their Application to Music Information Retrieval”, in Proc. IEEE International Symposium on Multimedia (IEEE ISM’12), Pdf, pp.9-16, Best paper award 2012. (Codes and Data are available)
48. Yi Yu, Zhijie Shen, Roger Zimmermann, “Automatic Music Soundtrack Generation for Outdoor Videos from Contextual Sensor Information”, in Proc. ACM international conference on Multimedia (ACM MM12), Multimedia Grand Challenge, Pdf, pp.1377-1378, 2012.
49. Yi Yu, Michel Crucianu, Vincent Oria, and Ernesto Damiani, “Combing Multi-Probe Histogram and Order-Statistics Based LSH for Scalable Audio Content Retrieval,” in Proc. ACM international conference on Multimedia (ACM MM10), Pdf, pp.381-390, 2010. (Codes and Data are available)
50. Yi Yu, Michel Crucianu, Vincent Oria, and Lei Chen, “Local Summarization and Multi-Level LSH for Retrieving Multi-Variant Audio Tracks,” in Proc. ACM international conference on Multimedia (ACM MM09), Pdf, pp.341-350, 2009.
Ph.D candidates in NII
Donghuo Zeng, (October 1, 2017 – September 30, 2020, co-supervised with Prof. Keizo Oyama)
Researchers in NII
Dr. Junjun Jiang, first project researcher received Outstanding Doctoral Dissertation Award from China Computer Federation in 2016 (October 1, 2016--)
Dr. Kazunari Sugiyama, first visiting researcher (November 15, 2017 – September 30, 2018)
Chengru Li, Peking University, China
Salo Aaro, Aalto University, Espoo, Finland
Himanshu Aggarwal, IIIT-Delhi, India
Yun Hao, UIUC, USA
Haoting Liang, Saarland University, (February 19-August 17, 2018)
HongThi Vuong, VNU University of Engineering and Technology, (March 9-August 31, 2018)
Weijian Ruan, Wuhan University, (March 5-August 31, 2018)
Tong Li, Berlin Institute of Technology (TUB, TU Berlin), (February 13-August 27, 2018)
Samuel Denys, École Polytechnique Fédérale de Lausanne（EPFL), (February 19, – August 10, 2018)
Raposo Francisco Afonso, INESC-ID, (August 28, 2017 – April 23, 2018)
Huaxuan Zhu, University of Southern California, (July 15, 2017 – April 26, 2018)
Minn Sein, Ecole Polytechnique de Montreal, Canada, (November 21, 2017 – May 17, 2018)
Maria-Eleni Kyriakidi, University of Athens/"Athena" Research & Innovation Centre, (March 7, 2017 – June 30, 2017)
Clément Maliet, Institute National Polytechnique de Toulouse, (March 24, 2017 –September 1, 2017)
Mai Trong, Khang, University of Information Technology – Vietnam National University Ho Chi Minh City Khang (February 28, 2017 – August 23, 2017)
Wei Zhou, University of Science and Technology of China, (February 24, 2017 – May 22, 2017)
Junpeng Xiao, University of Southern California, (September 5, 2016 – November 20, 2017)
Rajiv Ratn Shah, National University of Singapore (November 7, 2015 – May 3, 2016), first student who worked with me more than three years in NUS and NII.
Mei-Shuo Chen, National Taiwan University, (July 8, 2016 – September 8, 2016), first female intern.
Chunlin Zhong, University of Science and Technology of China, (August 25, 2016 – November 23, 2016)
Zhen Yu, Harbin Institute of Technology, (October 15, 2016 – March 30, 2017)
Muthu Kumar Chandrasekaran, National University of Singapore (March 10, 2016 – June 10, 2016)
Kuan-Yu Lin, National Taiwan University (January 16, 2016 – March 14, 2016)
Amir Hossein Nabizadeh Rafsanjani, University of Porto (October 31, 2014 – April 23, 2015)
Tim Ziemer, University of Hamburg (January 4, 2016 – April 3, 2016)
Marcelo E. Rodríguez-López, Utrecht University (December 19, 2015 – March 17, 2016)
Prof. Akiko Aizawa (Collaborator, NII)
Prof. Keizo Oyama (Collaborator, NII)
Prof. Shin’ichi Satoh (Collaborator, NII)
Prof. Nannan Wang (Visitor, Xidian University, August 10 – 14, 2018)
Prof. Denis Parra Santander (Visitor, Pontificia Universidad Catolica de Chile, March 9, 2018)
Prof. Tengjiao Wang, (Visitor, Peking University, March 7, 2018)
Prof. Stephen Downie, (Visitor, University of Illinois Urbana-Champaign, USA, February 16, 2018)
Prof. Lin Li (Visitor, Wuhan University of Technology, January 4, 2018)
Prof. Tat-Seng Chua (Visitor, National University of Singapore, August 9, 2017)
Prof. Denis Parra Santander (Visitor, Pontificia Universidad Catolica de Chile, August 8, 2017)
Dr. Kazunari Sugiyama (Visitor, National University of Singapore, August 21-23, 2017)
Prof. Lei Chen, (Visitor/Collaborator, Hong Kong University of Science and Technology, Jan. 21, 2017 – Jan. 26, 2017)
Prof. Feida Zhu, (Visitor/Collaborator, Singapore Management University, Feb. 12, 2017 – Feb. 20, 2017)
Prof. Zhifeng Bao, (Visitor/Collaborator, RMIT University, Australia, Feb. 8, 2017 – Feb. 16, 2017)
Prof. Stephen Downie, (Visitor, University of Illinois Urbana-Champaign, USA, September 16, 2016)
Prof. Alípio Mário Guedes Jorge (Visitor/Collaborator, University of Porto INESC, Portugal, July 25, 2016 – August 3)
Prof. Guo-Jun Qi (Visitor, University of Central Florida, USA, May 13, 2016 – May 28, 2016)
Dr. Tian Huat Tan (Visitor, Singapore University of Technology and Design, Singapore, March 13, 2016 – March 23, 2016)
Prof. Roger Zimmermann (Collaborator, National University of Singapore, Singapore)
Prof. Suhua Tang (Collaborator/Visitor, The University of Electro-Communications, Japan)
Photo 1, taken at level 14 in NII (from left, Sinnminn, Samuel, Huaxuan, Junjun, Haoting, Francisco, Yi, Dong, Donghuo, Weijian), March 5, 2018.
Photo 2 taken at Nikko (from left, Samuel, Hong, Tong, Yi, Weijian, Haoting, Donghuo), August 2, 2018.