Yi YU Ph.D.
Department of Informatics, The Graduate University for Advanced Studies (SOKENDAI)
yiyu at nii.ac.jp
2-1-2 Hitotsubashi, Chiyoda-ku, 101-8430 Tokyo, Japan
Secretary: Shiho Iwasawa (contact shiho at nii.ac.jp)
Yi Yu is an assistant professor in National Institute of Informatics (NII). Before joining NII, she was a senior research fellow at School of Computing, National University of Singapore. Her research interests include multimodal learning, large-scale multimedia/music/educational data mining, and multimedia/music analysis (see ongoing works). She has been working with lots of researchers (see students, collaborators, and photo1, photo2) with different research backgrounds. She and her team are awarded best paper runner up in APWeb-WAIM 2017, recognized as finalist of the World’s FIRST 10K best paper award in ICME17, won the 2nd prize in Yahoo Flickr grand challenge 2015, were in the top winners (out of 29 teams) awarded by ACM SIGSPATIAL GIS Cup 2013, and received a best paper award from IEEE ISM 2012.
Selected Publications (Full)
1. Zheng Wang, Ruimin Hu, Chen Chen, Yi Yu, Junjun Jiang, Chao Liang, Shin’ichi Satoh, “Person Re-identiﬁcation via Discrepancy Matrix and Matrix Metric”, accepted by IEEE Transactions on Cybernetics 2017.
2. Zhifeng Bao, Yi Yu, Jian Shen, Zhangjie Fu, “A Query Refinement Framework for Xml Keyword Search”, Journal of World Wide Web (2017). doi:10.1007/s11280-017-0447-z, https://link.springer.com/article/10.1007/s11280-017-0447-z.
3. Junjun Jiang, Chen Chen, Yi Yu, Xinwei Jiang, Jiayi Ma, “Spatial-Aware Collaborative Representation for Hyperspectral Remote Sensing Image Classification”, accepted by IEEE Geoscience and Remote Sensing Letters 2017, http://ieeexplore.ieee.org/document/7820148/, DOI: 10.1109/LGRS.2016.2645708.
4. Mang Ye, Chao Liang, Yi Yu, Zheng Wang, “Person Re-identification via Ranking Aggregation of Similarity Pulling and Dissimilarity Pushing”, IEEE Transactions on Multimedia, Vol. 18, No. 12, pp.2553-2566, 2016.
Shah, Yi Yu, Akshay
Verma, Suhua Tang, Anwar Dilawar Shaikhe, Roger
Zimmermann, “Leveraging Multimodal Information for Event Summarization and
Concept-level Sentiment Analysis”, Journal of Knowledge-Based Systems
(2016), pp. 102-109,DOI information: http://dx.doi.o
6. Zheng Wang, Ruimin Hu, Chao Liang, Yi Yu, Junjun Jiang, Many Ye, Jun Chen, Qingming Leng, “ Zero-shot Person Re-identification visa Cross-view Consistency”, IEEE Transaction on Multimedia, Vol. 18, No. 2, pp.260-272, 2016.
7. Yifang Yin, Yi Yu, and Roger Zimmermann, “On Generating Content-Oriented Geo Features for Sensor-Rich Outdoor Video Search”, IEEE Transaction on Multimedia, Vol. 17, No. 10, pp.1760-1772, 2015.
8. Suhua Tang, Yi Yu, Roger Zimmermann, and Sadao Obana, “Efficient Geo-fencing via Hybrid Hashing: A combination of Bucket Selection and In-bucket Binary Search,’’ Pdf, ACM Transactions on Spatial Algorithms and Systems, Volume 1 Issue 2, Article No. 5, 2015.
9. Yi Yu, Roger Zimmermann, and Suhua Tang, “Social Interactions over Location-Aware Multimedia Systems”, Pdf, a chapter in the book “Multimedia data mining and analytics—disruptive innovation,” (edited by A. Baughman, J. Gao, J.-Y. Pan, V. Petrushin, Springer), pp.117-146, 2015.
10. Yi Yu, Roger Zimmermann, Ye Wang, and Vincent Oria, “Scalable Content-Based Music Retrieval Using Chord Progression Histogram and Tree-Structure LSH” Pdf, IEEE Transaction on Multimedia, Vol. 15, No. 8, pp.1969-1981, 2013. (Codes and Data are available)
11. Zhonghua Li, Bingjun Zhang, Yi Yu, Jialie Shen, Ye Wang, “Query-Document-Dependent Fusion: a Case Study of Multimodal Music Retrieval”, IEEE Transaction on Multimedia, Vol. 15, No. 8, pp.1830-1942, 2013.
12. Junjun Jiang, Yi Yu, Zheng Wang, Jiayi Ma, “Residual Learning for Face Sketch Synthesis”, accepted by ICASSP2018.
13. Wenjun Huang, Chao Liang, Yi Yu, Zheng Wang, Weijian Ruan, Ruimin Hu, “Video-based Person Re-identification Self Paced Weighting”, accepted by AAAI 2018.
14. Yi Yu, Suhua Tang, Kiyoharu Aizawa, Akiko Aizawa, “VenueNet: Fine-Grained Venue Discovery by Deep Correlation Learning,” accepted by IEEE ISM2017.
15. Zheng Wang, Ruimin Hu, Yi Yu, Junjun Jiang, Jiayi Ma, Shin'Ichi Satoh, “Statistical Inference of Gaussian-Laplace Distribution for Person Verification”, accepted by ACM Multimedia (MM) 2017.
16. Chunlin Zhong, Yi Yu, Suhua Tang, Shin’ichi Satoh, Kai Xing, “Deep Multi-Label Hashing for Large-Scale Visual Search Based on Semantic Graph,” accepted by APWeb-WAIM Joint Conference on Web and Big Data 2017 (best paper runner up).
17. Junjun Jiang, Yi Yu, Suhua Tang, Jiayi Ma, Guo-Jun Qi, Akiko Aizawa, “Context-Patch based Face Hallucination via Thresholding Locality-Constrained Representation with Reproducing Learning”, accepted by IEEE International Conference on Multimedia and Expo (ICME) 2017 (finalist of the World’s First 10K best paper award).
18. Soo-Chang Pei, Mei-Shuo Chen, Yi Yu, Suhua Tang, Chunlin Zhong, “Compact LBP and WLBP Descriptor with Magnitude and Direction Difference for Face Recognition”, accepted by IEEE International Conference on Image Processing (ICIP) 2017.
19. Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang, and Chen Chen, “TAICHI Distance for Person Re-identification,” accepted by IEEE International Conference on Acoustics, Speech and Signal Processing 2017.
21. Rajiv Ratn Shah, Yi Yu, Suhua Tang, Shin’ichi Satoh, Akshay Verma, Roger Zimmermann, “Concept-Level Multimodal Ranking of Flickr Photo Tags via Recall Based Weighting”, Multimedia COMMONS Workshop at ACM Multimedia 2016, pp.19-26.
22. Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang. “Scale-adaptive Low-resolution Person Re-identification via Learning a Discriminating Surface”, the 25th International Joint Conference on Artificial Intelligence (IJCAI), 2016, pp.2669-2675.
23. Rajiv Ratn Shah, Anupam Samanta, Deepak Gupta, Yi Yu, Suhua Tang, Roger Zimmermann, “PROMPT: Personalized User Tag Recommendation for Social Media Photos Leveraging Personal and Social Contexts”, IEEE International Symposium on Multimedia, 2016, pp.486-492.
24. Amir Hossein Nabizadeh Rafsanjani, Alípio Mário Guedes Jorge, Suhua Tang, and Yi Yu, “Predicting User Preference Based on Matrix Factorization by Exploiting Music Attributes”, accepted by Ninth International C* Conference on Computer Science & Software Engineering (C3S2E), 2016, pp.61-66.
25. Subhasree Basu, Yi Yu, and Roger Zimmermann, “Fuzzy Clustering of Lecture Videos Based on Topic Modeling”, 14th Workshop on Content-Based Multimedia Indexing (CBMI), 2016, pp.1-6.
26. Subhasree Basu, Yi Yu, Vivek K. Singh, and Roger Zimmermann, “VIDEOPEDIA: Lecture Video Recommendation for Educational Blogs Using Topic Modeling”, The 22th International Conference on Multimedia Modeling (MMM’16), 2016, pp.238-250.
27. Rajiv Ratn Shah, Mohamed Hefeeda, Roger Zimmermann, Khaled Harras, Cheng-Hsin Hsu, and Yi Yu, “NEWSMAN: Uploading Videos over Adaptive Middleboxes to News Servers InWeak Network Infrastructures”, The 22th International Conference on Multimedia Modeling (MMM’16), 2016, pp.100-113.
28. Wenxin Huang, Ruimin Hu, Chao Liang, Yi Yu, Zheng Wang, Xian Zhong, Chunjie Zhang, “Camera network based person re-identification by leveraging spatial-temporal constraint and multiple cameras relations”, The 22th International Conference on Multimedia Modeling (MMM’16), 2016, pp.174-186.
29. Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang, and Wenxin Huang, “Multi-Level Fusion for Person Re-identification with Incomplete Marks”, ACM international conference on Multimedia (ACM MM’15), 2015, pp.1267-1270.
30. Rajiv Ratn Shah, Anwar Shaikh, Yi Yu, Wenjing Geng, Roger Zimmermann, and Gangshan Wu, “EventBuilder: Real-time Multimedia Event Summarization by Visualizing Social Media”, accepted by ACM international conference on Multimedia (ACM MM’15), 2015, pp.185-188. Runner up in Yahoo Flickr Grand Challenge 2015.
31. Rajiv Ratn Shah, Yi Yu, Anwar Shaikh, and Roger Zimmermann, “TRACE: A linguistic-based approach for automatic lecture video segmentation leveraging Wikipedia texts”, The IEEE International Symposium on Multimedia, 2015, pp.217-220.
32. Lei Yao, Jun Chen, Yi Yu, Zheng Wang, Wenxin Huang, Mang Ye, and Ruimin Hu, “Adaptive Margin Nearest Neighbor for Person Re-identification”, Pacific-Rim conference on Multimedia (PCM’15), 2015, pp.75-84.
33. Rajiv Ratn Shah, Yi Yu, and Roger Zimmermann. “ADVISOR - Personalized Video Soundtrack Recommendation by Late Fusion with Heuristic Rankings”, Pdf, ACM international conference on Multimedia (ACM MM’14), 2014, pp.607-616. (Codes are available)
34. Yi Yu, Suhua Tang, Roger Zimmermann, and Kiyoharu Aizawa. “Empirical Observation of User Activities: Check-ins, Venue Photos and Tips in Foursquare”, Pdf, WISMM in ACM MM, 2014, pp.31-34. (Codes and Data are available) Tips (NYC, LA) (Singapore and Nanjing)
35. Subhasree Basu, Yi Yu, and Roger Zimmermann. “Student Performance Evaluation of Multimodal Learning via a Vector Space Model”, Pdf, WISMM in ACM MM, 2014, pp.27-30. (Codes are available)
36. Rajiv Ratn Shah, Yi Yu, Anwar Shaikh, Suhua Tang, and Roger Zimmermann. “ATLAS: Automatic Temporal Segmentation and Annotation of Lecture Videos based on Modelling Transition Time”, Pdf, ACM international conference on Multimedia (ACM MM’14), 2014, pp.209-212.
37. Rajiv Ratn Shah, Yi Yu, and Roger Zimmermann. “User Preference-Aware Video Generation Based on Modeling Scene Moods”, in Proc. ACM MMSys 2014, 2014, pp.156-159.
38. Yi Yu, Kiyoharu Aizawa, Toshihiko Yamasaki and Roger Zimmermann. “Emerging Topics on Personalized and Localized Multimedia Information Systems”, Pdf, a full-day tutorial in ACM international conference on Multimedia (ACM MM’14), pp.1233-1234.
39. Roger Zimmermann, Yi Yu. “WISMM14 -- First International Workshop on Internet-Scale Multimedia Management”, ACM MM, 2014, pp.1257-1258. Workshop summary
40. Yi Yu, Suhua Tang, Roger Zimmermann. “Edge-Based Locality Sensitive Hashing for Efficient Geo-Fencing Application”, Pdf, pp.576-579, in Proc. ACM SIGSPATIAL GIS 2013 (ACM GIS Cup 13). Slides
41. Yi Yu, Roger Zimmermann, Ye Wang, and Vincent Oria, “Recognition and Summarization of Chord Progressions and Their Application to Music Information Retrieval”, in Proc. IEEE International Symposium on Multimedia (IEEE ISM’12), Pdf, pp.9-16, Best paper award 2012. (Codes and Data are available)
42. Yi Yu, Zhijie Shen, Roger Zimmermann, “Automatic Music Soundtrack Generation for Outdoor Videos from Contextual Sensor Information”, in Proc. ACM international conference on Multimedia (ACM MM12), Multimedia Grand Challenge, Pdf, pp.1377-1378, 2012.
43. Yi Yu, Michel Crucianu, Vincent Oria, and Ernesto Damiani, “Combing Multi-Probe Histogram and Order-Statistics Based LSH for Scalable Audio Content Retrieval,” in Proc. ACM international conference on Multimedia (ACM MM10), Pdf, pp.381-390, 2010. (Codes and Data are available)
44. Yi Yu, Michel Crucianu, Vincent Oria, and Lei Chen, “Local Summarization and Multi-Level LSH for Retrieving Multi-Variant Audio Tracks,” in Proc. ACM international conference on Multimedia (ACM MM09), Pdf, pp.341-350, 2009.
Ph.D candidates in NII
Donghuo Zeng, (October 1, 2017 – September 30, 2020, co-supervised with Prof. Keizo Oyama)
Researchers in NII
Dr. Junjun Jiang, first project researcher received Outstanding Doctoral Dissertation Award from China Computer Federation in 2016 (October 1, 2016--)
Dr. Kazunari Sugiyama, first visiting researcher (November 15, 2017--)
Haoting Liang, Saarland University
HongThi Vuong, VNU University of Engineering and Technology
Weijian Ruan, Wuhan University
Tong Li, Berlin Institute of Technology (TUB, TU Berlin)
Samuel Denys, École Polytechnique Fédérale de Lausanne（EPFL), (February 19, – August 17, 2018)
Raposo Francisco Afonso, INESC-ID, (December 1, 2017 – May 29, 2018)
Huaxuan Zhu, University of Southern California, (July 15, 2017 – January 10, 2018)
Minn Sein, Ecole Polytechnique de Montreal, Canada, (July 30, 2017 – January 5, 2018)
Maria-Eleni Kyriakidi, University of Athens/"Athena" Research & Innovation Centre, (March 6, 2017 – July 3, 2017)
Clément Maliet, Institute National Polytechnique de Toulouse, (March 24, 2017 –September 3, 2017)
Mai Trong, Khang, University of Information Technology – Vietnam National University Ho Chi Minh City Khang (February 26, 2017 – August 24, 2017)
Wei Zhou, University of Science and Technology of China, (February 23, 2017 – May 23, 2017)
Junpeng Xiao, University of Southern California, (September 2, 2016 – November 10, 2017)
Rajiv Ratn Shah, National University of Singapore (November 7, 2015 – May 3, 2016), first student who worked with me more than three years in NUS and NII.
Mei-Shuo Chen, National Taiwan University, (July 8, 2016 – September 8, 2016), first female intern.
Chunlin Zhong, University of Science and Technology of China, (August 25, 2016 – November 23, 2016)
Zhen Yu, Harbin Institute of Technology, (October 15, 2016 – March 30, 2017)
Muthu Kumar Chandrasekaran, National University of Singapore (March 10, 2016 – June 10, 2016)
Kuan-Yu Lin, National Taiwan University (January 16, 2016 – March 14, 2016)
Amir Hossein Nabizadeh Rafsanjani, University of Porto (October 31, 2014 – April 23, 2015)
Tim Ziemer, University of Hamburg (January 4, 2016 – April 3, 2016)
Marcelo E. Rodríguez-López, Utrecht University (December 19, 2015 – March 17, 2016)
Prof. Akiko Aizawa (Collaborator, NII)
Prof. Keizo Oyama (Collaborator, NII)
Prof. Shin’ichi Satoh (Collaborator, NII)
Prof. Denis Parra Santander (Visitor, Pontificia Universidad Catolica de Chile, March 9, 2017)
Prof. Tengjiao Wang, (Visitor, Peking University, March 7)
Prof. Stephen Downie, (Visitor, University of Illinois Urbana-Champaign, USA, February 16, 2018)
Prof. Lin Li (Visitor, Wuhan University of Technology, January 4, 2018)
Prof. Tat-Seng Chua (Visitor, National University of Singapore, August 9, 2017)
Prof. Denis Parra Santander (Visitor, Pontificia Universidad Catolica de Chile, August 8, 2017)
Dr. Kazunari Sugiyama (Visitor, National University of Singapore, August 21-23, 2017)
Prof. Lei Chen, (Visitor/Collaborator, Hong Kong University of Science and Technology, Jan. 21, 2017 – Jan. 26, 2017)
Prof. Feida Zhu, (Visitor/Collaborator, Singapore Management University, Feb. 12, 2017 – Feb. 20, 2017)
Prof. Zhifeng Bao, (Visitor/Collaborator, RMIT University, Australia, Feb. 8, 2017 – Feb. 16, 2017)
Prof. Stephen Downie, (Visitor, University of Illinois Urbana-Champaign, USA, September 16, 2016)
Prof. Alípio Mário Guedes Jorge (Visitor/Collaborator, University of Porto INESC, Portugal, July 25, 2016 – August 3)
Prof. Guo-Jun Qi (Visitor, University of Central Florida, USA, May 13, 2016 – May 28, 2016)
Dr. Tian Huat Tan (Visitor, Singapore University of Technology and Design, Singapore, March 13, 2016 – March 23, 2016)
Prof. Roger Zimmermann (Collaborator, National University of Singapore, Singapore)
Prof. Suhua Tang (Collaborator/Visitor, The University of Electro-Communications, Japan)
Photo 1, taken at level 14 in NII (from left, Sinnminn, Samuel, Huaxuan, Junjun, Haoting, Francisco, Yi, Dong, Donghuo, Weijian), March 5, 2018.
Photo 2 taken at level 14 in NII (from left, Donghuo, Tong, Hong, Francisco, Yi, Seinminn, Huaxuan, Samuel, Haoting, Weijian), April 23, 2018.