Yi YU  Ph.D.

IMG_3115-2

Assistant Professor

Digital Content and Media Sciences Research Division, National Institute of InformaticsDescription: Description: Description: Description: Description: Description: Description: Description: Description: Description: Description: DSC00090b

Department of Informatics, The Graduate University for Advanced Studies (SOKENDAI)

Tokyo, Japan

yiyu at nii.ac.jp

+81-03-4212-2574

2-1-2 Hitotsubashi, Chiyoda-ku, 101-8430 Tokyo, Japan

Secretary: Shiho Iwasawa (contact shiho at nii.ac.jp)

Yi Yu is an assistant professor in National Institute of Informatics (NII). Before joining NII, she was a senior research fellow at School of Computing, National University of Singapore. Her research interests include large-scale multimedia/music/educational data mining, multimodal learning, and multimedia/music analysis (see ongoing works, lectures, and source codes). She has been working with lots of researchers (see students and collaborators) with different research backgrounds. She and her team are recognized as finalist of the World’s FIRST 10K best paper award in ICME17, won the 2nd prize in Yahoo Flickr grand challenge 2015, were in the top winners (out of 29 teams) awarded by ACM SIGSPATIAL GIS Cup 2013, and received a best paper award from IEEE ISM 2012.

 

Selected Publications (Full)

 

Journals and book chapter

1.      Zhifeng Bao, Yi Yu, Jian Shen, Zhangjie Fu, A Query Refinement Framework for Xml Keyword Search, Journal of World Wide Web (2017). doi:10.1007/s11280-017-0447-z, https://link.springer.com/article/10.1007/s11280-017-0447-z.

2.      Junjun Jiang, Chen Chen, Yi Yu, Xinwei Jiang, Jiayi Ma, “Spatial-Aware Collaborative Representation for Hyperspectral Remote Sensing Image Classification”, accepted by IEEE Geoscience and Remote Sensing Letters 2017, http://ieeexplore.ieee.org/document/7820148/, DOI: 10.1109/LGRS.2016.2645708.

3.      Mang Ye, Chao Liang, Yi Yu, Zheng Wang,  Person Re-identification via Ranking Aggregation of Similarity Pulling and Dissimilarity Pushing”, IEEE Transactions on Multimedia, Vol. 18, No. 12, pp.2553-2566, 2016.

4.      Rajiv Ratn Shah, Yi Yu, Akshay Verma, Suhua Tang, Anwar Dilawar Shaikhe, Roger Zimmermann, Leveraging Multimodal Information for Event Summarization and Concept-level Sentiment Analysis”, Journal of Knowledge-Based Systems  (2016), pp. 102-109,DOI information: http://dx.doi.org/10.1016/j.knosys.2016.05.022. ( Initial Demonstration at http://www.yiyu.nii.ac.jp:8080/EventBuilder/)

5.      Zheng Wang, Ruimin Hu, Chao Liang, Yi Yu, Junjun Jiang, Many Ye, Jun Chen, Qingming Leng, “ Zero-shot Person Re-identification visa Cross-view Consistency”, IEEE Transaction on Multimedia, Vol. 18, No. 2, pp.260-272, 2016.

6.      Yifang Yin, Yi Yu, and Roger Zimmermann, “On Generating Content-Oriented Geo Features for Sensor-Rich Outdoor Video Search”, IEEE Transaction on Multimedia, Vol. 17, No. 10, pp.1760-1772, 2015.

7.      Suhua Tang, Yi Yu, Roger Zimmermann, and Sadao Obana, “Efficient Geo-fencing via Hybrid Hashing: A combination of Bucket Selection and In-bucket Binary Search,’’ Pdf, ACM Transactions on Spatial Algorithms and Systems, Volume 1 Issue 2, Article No. 5, 2015.

8.      Yi Yu, Roger Zimmermann, and Suhua Tang, Social Interactions over Location-Aware Multimedia Systems”, Pdf, a chapter in the book “Multimedia data mining and analytics—disruptive innovation,” (edited by A. Baughman, J. Gao, J.-Y. Pan, V. Petrushin, Springer), pp.117-146, 2015.

9.      Yi Yu, Roger Zimmermann, Ye Wang, and Vincent Oria, Scalable Content-Based Music Retrieval Using Chord Progression Histogram and Tree-Structure LSH Pdf, IEEE Transaction on Multimedia, Vol. 15, No. 8, pp.1969-1981, 2013. (Codes and Data are available)

10.  Zhonghua Li, Bingjun Zhang, Yi Yu, Jialie Shen, Ye Wang, Query-Document-Dependent Fusion: a Case Study of Multimodal Music Retrieval”, IEEE Transaction on Multimedia, Vol. 15, No. 8, pp.1830-1942, 2013.

 

Conferences

 

11.  Chunlin Zhong, Yi Yu, Suhua Tang, Shin’ichi Satoh, Kai Xing, “Deep Multi-Label Hashing for Large-Scale Visual Search Based on Semantic Graph,” accepted by APWeb-WAIM Joint Conference  on Web and Big Data 2017.

12.  Junjun Jiang, Yi Yu, Suhua Tang, Jiayi Ma, Guo-Jun Qi, Akiko Aizawa, “Context-Patch based Face Hallucination via Thresholding Locality-Constrained Representation with Reproducing Learning,”, accepted by IEEE International Conference on Multimedia and Expo (ICME) 2017.

13.  Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang, and Chen Chen, “TAICHI Distance for Person Re-identification,” accepted by IEEE International Conference on Acoustics, Speech and Signal Processing 2017.

14.  Zheng Wang, Ruimin Hu, Chao Liang, Rui Shao, and Yi Yu, “3A: A Person Re-identification System via Attribute Augmentation and Aggregation,” accepted by IEEE International Conference on Acoustics, Speech and Signal Processing 2017.

15.  Tian Huat Tan, Yinxing Xue, Manman Chen, Shuang Liu, Yi Yu, Jun Sun, “JSFox: Integrating Static and Dynamic Type Analysis of JavaScript Programs, ”accepted by 39th International Conference on Software Engineering (ICSE 2017).

16.  Rajiv Ratn Shah, Yi Yu, Suhua Tang, Shin’ichi Satoh,  Akshay Verma, Roger Zimmermann, Concept-Level Multimodal Ranking of Flickr Photo Tags via Recall Based Weighting”, Multimedia COMMONS Workshop at ACM Multimedia 2016, pp.19-26.

17.  Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang. “Scale-adaptive Low-resolution Person Re-identification via Learning a Discriminating Surface”, the 25th International Joint Conference on Artificial Intelligence (IJCAI), 2016, pp.2669-2675.

18.  Rajiv Ratn Shah, Anupam Samanta, Deepak Gupta, Yi Yu, Suhua Tang, Roger Zimmermann, PROMPT: Personalized User Tag Recommendation for Social Media Photos Leveraging Personal and Social Contexts”, IEEE International Symposium on Multimedia, 2016, pp.486-492.

19.  Amir Hossein Nabizadeh Rafsanjani, Alípio Mário Guedes Jorge, Suhua Tang, and Yi Yu, “Predicting User Preference Based on Matrix Factorization by Exploiting Music Attributes”, accepted by Ninth International C* Conference on Computer Science & Software Engineering (C3S2E), 2016, pp.61-66.

20.  Subhasree Basu, Yi Yu, and Roger Zimmermann, “Fuzzy Clustering of Lecture Videos Based on Topic Modeling”, 14th Workshop on Content-Based Multimedia Indexing (CBMI), 2016, pp.1-6.

21.  Subhasree Basu, Yi Yu, Vivek K. Singh, and Roger Zimmermann, “VIDEOPEDIA: Lecture Video Recommendation for Educational Blogs Using Topic Modeling”, The 22th International Conference on Multimedia Modeling (MMM’16), 2016, pp.238-250.

22.  Rajiv Ratn Shah, Mohamed Hefeeda, Roger Zimmermann, Khaled Harras, Cheng-Hsin Hsu, and Yi Yu, “NEWSMAN: Uploading Videos over Adaptive Middleboxes to News Servers InWeak Network Infrastructures”, The 22th International Conference on Multimedia Modeling (MMM’16), 2016, pp.100-113.

23.  Wenxin Huang, Ruimin Hu, Chao Liang, Yi Yu, Zheng Wang, Xian Zhong, Chunjie Zhang, “Camera network based person re-identification by leveraging spatial-temporal constraint and multiple cameras relations”, The 22th International Conference on Multimedia Modeling (MMM16), 2016, pp.174-186.

24.  Zheng Wang, Ruimin Hu, Yi Yu, Chao Liang, and Wenxin Huang, “Multi-Level Fusion for Person Re-identification with Incomplete Marks”, ACM international conference on Multimedia (ACM MM’15), 2015, pp.1267-1270.

25.  Rajiv Ratn Shah, Anwar Shaikh, Yi Yu, Wenjing Geng, Roger Zimmermann, and Gangshan Wu, “EventBuilder: Real-time Multimedia Event Summarization by Visualizing Social Media”, accepted by ACM international conference on Multimedia (ACM MM’15), 2015, pp.185-188. Runner up in Yahoo Flickr Grand Challenge 2015.

26.  Rajiv Ratn Shah, Yi Yu, Anwar Shaikh, and Roger Zimmermann, “TRACE: A linguistic-based approach for automatic lecture video segmentation leveraging Wikipedia texts”, The IEEE International Symposium on Multimedia, 2015, pp.217-220.

27.  Lei Yao, Jun Chen, Yi Yu, Zheng Wang, Wenxin Huang, Mang Ye, and Ruimin Hu, “Adaptive Margin Nearest Neighbor for Person Re-identification”, Pacific-Rim conference on Multimedia (PCM’15), 2015, pp.75-84.

28.  Rajiv Ratn Shah, Yi Yu, and Roger Zimmermann. ADVISOR - Personalized Video Soundtrack Recommendation by Late Fusion with Heuristic Rankings”, Pdf, ACM international conference on Multimedia (ACM MM’14), 2014, pp.607-616. (Codes are available)

29.  Yi Yu, Suhua Tang, Roger Zimmermann, and Kiyoharu Aizawa. Empirical Observation of User Activities: Check-ins, Venue Photos and Tips in Foursquare, Pdf, WISMM in ACM MM, 2014, pp.31-34. (Codes and Data are available) Tips (NYC, LA) (Singapore and Nanjing)

30.  Subhasree Basu, Yi Yu, and Roger Zimmermann. Student Performance Evaluation of Multimodal Learning via a Vector Space Model”, Pdf, WISMM in ACM MM, 2014, pp.27-30. (Codes are available)

31.  Rajiv Ratn Shah, Yi Yu, Anwar Shaikh, Suhua Tang, and Roger Zimmermann. ATLAS: Automatic Temporal Segmentation and Annotation of Lecture Videos based on Modelling Transition Time”, Pdf, ACM international conference on Multimedia (ACM MM’14), 2014, pp.209-212.

32.  Rajiv Ratn Shah, Yi Yu, and Roger Zimmermann. “User Preference-Aware Video Generation Based on Modeling Scene Moods”, in Proc. ACM MMSys 2014, 2014, pp.156-159.

33.  Yi Yu, Kiyoharu Aizawa, Toshihiko Yamasaki and Roger Zimmermann.Emerging Topics on Personalized and Localized Multimedia Information Systems”, Pdf, a full-day tutorial in ACM international conference on Multimedia (ACM MM’14), pp.1233-1234.

34.  Roger Zimmermann, Yi Yu. “WISMM14 -- First International Workshop on Internet-Scale Multimedia Management”, ACM MM, 2014, pp.1257-1258. Workshop summary

35.  Yi Yu, Suhua Tang, Roger Zimmermann. “Edge-Based Locality Sensitive Hashing for Efficient Geo-Fencing Application”, Pdf, pp.576-579, in Proc. ACM SIGSPATIAL GIS 2013 (ACM GIS Cup 13). Slides

36.  Yi Yu, Roger Zimmermann, Ye Wang, and Vincent Oria, “Recognition and Summarization of Chord Progressions and Their Application to Music Information Retrieval”, in Proc. IEEE International Symposium on Multimedia (IEEE ISM’12), Pdf,  pp.9-16, Best paper award 2012. (Codes and Data are available)

37.  Yi Yu, Zhijie Shen, Roger Zimmermann, “Automatic Music Soundtrack Generation for Outdoor Videos from Contextual Sensor Information”, in Proc. ACM international conference on Multimedia (ACM MM12), Multimedia Grand Challenge, Pdf, pp.1377-1378, 2012.

38.  Yi Yu, Michel Crucianu, Vincent Oria, and Ernesto Damiani, “Combing Multi-Probe Histogram and Order-Statistics Based LSH for Scalable Audio Content Retrieval,” in Proc. ACM international conference on Multimedia (ACM MM10), Pdf, pp.381-390, 2010. (Codes and Data are available)

39.  Yi Yu, Michel Crucianu, Vincent Oria, and Lei Chen, “Local Summarization and Multi-Level LSH for Retrieving Multi-Variant Audio Tracks,” in Proc. ACM international conference on Multimedia (ACM MM09), Pdf, pp.341-350, 2009.

 

Ph.D candidates in NII

 

{    } my milestone: first Ph.D student in NII

 

Interns

 

Samuel Denys, École Polytechnique Fédérale de LausanneEPFL), (February 19, – August 17, 2018)

Raposo Francisco Afonso, INESC-ID, (December 1, 2017 – May 29, 2018)

Huaxuan Zhu, University of Southern California, (July 15, 2017 – January 10, 2018)

Minn Sein, Ecole Polytechnique de Montreal, Canada, (July 30, 2017 – January 5, 2018)

Maria-Eleni Kyriakidi, University of Athens/"Athena" Research & Innovation Centre, (February 1, 2017 – June 1, 2017)

Clément Maliet, Institute National Polytechnique de Toulouse, (March 13, 2017 –September 5, 2017)

Mai Trong, Khang, University of Information Technology Vietnam National University Ho Chi Minh City Khang  (February 27, 2017 – August 25, 2017)

Wei Zhou, University of Science and Technology of China, (January 25, 2017 – April 23, 2017)

Junpeng Xiao, University of Southern California, (September 2, 2016 – November 10, 2017)

Chunlin Zhong, University of Science and Technology of China, (August 25, 2016 – November 23, 2016)

Zhen Yu, Harbin Institute of Technology, (October 15, 2016 – March 30, 2017)

Mei-Shuo Chen, National Taiwan University, (July 8, 2016 – September 8, 2016), my milestone: first female intern.

Muthu Kumar Chandrasekaran, National University of Singapore (March 10, 2016 – June 10, 2016)

Kuan-Yu Lin, National Taiwan University (January 16, 2016 – March 14, 2016)

Rajiv Ratn Shah, National University of Singapore (November 7, 2015 – May 3, 2016), my milestone: first student who has been working with me more than three years.

Amir Hossein Nabizadeh Rafsanjani, University of Porto (October 31, 2014 – April 23, 2015)
Tim Ziemer, University of Hamburg (January 4, 2016 – April 3, 2016)

Marcelo E. Rodríguez-López, Utrecht University (December 19, 2015 – March 17, 2016)

 

Visitors/ Collaborators

Prof. Akiko Aizawa, (Collaborator, NII)

Prof. Shin’ichi Satoh, (Collaborator, NII)

Prof. Lei Chen, (Visitor/Collaborator, Hong Kong University of Science and Technology, Jan. 21, 2017 – Jan. 26, 2017)

Prof. Feida Zhu, (Visitor/Collaborator, Singapore Management University, Feb. 12, 2017 – Feb. 20, 2017)

Prof. Zhifeng Bao, (Visitor/Collaborator, RMIT University, Australia, Feb. 8, 2017 – Feb. 16, 2017)

Prof. Stephen Downie, (Visitor, University of Illinois Urbana-Champaign, USA, September 16, 2016)

Prof. Alípio Mário Guedes Jorge (Visitor/Collaborator, University of Porto ­ INESC, Portugal, July 25, 2016 – August 3)

Prof. Guo-Jun Qi (Visitor, University of Central Florida, USA, May 13, 2016 – May 28, 2016)

Dr. Tian  Huat Tan (Visitor, Singapore University of Technology and Design, Singapore, March 13, 2016 – March 23, 2016)

Prof. Roger Zimmermann (Collaborator, National University of Singapore, Singapore)

Prof. Suhua Tang (Collaborator/Visitor, The University of Electro-Communications, Japan)