Social information technologies to counter infodemics CREST Research area : Core technologies for trusted quality AI systems

Achievements

Refereed journal papers | Refereed conference papers | Preprints | Books, book chapters, and research reports | Invited talks | Oral Presentation, Poster・demo | Media coverage(Press release/ News release) | Media coverage(Online articles) | Media coverage(TV / Radio) | Media coverage(Newspapers) | Media coverage(Others) | Patents | Awards | Others

Refereed journal papers

  1. H. Felouat, H. H. Nguyen, T. -N. Le, J. Yamagishi and I. Echizen, "eKYC-DF: A Large-Scale Deepfake Dataset for Developing and Evaluating eKYC Systems", IEEE Access, vol. 12, pp. 30876-30892, 2024, Link
  2. K. -D. Nguyen, H. H. Nguyen, T. -N. Le, J. Yamagishi and I. Echizen, "Analysis of Fine-Grained Counting Methods for Masked Face Counting: A Comparative Study", IEEE Access, vol. 12, pp. 27426-27443, 2024, Link
  3. P. Ghasiya, G. Ahnert, K. Sasahara, "Identifying Themes of Right-Wing Extremism in Hindutva Discourse on Twitter", ISocial Media + Society. 9, 20563051231199457 (2023), Link
  4. P. Ghasiya and K. Sasahara, "Messaging Strategies of Ukraine and Russia on Telegram during the 2022 Russian invasion of Ukraine", First Monday 28(8) (2023), Link
  5. Yi Ji, Trung-Nghia Le, Huy H. Nguyen, Isao Echizen, "Purifying Adversarial Images using Adversarial Autoencoders with Conditional Normalizing Flows," IEEE Open Journal of Signal Processing, 2023
  6. Xuechen Liu, Xin Wang, Md Sahidullah, Jose Patino, Héctor Delgado, Tomi Kinnunen, Massimiliano Todisco, Junichi Yamagishi, Nicholas Evans, Andreas Nautsch, Kong Aik Lee, "ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wild", IEEE/ACM Transactions on Audio Speech and Language Processing 10.1109/TA SLP.2023.3285283, June 2023
  7. CC Chang, X Wang, S Chen, H Kiya, I Echizen, "On the predictability in reversible steganography", Telecommunication Systems, Springer, 1-13, January 2023, Link
  8. L. Zhang, X. Wang, E. Cooper, N. Evans and J. Yamagishi, “The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterance”, IEEE/ACM Transactions on Audio, Speech, and Language Processing, Link
  9. Mauro Barni, Yi Fang, Yuhong Liu, Laura Robinson, Kazutoshi Sasahara, Subramaniam Vincent, Xinchao Wang and Zhizheng Wu, "Combating Misinformation/ Disinformation in Online Social Media: A Multidisciplinary View", APSIPA Transactions on Signal and Information Processing (2022), Link
  10. Ching-Chun Chang, Xu Wang, Sisheng Chen, Isao Echizen, Victor Sanchez, Chang-Tsun Li, "Deep Learning for Predictive Analytics in Reversible Steganography", IEEE ACCESS, Preprint
  11. K. Gao, C.-C. Chang, J.-H. Horng, and I. Echizen, "Steganographic Secret Sharing via AI-Generated Photorealistic Images" EURASIP Journal on Wireless Communications and Networking
  12. Yuki Hirose, Kazuaki Nakamura, Naoko Nitta, Noboru Babaguchi, "Anonymization of Human Gait in Video Based on Silhouette Deformation and Texture Transfer", IEEE Transactions on Information Forensics and Security, vol.17, pp.3375-3390
  13. Mahdi Khosravy, Kazuaki Nakamura, Naoko Nitta, Nilanjan Dey, Rubén González Crespo, Enrique Herrera-Viedma, Noboru Babaguchi, "Social IoT Approach to Cyber Defense of a Deep-Learning-Based Recognition System in Front of Media Clones Generated by Model Inversion Attack", IEEE Transactions on Systems, Man, and Cybernetics: Systems
  14. Chang Zeng, Xiaoxiao Miao, Xin Wang, Erica Cooper, and Junichi Yamagishi, "Joint Speaker Encoder and Neural Back-end Model for Fully End-to-End Automatic Speaker Verification with Multiple Enrollment Utterances", IEEE/ACM Transactions on Audio Speech and Language Processing, submitted, preprint
  15. Takayuki Mizuno, Shouji Fujimoto and Atsushi Ishikawa, "Generation of individual daily trajectories by GPT-2", Front. Phys. Link
  16. Shouji Fujimoto, Atsushi Ishikawa, Takayuki Mizuno, "Copula-based synthetic data generation in firm-size variable", The Review of Socionetwork Strategies 16, 479–492, Link
  17. T. Yasui, T. Tanaka, A. Malik, M. Kuribayashi, "Coded DNN watermark: robustness against pruning models using constant weight code", Journal of Imaging, vol.8, no.6, 16pages, 2022
  18. Piyush Ghasiya and Kazutoshi Sasahara, "Rapid Sharing of Islamophobic Hate on Facebook: The Case of the Tablighi Jamaat Controversy", Social Media + Society (2022), Link
  19. Hitoshi Kiya, Ryota Iijima, MaungMaung Aprilpyone, Yuma Kinoshita, "Image and Model Transformation with Secret Key for Vision Transformer", IEICE Trans. Inf. & Sys., March, 2023 (Invited), Preprint
  20. Jialiang Shi, Piyush Ghasiya and Kazutoshi Sasahara, "Psycho-linguistic Differences among Competing Vaccination Communities on Social Media", APSIPA Transactions on Signal and Information Processing: Vol.11, No.1, e15, June 2022, Link
  21. Wentao Xu and Kazutoshi Sasahara, "A Network-Based Approach to QAnon User Dynamics and Topic Diversity During the COVID-19 Infodemic", APSIPA Transactions on Signal and Information Processing, Vol.11, No.1, e17, June 2022, Link
  22. Hiroki Ito, AprilPyone MaungMaung, Sayaka Shiota, and Hitoshi Kiya, "Access Control of Semantic Segmentation Models Using Encrypted Feature Maps", APSIPA TSIP, accepted, 2022, Preprint
  23. AprilPyone MaungMaung, Hitoshi Kiya, "Privacy-Preserving Image Classification Using Isotropic Network", IEEE MultiMedia, accepted, April 2022, Preprint
  24. Huy H. Nguyen, Sébastien Marcel, Junichi Yamagishi. Isao Echizen, "Master Face Attacks on Face Recognition Systems", IEEE TBIOM, accepted, April 2022, Link
  25. Asad Malik, Minoru Kuribayashi, Sani M. Abdullahi, Ahmad Neyaz Khan, "DeepFake Detection for Human Face Images and Videos: A Survey", IEEE Access, vol.10, pp.18757-18775, 2022, Link
  26. Hitoshi Kiya, AprilPyone MaungMaung, Yuma Kinoshita, Imaizumi Shoko, Sayaka Shiota, "An Overview of Compressible and Learnable Image Transformation with Secret Key and Its Applications", APSIPA Transactions, accepted, 2022, Preprint
  27. Huy H. Nguyen, Minoru Kuribayashi, Junichi Yamagishi, Isao Echizen, "Effects of Image Processing Operations on Adversarial Noise and Their Application to Detecting and Correcting Adversarial Images," IEICE Trans. Inf. Syst., vol.E105-D, no.1, 2022.
  28. Mahdi Khosravy, Kazuaki Nakamura, Yuki Hirose, Naoko Nitta, and Noboru Babaguchi, "Model Inversion Attack by Integration of Deep Generative Models: Privacy- Sensitive Face Generation From a Face Recognition System", IEEE Transactions on Information Forensics and Security,10.1109/TIFS.2022.31406 87 Vol.17, published, January 2022.
  29. X. Shi, E. Cooper and J. Yamagishi, "Use of Speaker Recognition Approaches for Learning and Evaluating Embedding Representations of Musical Instrument Sounds", IEEE/ACM Transactions on Audio, Speech, and Language Processing 10.1109/TASLP.2022.314 0549, published, January 2022.
  30. Huy H. Nguyen, Sebastien Marcel, Junichi Yamagishi, and Isao Echizen, "A Study of Master Face Attacks on Face Recognition Systems", IEEE TRANSACTIONS ON BIOMETRICS, BEHAVIOR, AND IDENTITY SCIENCE (T-BIOM), January 2022.
  31. Shouji Fujimoto, Takayuki Mizuno, Atushi Ishikawa, "Interpolation of non-random missing values in financial statements’ big data using CatBoost", IEEE/ACM Transactions on Audio, Speech, and Language Processing 10.1109/TASLP.2021.313 8681, published, December, 2021>
  32. A. Kanervisto, V. Hautamäki, T. Kinnunen and J. Yamagishi, "Optimizing Tandem Speaker Verification and Anti-Spoofing Systems" Journal of Computational Social Science, published, March, 2021>
  33. Trung-Nghia Le, Yubo Cao, Tan-Cong Nguyen, Minh-Quan Le, Khanh-Duy Nguyen, Thanh-Toan Do, Minh-Triet Tran, Tam V. Nguyen, "Camouflaged Instance Segmentation In-The-Wild: Dataset, Method, and Benchmark Suite", IEEE Transactions on Image Processing (T-IP), accepted, 2021, Preprint
  34. Xu Wentao and Kazutoshi Sasahara, "Characterizing the roles of bots on Twitter during the COVID-19 infodemic", Journal of Computational Social Science, accepted, 2021, Preprint, Link
  35. Sisheng Chen, Ching-Chun Chang, and Isao Echizen, "Steganographic Secret Sharing with GAN-Based Face Synthesis and Morphing for Trustworthy Authentication in IoT," IEEE Access, accepted, 2021, Link
  36. Thach V. Bui, Mahdi Cheraghchi, and Isao Echizen, "Improved non-adaptive algorithms for threshold group testing with a gap", IEEE Transactions on Information Theory, accepted, 2021, Link
  37. April Pyone MAUNG MAUNG, Hitoshi KIYA, "A protection method of trained CNN model with a secret key from unauthorized access", APSIPA Transactions on Signal and Information Processing, Vol.10, July 2021, Link
  38. Akiko Matsuo, Baofa Du and Kazutoshi Sasahara, "Appraisals of Fairness moral foundation predicts the language use involving moral issues on Twitter among Japanese", Frontiers in Psychology, accepted, 2021
  39. April Pyone MAUNG MAUNG, Hitoshi KIYA, "Block-wise Image Transformation with Secret Key for Adversarially Robust Defense" IEEE Trans. on Information Forensics and Security, in press, March 2021, Link
  40. Mahdi Khosravy, Kazuaki Nakamura, Yuki Hirose, Naoko Nitta, Noboru Babaguchi, "Model Inversion Attack: Analysis under Gray-box Scenario on Deep Learning based Face Recognition System", KSII Transactions on Internet and Information Systems, Vol.15, No.3, pp.1100-1118, March 2021, Link

Refereed conference papers

  1. Teru Nagamori, Sayaka Shiota and Hitoshi Kiya, "Efficient Fine-Tuning with Domain Adaptation for Privacy-Preserving Vision Transformer", APSIPA Transactions on Signal and Information Processing: Vol. 13: No. 1, e8, Apr. 2024, Link
  2. Shirin Dabbaghi, Canasai Kruengkrai, Ramin Yahyapour, Junichi Yamagishi, "Bridging Textual and Tabular Worlds for Fact Verification: A Lightweight, Attention-Based Model,", 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), May 2024
  3. X. Wang and J. Yamagishi, "Can Large-Scale Vocoded Spoofed Data Improve Speech Spoofing Countermeasure with a Self-Supervised Front End?,", ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Korea, Republic of, 2024, pp. 10311-10315, doi: 10.1109/ICASSP48485.2024.10446331, April 2024
  4. T. Chen, Y. Hirota, M. Otani, N. Garcia, and Y. Nakashima, "Would Deep Generative Models Amplify Bias in Future Models?", In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2024.,
  5. F. Baldassini, H. H. Nguyen, C.-C. Chang, I. Echizen, "CROSS-ATTENTION WATERMARKING OF LARGE LANGUAGE MODEL", Proc. of the 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2024), 5 pages, April 2024
  6. F. Shalabi, H. Felouat, H. H. Nguyen, I. Echizen, "Leveraging Chat-Based Large Vision-Language Models for Multimodal Out-of-Context Detection", Proc. of the 38-th International Conference on Advanced Information Networking and Applications (AINA-2024), April 2024
  7. Z. Dou, Y. Guo, H. H. Nguyen, C.-C. Chang, I. Echizen, "Enhancing Robustness of LLM-Synthetic Text Detectors for Academic Writing: A Comprehensive Analysis", Proc. of the 38-th International Conference on Advanced Information Networking and Applications (AINA-2024), April 2024
  8. M. Pandey, H. Kaur, S. Basak, I. Echizen, "Privacy-Preserving Location-Based Services: A DQN Algorithmic Perspective", Proc. of the 38-th International Conference on Advanced Information Networking and Applications (AINA-2024), April 2024
  9. J. Zhang, B. Wang, L. Li, Y. Nakashima, and H. Nagahara, "Instruct Me More! Random Prompting for Visual In-Context Learning", Proc. Winter Conference on Applications of Computer Vision (WACV), 10 pages, January 2024
  10. Z. Pang, Y. Nakashima, M. Otani, and H. Nagahara, "Revisiting Pixel-Level Contrastive Pre-Training on Scene Images", Proc. Winter Conference on Applications of Computer Vision (WACV), 10 pages, January 2024
  11. Yi-Chen Chang, Canasai Kruengkrai, Junichi Yamagishi, "XFEVER: Exploring Fact Verification across Languages", Computer Speech & Language , submitted, December 2023
  12. E. Bao, C.-C. Chang, H. H. Nguyen, I. Echizen, "From Deconstruction to Reconstruction: A Plug-in Module for Diffusion-Based Purification of Adversarial Examples", Proc. of the 22nd International Workshops on Digital-forensics and Watermarking (IWDW2023), November 2023
  13. Yi-Chen Chang, Canasai Kruengkrai, and Junichi Yamagishi, "XFEVER: Exploring Fact Verification across Languages. In Proceedings of the 35th Conference on Computational Linguistics and Speech Processing (ROCLING 2023), pages 1?11, Taipei City, Taiwan", The Association for Computational Linguistics and Chinese Language Processing (ACLCLP), October 2023
  14. R. Shukla, H. Kaur, I. Echizen, and P. Khanna, "Fingerprint Digital Twin for Secure and Privacy Preserving Biometric Authentication", Proc. of the 2023 IEEE Conference on Systems, Man, and Cybernetics (IEEE SMC 2023), 8 pages, October 2023
  15. T. Nagamori, S. Shiota, and H. Kiya , "Domain Adaptation for Efficiently Fine-tuning Vision Transformer with Encrypted Images", APSIPA ASC 2023, accepted, October 2023
  16. R Aso, S. Shiota, and H. Kiya , "Enhanced Security with Encrypted Vision Transformer in Federated Learning", IEEE GCCE 2023, accepted, October 2023
  17. R. Iijima, M. Tanaka, S. Shiota, and H. Kiya , "Enhanced Security against Adversarial Examples Using a Random Ensemble of Encrypted Vision Transformer Models", IEEE GCCE 2023, accepted, October 2023
  18. W. Zhao, Y. Nakashima, H. Chen, and N, Babaguchi, "Enhancing Fake News Detection in Social Media via Label Propagation on Cross-modal Tweet Graph", ACM Multimedia 2023, 9 pages, October 2023
  19. F. Shalabi, H. H. Nguyen, H. Felouat, C.-C. Chang, and I. Echizen, "Image-Text Out-Of-Context Detection Using Synthetic Multimodal Misinformation", APSIPA ASC 2023, 8 pages, October 2023
  20. A.P. MaungMaung, I. Echizen, and H. Kiya, "Hindering Adversarial Attacks with Multiple Encrypted Patch Embeddings", APSIPA ASC 2023, 7 pages, October 2023
  21. H. H. Nguyen, J. Yamagishi, and I. Echizen, "How Close Are Other Computer Vision Tasks to Deepfake Detection?", IEEE International Joint Conference on Biometrics (IJCB 2023), 10 pages, September 2023
  22. M. Niu, Z. Li, Y. Zhan, H. H. Nguyen, I. Echizen, and Y. Zheng, "Physics-Based Adversarial Attack on Near-Infrared Human Detector for Nighttime Surveillance Camera Systems", ACM Multimedia 2023, 10 pages, October 2023
  23. Canasai Kruengkrai and Junichi Yamagishi, "Revisiting Pathologies of Neural Models under Input Reduction", In Proceedings of Findings of the Association for Computational Linguistics: ACL 2023, pages 11504--11517, 2023., Link
  24. Lin Zhang, Xin Wang, Erica Cooper, Nicholas Evans, Junichi Yamagishi, "Range-Based Equal Error Rate for Spoof Localization", Interspeech 2023, August 2023, Link
  25. Chang Zeng, Xin Wang, Xiaoxiao Miao, Erica Cooper, Junichi Yamagishi, "Improving Generalization Ability of Countermeasures for New Mismatch Scenario by Combining Multiple Advanced Regularization Terms", Interspeech 2023, August 2023, Link
  26. Hoang-Quoc Nguyen-Son, Seira Hidano, Kazuhide Fukushima, Shinsaku Kiyomoto and Isao Echizen, "VoteTRANS: Detecting Adversarial Text without Training by Voting on Hard Labels of Transformations". Finding of The 61st Annual Meeting of the Association for Computational Linguistics (ACL), July 2023
  27. Mayu Otani, Riku Togashi, Yu Sawai, Ryosuke Ishigami, Yuta Nakashima, Esa Rahtu, Janne Heikkilä, Shin'ichi Satoh, "Toward verifiable and reproducible human evaluation for text-to-image generation," IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
  28. D. Gamage, K. Sasahara, "A Mixed-method Approach to Analyze Deepfake related discussions on Reddit and Twitter ", 9th International Conference on Computational Social Science , submitted, July 2023
  29. Xin Wang, Junichi Yamagishi, "Spoofed training data for speech spoofing countermeasure can be efficiently created using neural vocoders", ICASSP 2023 /10.1109/ICA SSP49357.2023.1009477 9, accepted, June 2023
  30. Bowen Wang, Liangzhi Li, Yuta Nakashima, Hajime Nagahara, "Learning Bottleneck Concepts in Image Classification", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), accepted, June 2023
  31. Yusuke Hirota, Yuta Nakashima, Noa Garcia, "Model-Agnostic Gender Debiased Image Captioning", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), accepted, June 2023
  32. Noa Garcia, Yusuke Hirota, Yankun Wu, Yuta Nakashima, "Uncurated Image-Text Datasets: Shedding Light on Demographic Bias", IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), accepted, June 2023
  33. H. Kaur, R. Shukla, I. Echizen, and P. Khanna, "Secure and Privacy Preserving Proxy Biometrics Identities", AINA 2023, March 2023, Preprint
  34. Yuki Hirose, Kazuaki Nakamura, Naoko Nitta, and Noboru Babaguchi, "An Experimental Consideration on Gait Spoofing", in Proceedings of 18th International Conference on Computer Vision Theory and Applications, 8 pages, Lisbon, Portugal, Feb., 2023.
  35. Y. Sun, Z. Zhang, I. Echizen, H. H. Nguyen, C. Qiu, and S. Lu, “Face Forgery Detection Based on Facial Region Displacement Trajectory Series”, Winter Conference on Applications of Computer Vision Workshop (WACV-W) 2023, Preprint
  36. Zongshang Pang, Yuta Nakashima, Mayu Otani, Hajime Nagahara, "Contrastive Losses Are Natural Criteria for Unsupervised Video Summarization", IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2023) , January 2023, Preprint
  37. Li-Kuang Chen, Canasai Kruengkrai, and Junichi Yamagishi, "Outlier-Aware Training for Improving Group Accuracy Disparities", AACL-IJCNLP: Student Research Workshop, pages 54--60, 2022 Link, code
  38. M. S. Raval, M. Roy, M. Kuribayashi, "Survey on Vision Based Fake News Detection and Its Impact Analysis", Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2022), pp. 1834-1838, 2022.
  39. P. Raval, H. Khakhi, M. Kuribayashi, M. S. Raval, "Defense Against Adversarial Examples Using Beneficial Noise", Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2022), pp. 1839-1845, 2022
  40. H. Takiwaki, M. Kuribayashi, N. Funabiki, M. S. Raval, "Privacy Protection Against Automated Tracking System Using Adversarial Patch", Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2022), pp.1846-1851, 2022
  41. M. Kuribayashi, K. Kamakari, N. Funabiki, "Classification of Screenshot Image Captured in Online Meeting System", International IFIP Cross Domain Conference for Machine Learning & Knowledge Extraction (CD-MAKE2022), LNCS 13480, pp.244-255, Springer-Verlag, 2022
  42. Futa Waseda, Sosuke Nishikawa, Trung-Nghia Le, Huy H. Nguyen, and Isao Echizen, "Closer Look at the Transferability of Adversarial Examples: How They Fool Different Models Differently," IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2023) , January 2023, Preprint
  43. Huy H. Nguyen, Trung-Nghia Le, Junichi Yamagishi, and Isao Echizen, "Analysis of Master Vein Attacks on Finger Vein Recognition Systems," IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2023), January 2023, Preprint
  44. K. Tsunomori, Y. Yamasaki, M. Kuribayashi, N. Funabiki, I. Echizen, "Detection and Correction of Adversarial Examples Based on JPEG-Compression-Derived Distortion," Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2022), November 2022
  45. Ryota Iijima, Miki Tanaka, Isao Echizen, and Hitoshi Kiya, "On the Adversarial Transferability of ConvMixer Models", APSIPA ASC 2022, Novemver 2022, Preprint
  46. Miki Tanaka, Isao Echizen, Hitoshi Kiya, "On the Transferability of Adversarial Examples between Encrypted Models", IEEE ISPACS 2022, Novemver 2022, Preprint
  47. Ryota Iijima, Hitoshi Kiya, "An Encryption Method of ConvMixer Models without Performance Degradation", the International Conference on Machine Learning and Cybernetics 2022 (ICMLC 2022), September 2022, Preprint
  48. Sosuke Nishikawa, Ikuya Yamada, Yoshimasa Tsuruoka, Isao Echizen, "A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification", The SIGNLL Conference on Computational Natural Language Learning (CoNLL 2022), December 2022, Preprint
  49. Trung-Nghia Le, Ta Gu, Huy H. Nguyen, Isao Echizen, "Rethinking Adversarial Examples for Location Privacy Protection", IEEE International Workshop on Information Forensics and Security, 2022 (WIFS 2022), December 2022, Preprint
  50. Minh-Quan Le, Trung-Nghia Le, Tam V. Nguyen, Isao Echizen, Minh-Triet Tran, "GUNNEL: Guided Mixup Augmentation and Multi-View Fusion for Aquatic Animal Segmentation", CV4Animal Workshop, CVPR 2022, June 2022, Preprint, Poster
  51. Canasai Kruengkrai, Junichi Yamagishi “Mitigating the Diminishing Effect of Elastic Weight Consolidation” COLING 2022, accepted, Oct 2022
  52. Chang Zeng, Lin Zhang, Meng Liu, Junichi Yamagishi “Spoofing-Aware Attention based ASV Back-end with Multiple Enrollment Utterances and a Sampling Strategy for the SASV Challenge 2022" Interspeech 2022, accepted, Sept 2022, Preprint
  53. Erica Cooper, Wen-Chin Huang, Tomoki Toda, JunichiYamagishi, "Generalization Ability of MOS Prediction Networks", IEEE ICASSP 2022, May 2022
  54. Chang Zeng, Xin Wang, Erica Cooper, Xiaoxiao Miao, Junichi Yamagishi “Attention Back-end for Automatic Speaker Verification with Multiple Enrollment Utterances” ICASSP 2022, May 2022, Link
  55. K. Miyazaki, T. Uchiba, K. Tanaka, J. An, H. Kwak, and K. Sasahara, “This is Fake News”: Characterizing the Spontaneous Debunking from Twitter Users to COVID-19 False Information, ICWSM 2023 (International AAAI Conference on Web and Social Media) Preprint
  56. Zheng Qi, AprilPyone MaungMaung, Yuma Kinoshita and Hitoshi Kiya, "Privacy-Preserving Image Classification Using Vision Transformer", EUSIPCO2022, accepted, August 2022, Preprint
  57. Sosuke Nishikawa, Ryokan Ri, Ikuya Yamada, Yoshimasa Tsuruoka and Isao Echizen, "EASE: Entity-Aware Contrastive Learning of Sentence Embedding." NAACL 2022, accepted, July 2022 , Preprint
  58. Shunsuke Yoshimura, Kazuaki Nakamura, Naoko Nitta, and Noboru Babaguchi, "Model Inversion Attack against a Face Recognition System in a Black-Box Setting", Proc. Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC2021), December 2021
  59. Yusuke Hirota, Yuta Nakashima, Noa Garcia, "Gender and Racial Bias in Visual Question Answering Datasets", Proc. ACM Conference on Fairness, Accountability, and Transparency (FAccT) 2022, accepted, June 2022
  60. Lin Zhang, Xin Wang, Erica Cooper, Junichi Yamagishi, Jose Patino, and Nicholas Evans, “An Initial Investigation for Detecting Partially Spoofed Audio” in Proc. Interspeech, 2021, pp. 4264—4268, Link
  61. Lin Zhang and Xin Wang and Erica Cooper and Junichi Yamagishi, “Multi-task Learning in Utterance-level and Segmental-level Spoof Detection”, in Proc. ASVspoof 2021 workshop, pp. 9-15, Link
  62. Kunihiro Miyazaki, Takayuki Uchiba, Kenji Tanaka, Kazutoshi Sasahara, "Characterizing the Anti-Vaxxers’ Reply Behavior on Social Media", WI-IAT '21, December 2021 Link
  63. Canasai Kruengkrai, Junichi Yamagishi , "Mitigating Catastrophic Forgetting in Continual Learning for Fact Verification", accepted, THE 29TH INTERNATIONAL CONFERENCE ON COMPUTATIONA L LINGUISTICS (COLING 2022) , October 2022
  64. Xin Wang, Junich Yamagishi, "Investigating self-supervised front ends for speech spoofing countermeasures", accepted, ISCA Odyssey2022 , July 2022
  65. Riku Togashi, Mayu Otani, Yuta Nakashima, Esa Rahtu, Janne Heikkila, Tetsuya Sakai, "AxIoU: An Axiomatically Justified Measure for Video Moment Retrieval", Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition, accepted, June 2022
  66. Mayu Otani, Riku Togashi, Yuta Nakashima, Esa Rahtu, Janne Heikkila, and Shin'ichi Satoh, "Optimal Correction Cost for Object Detection Evaluation", Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition, accepted, June 2022
  67. Yusuke Hirota, Yuta Nakashima, and Noa Garcia, "Quantifying Societal Bias Amplification in Image Captioning", Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition, accepted, June 2022
  68. Dilrukshi Gamage, Piyush Ghasiya, Vamshi Krishna Bonagiri, Mark E. Whiting, and Kazutoshi Sasahara, "Are deepfakes concerning? Exploring societal implications of deepfake conversations in Reddit", CHI 2022, accepted, May 2022, Link
  69. Xin Wang, Junich Yamagishi, "Estimating the confidence of speech spoofing countermeasure", IEEE ICASSP 2022 ,accepted , May, 2022
  70. Wen-Chin Huang, Erica Cooper, Junichi Yamagishi, Tomoki Toda, "LDNet: Unified Listener Dependent Modeling in MOS Prediction for Synthetic Speech ", IEEE ICASSP 2022 ,accepted , May, 2022
  71. Khanh-Duy Nguyen, Huy H. Nguyen, Trung-Nghia Le, Junichi Yamagishi, Isao Echizen, "Effectiveness of Detection-based and Regression-based Approaches for Estimating Mask-Wearing Ratio," The International Workshop on Face and Gesture Analysis for COVID-19 (FG4COVID19) held in conjunction with FG 2021, December, 2021, preprint, dataset
  72. D. Takeshita, M. Kuribayashi, N. Funabiki, "A study of feature extraction suitable for double JPEG compression analysis based on statistical bias observation of DCT coefficients", APSIPA ASC 2021, December 2021
  73. K. Nakai, M. Kuribayashi, N. Funabiki, "A study of privacy protection of photos taken by wide-angle surveillance camera", APSIPA ASC 2021, December 2021
  74. Y. Yamasaki, M. Kuribayashi, N. Funabiki, H. Nguyen, and I. Echizen, "A Study of Feature Extraction Based on Denoising Auto Encoder for Classification of Adversarial Examples," APSIPA ASC 2021, December 2021
  75. MaungMaung AprilPyone, Hitoshi Kiya, "A Protection Method of Trained CNN Model Using Feature Maps Transformed With Secret Key From Unauthorized Access", APSIPA ASC 2021, December 2021, Preprint
  76. Dilrukshi Gamage, Jiayu Chen, and Kazutoshi Sasahara, "The Emergence of Deepfakes and its Societal Implications: A Systematic Review", Conference for Truth and Trust Online, October 2021
  77. Sosuke Nishikawa, Ikuya Yamada, Yoshimasa Tsuruoka, Isao Echizen, "A Multilingual Bag-of-Entities Model forZero-Shot Cross-Lingual Text Classification", ACL-IJCNLP 2021 Student Research Workshop (non-archival option), 2021, Link
  78. Liangzhi Li, Bowen Wang, Manisha Verma, Yuta Nakashima, Ryo Kawasaki, Hajime Nagahara, “SCOUTER: Slot Attention-based Classifier for Explainable Image Recognition” ICCV 2021, accepted, October 2021, Preprint, code
  79. Trung-Nghia Le, Huy H. Nguyen, Junichi Yamagishi, Isao Echizen, "OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wild" ICCV 2021, accepted, October 2021, Preprint, presentation video, dataset
  80. April Pyone MAUNG MAUNG, Hitoshi KIYA, "TRANSFER LEARNING-BASED MODEL PROTECTION WITH SECRET KEY,", IEEE International Conference on Image Processing, accepted, September 2021
  81. Erica Cooper, Xin Wang, Junichi Yamagishi, "Text-to-Speech Synthesis Techniques for MIDI-to-Audio Synthesis", Proc. 11th ISCA Speech Synthesis Workshop (SSW 11) 10.21437/SSW.2021-23 , published, August 2021
  82. Erica Cooper, Junichi Yamagishi, "How do Voices from Past Speech Synthesis Challenges Compare Today?", Proc. 11th ISCA Speech Synthesis Workshop (SSW 11) 10.21437/SSW.2021-32 , published, August 2021
  83. Xin Wang, Junich Yamagishi, "A Comparative Study on Recent Neural Spoofing Countermeasures for Synthetic Speech Detection", Proc. Interspeech 2021 10.21437/Interspeech.202 1-702, published, August 2021
  84. Canasai Kruengkrai, Xin Wang, Junichi Yamagishi, "A Multi-Level Attention Model for Evidence-Based Fact Checking", Findings of ACL2021, accepted, August 2021, Preprint, code
  85. M. Kuribayashi, T. Tanaka, S. Suzuki, T. Yasui, Nobuo Funabiki, "White-box watermarking scheme for fully-connected layers in fine-tuning model," 9th ACM Workshop on Information Hiding and Multimedia Security (IH&MMSec'21), accepted, June 2021.
  86. April Pyone MAUNG MAUNG, Hitoshi KIYA, "Piracy-Resistant DNN Watermarking by Block-Wise Image Transformation with Secret Key," ACM Workshop on Information Hiding and Multimedia Security 22th, accepted, June 2021.
  87. Marc Treu, Trung-Nghia Le, Huy H. Nguyen, Junichi Yamagishi, Isao Echizen, "Fashion-Guided Adversarial Attack on Person Segmentation", Computer Vision and Pattern Recognition WORKSHOP ON MEDIA FORENSICS 2021, accepted, June 2021, Preprint, Presentation Video, code/dataset
  88. Harkeerat Kaur, Rohit Kumar, and Isao Echizen, "Reinforcement Learning based Smart Data Agent for Location Privacy", The 35th International Conference on Advanced Information Networking and Applications (AINA-2021), accepted, May 2021
  89. Sota Kawakami, Kei Okada, Naoko Nitta, Kazuaki Nakamura, Noboru Babaguchi, "Semi-supervised outdoor image generation conditioned on weather signals", Proc. of 25th International Conference on Pattern Recognition (ICPR2020), January 2021
  90. A. Higashi, M. Kuribayashi, N. Funabiki, H. Nguyen, I. Echizen, "Detection of adversarial examples based on sensitivities to noise removal filter", Proceedings of 2020 Asia-Pacific Signal and Information Processing Association Anual Sumit and Confonference (APSIPA ASC 2020), December 2020

Preprints

  1. Lin Zhang, Xin Wang, Erica Cooper, Nicholas Evans, Junichi Yamagishi, "The PartialSpoof Database and Countermeasures for the Detection of Short Generated Audio Segments Embedded in a Speech Utterance", Submitted to IEEE/ACM Transactions on Audio Speech and Language Processing, April 2022, Preprint
  2. Xiaoxiao Miao, Xin Wang, Erica Cooper, Junichi Yamagishi, Natalia Tomashenko, "Analyzing Language-Independent Speaker Anonymization Framework under Unseen Conditions", March 2022, Preprint
  3. Xin Wang, Junich Yamagishi, "Investigating Active-learning-based Training Data Selection for Speech Spoofing Countermeasure", March 2022, Preprint
  4. Wen-Chin Huang, Erica Cooper, Yu Tsao, Hsin-Min Wang, Tomoki Toda, Junichi Yamagishi, "The VoiceMOS Challenge 2022", March 2022, Preprint
  5. K. Miyazaki, T. Uchiba, K. Tanaka, and K. Sasahara, "Aggressive behaviour of anti-vaxxers and their toxic replies in English and Japanese", January 2022, Preprint
  6. Futa Waseda, Sosuke Nishikawa, Trung-Nghia Le, Huy H. Nguyen, Isao Echizen, "Closer Look at the Transferability of Adversarial Examples: How They Fool Different Models Differently", December 2021, Preprint
  7. Minh-Quan Le, Trung-Nghia Le, Tam V. Nguyen, Isao Echizen, Minh-Triet Tran, "Multimodal-based Scene-Aware Framework for Aquatic Animal Segmentation", December 2021, Preprint
  8. Jialiang Shi, Piyush Ghasiya, Kazutoshi Sasahara, "Psycho-linguistic differences among competing vaccination communities on social media", Novemver 2021, Preprint
  9. Wentao Xu, Kazutoshi Sasahara, "A network-based approach to QAnon user dynamics during COVID-19 infodemic", October 2021, Preprint
  10. Sosuke Nishikawa, Ikuya Yamada, Yoshimasa Tsuruoka, Isao Echizen, "A Multilingual Bag-of-Entities Model for Zero-Shot Cross-Lingual Text Classification", October 2021, Preprint

Books, book chapters, and research reports


    Frontiers in Fake Media Generation and Detection (M. Khosravy, I. Echizen, and N. Babaguchi, eds.)
     
    1. Kazuaki Nakamura, Yuto Mori, Naoko Nitta, and Noboru Babaguchi, "Recognizer Cloning Attack on Image Recognition Services and Its Defending Method", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 10, Springer, 2022
    2. Xin Wang and Junichi Yamagishi, "A Practical Guide to Logical Access Voice Presentation Attack Detection", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 8, Springer, 2022, Link
    3. MaungMaung AprilPyone and Hitoshi Kiya, "Adversarial Defense with Secret Key", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 7, Springer, 2022
    4. Minoru Kuribayashi, "Defense Against Adversarial Attacks", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 6, Springer, 2022
    5. Jeongwoo Lim, Masayuki Tamura, Naoko Nitta, Kazuaki Nakamura, and Noboru Babaguchi, "Spoofing Tweet Generator considering Points of Interest of Target User", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 5, Springer, 2022
    6. Trung-Nghia Le, Huy H Nguyen, Junichi Yamagishi, and Isao Echizen, "Robust Deepfake On Unrestricted Media: Generation And Detection", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 4, Springer, 2022, Link
    7. Minoru Kuribayashi, "Adversarial Attacks", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 3, Springer, 2022
    8. MaungMaung AprilPyone, Yuma Kinoshita, and Hitoshi Kiya, Tokyo Metropolitan, "Adversarial Examples and Defenses", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 2, Springer, 2022
    9. Dilrukshi Gamage, Jiayu Cheny, Piyush Ghasiya, and Kazutoshi Sasahara, "Deepfakes and Society: What lies ahead?", Book chapter, Frontiers in Fake Media Generation and Detection, Chapter 1, Springer, 2022
    10. Mahdi Khosravy, Isao Echizen, Noboru Babaguchi, "Frontiers in Fake Media Generation and Detection", Springer, June 2022, Link
    11. Ruben Tolosana, Christian Rathgeb, Ruben Vera-Rodriguez, Christoph Busch, Luisa Verdoliva, Siwei Lyu, Huy H. Nguyen, Junichi Yamagishi, Isao Echizen, Peter Rot, Klemen Grm, Vitomir Štruc, Antitza Dantcheva, Zahid Akhtar, Sergio Romero-Tapiador, Julian Fierrez, Aythami Morales, Javier Ortega-Garcia, Els Kindt, Catherine Jasserand, Tarmo Kalvet, Marek Tiits, "Future Trends in Digital Face Manipulation and Detection", Book chapter, Handbook of Digital Face Manipulation and Detection, pp.463-482, Springer, 2022
    12. Huy H. Nguyen, Junichi Yamagishi, Isao Echizen, "Capsule-Forensics Networks for Deepfake Detection", Book chapter, Handbook of Digital Face Manipulation and Detection, pp. 275-301, Springer, 2022

    Invited talks

    1. Y. Nakashima, "Mitigating social bias in image captioning models", International Workshop on Frontiers of Computer Vision, Feb. 2024.
    2. Isao Echizen, "Real or Fake? Frontiers of Countering Fake Media in the Age of Infodemics", MATH CU SEMINAR, Dept. Mathematics and Computer Science, Faculty of Science, Chulalongkorn University, March 1, 2024
    3. Isao Echizen, "Real or Fake? Frontiers of Countering Fake Media in the Age of Infodemics", The 1st Japan-Korea Workshop on Artificial Intelligence, December 27, 2023
    4. Isao Echizen, "Real or Fake? Frontiers of Countering Fake Media in the Age of Infodemics", The 11th US-JAPAN HI-TECH INDUSTRIALIZATION FORUM, December 19, 2023
    5. Isao Echizen, "Real or Fake? From Biometric Data Protection to Fake Media Detection", 2023 The 6th Asia Conference on Cognitive Engineering and Intelligent Interaction, December 15, 2023
    6. Isao Echizen, "The Risks and Opportunities of Generative AI", G7 Mito Ibaraki: Interior and Security Ministers' Meeting, December 9, 2023
    7. N. Garcia, "The elephant in the room: Societal biases in vision and language tasks", CVPR Workshop on New Frontiers for Zero-shot Image captioning Evaluation, June 2023
    8. Y. Nakashima, "Concept discovery from an image dataset: Toward image representation with an emergent language", Seventh International Workshop on Symbolic-Neural Learning (SNL-2023), June 2023
    9. Isao Echizen, "Real or Fake? Frontiers of Countering Fake Media in the Age of Infodemics", 2023 5th International Electronics Communication Conference (IECC 2023), July 2023
    10. Isao Echizen, "Real or Fake? From Biometric Data Protection to Fake Media Detection", 2023 8th International Conference on Information and Network Technologies (ICINT 2023), May 2023, Link
    11. Minoru Kuribayashi, "Multimedia Forensics for Fake Content Classification", International Conference on Emerging Computational Intelligence (ICECI 2023), February 2023 <Keynote>
    12. Isao Echizen, "Fake media detection and its practical application", Dagstuhl Seminar 23021, Media Forensics and the Challenge of Big Data, January 2023, Link
    13. Junichi Yamagishi, “Speech Synthesis Research 2.0”, THE 34TH CONFERENCE ON COMPUTATIONAL LINGUISTICS AND SPEECH PROCESSING (Rocling 2022), November 2022,
    14. Junichi Yamagishi, “Lessons learned from ASVSpoof and remaining challenges”, 1st International Workshop on Deepfake Detection for Audio Multimedia (DDAM 2022), Workshop at ACM Multimedia 2022, October 2022,
    15. Isao Echizen, "Real or Fake? From Biometric Data Protection to Fake Media Detection", ICSTE 2022, October 2022, Link
    16. Isao Echizen, IEICE English Webinar(Distinguished Lecturer Program Series), October 2022
    17. Isao Echizen, "Real or Fake? Fake Media Generation and Detection", INTERNATIONAL FORUM INTELLIGENCE AUGMENTATION AND AMPLIFICATION PLUS SOCIETY 2022 (IAASOC 2022), July 2022 Link
    18. Isao Echizen, "Real or Fake? From Biometric Data Protection to Fake Media Detection", The 2022 4th International Electronics Communication Conference (IECC 2022), July 2022 <Keynote>
    19. Isao Echizen, "Real or Fake? From Biometric Data Protection to Fake Media Detection", The 2nd International JST-ERCIM Workshop, December 8, 2021, Link
    20. Isao Echizen, "Real or Fake? From Biometric Data Protection to Fake Media Detection", Quarterly Invited Speech at IAPR Computation Forensics Technical Committee (TC6), September 29, 2021, Link
    21. Huy H. Nguyen, "Deepfake Generation and Detection – An Overview", The 27th Symposium on Sensing via Image Information, June 2021, Slides, Presentation Video
    22. Isao Echizen, "Real or Fake? The Future of Biometric Data Protection", EURASIP Journal on Image and Video Processing Webinar, May 2021
    23. M. Kuribayashi, "Adversarial Examples of Deep Learning System and Its Defense", IEEE Computational Intelligence Society Chapter and Ahmedabad University, March 2021
    24. Isao Echizen, "Real or Fake? The Future of Media Security and Privacy", Symposium of Yotta Informatics, Research Platform for Yotta-Scale Data Science 2021, March 2021
    25. Isao Echizen, Junichi Yamagishi, Trung-Nghia Le, and Huy H. Nguyen, "Real or Fake? The Future of Media Security and Privacy", The 7th International Symposium toward the Future of Advanced Researches in Shizuoka University 2021 (ISFAR-SU2021), March 2021
    26. Kazutoshi Sasahara, "Online echo chamber: What is it and how to break out of it?", Eurasian Summit of models for Society 2021, March 2021
    27. Isao Echizen, "Real or Fake? The future of biometric data protection", The 2021 2nd Asia Service Sciences and Software Engineering (ASSE) Conference, February 2021 <Keynote>

    Oral Presentation, Poster・demo

    1. D. Gamage and K. Sasahara, “A Mixed-method Approach to Analyze Deepfake related discussions on Reddit and Twitter [Oral]”, IC2S2 2023
    2. P. Ghasiya, A. Georg, and K. Sasahara, “Identifying Themes of Right-Wing Extremism in Hindutva Discourse on Twitter [Poster]”, IC2S2 2023
    3. K. Miyazaki et al., “How do Toxic Comments Induce Fearful Responses in Anti-vaccine Videos on YouTube? [Poster]”, IC2S2 2023
    4. Piyush Ghasiya Kazutoshi Sasahara, "Rapid Sharing of Islamophobic Hate on Facebook: The Case of the Tablighi Jamaat Controversy", IC2S2 2022, accepted, July 2022
    5. Wentao Xu, Kazutoshi Sasahara, "QAnon user dynamics and topical diversity amid the COVID-19 infodemic", IC2S2 2022, accepted, July 2022
    6. Dilrukshi Gamage, Kazutoshi Sasahara, "Analyzing conversations about deepfakes in Reddit and Twitter", IC2S2 2022, accepted, July 2022
    7. Kunihiro Miyazaki, Takayuki Uchiba, Jisun An, Haewoon Kwak, Kazutoshi Sasahara, "Characterizing the Spontaneous Debunking from Twitter Users to COVID-19 False Information", IC2S2 2022, accepted, July 2022
    8. Junichi Yamagishi and Isao Echizen, "Deepfake Video Detection", CES 2021, January 2021
    9. Jiayu Chen, Tasuku Igarashi, "Overcoming choice homophily under wealth disparities in dynamic social networks.", 5th Australian Social Network Analysis Conference, Novemver 2020
    10. Jiayu Chen, Tasuku Igarashi, "Do Well and Have Well: Favorable Behavior Breeds Rich-Poor Cooperation.", 32nd Association for Psychological Science Annual Convention, June 2020

    Media coverage(Press release/ News release)

    Media coverage(Online articles)

    1. Isao Echizen, The Yomiuri Shimbun, Japan Institute Researchers Devise New Way to Fight Deepfakes, August 30, 2023
    2. Masaru Kitsuregawa, Shigeo Urushidani, Kazutsuna Yamaji, Hiroki Takakura, Ichiro Hasuo, Imari Sato, Fuyuki Ishikawa, Isao Echizen, Kensaku Mori, Communications of the ACM, July 2023, Vol. 66 No. 7, Pages 58-63 10.1145/3589736,Activities of National Institute of Informatics in Japan
    3. Junichi Yamagishi, Forbes, Analyzing The Rise Of Deepfake Voice Technology, May 10, 2021
    4. Kazutoshi Sasahara, Proceedings of the National Academy of Sciences of the United States of America, Model captures how polarization emerges on social media during political campaigns, December 20, 2020

    Media coverage(TV / Radio)

    1. Isao Echizen, 2023/01/13, NHK World, [IN DEPTH] AI: The Good, the Bad and the Inspirational, Link

    Media coverage(Newspapers)

    Media coverage(Others)

    Patents

    Awards

    1. A.P.M. Maung and H. Kiya, Japan Student Journal Paper Award, IEEE Signal Processing Society (SPS) , 2022

    Others

    1. Miyazaki, K., Uchiba, T., Kwak, H. et al., "The impact of toxic trolling comments on anti-vaccine YouTube videos", published, Sci Rep 14, 5088 (2024) link
    2. K. Miyazaki, T. Uchiba, K. Tanaka, and K. Sasahara, "The Strategy Behind Anti-Vaxxers’ Reply Behavior on Social Media", submitted, Preprint