First International Workshop on Embodied Semiotics (EmSemi2023)

  • DATE: June 4-6, 2023 (depending on the number of papers and presentations, it would be a one-day or two-day workshop)
  • VENUE: Kumamoto-Jo Hall, Kumamoto, Japan (onsite/online/hybrid styles are all available)

Invited Speakers

In preparation

Aims and Scope

The purpose of this workshop is to develop a "multimodal semiotic" approach to the existing semiotics discussed in the fields of linguistics and philosophy of language, focusing on the phenomena such as gestures and signs in language interactions, which have not yet been clearly characterized as symbols. As a whole, we aim to "treat not only speech but also gestures and signs methodologically and engineeringly in a cross-modality manner (cross-modality)". As a result, we will organize interaction data annotated with multimodal semiotics as a corpus and make it widely available to the related research community to clarify the way to apply our theory to the development of multimodal dialogue translation technology. In this first workshop, we plan a special session to hear opinions on releasing the multimodal and sign language corpora. We call the above research activities as "Embodied Semiotics" to create a new academic field that integrates the humanities and sciences.

Call for Papers

Drawing on various interdisciplinary approaches such as:

  • Theoretical Linguistics
  • General Linguistics
  • Philosophy of Language
  • Sign Language Linguistics
  • Language Interaction Studies
  • Conversation Analysis
  • Ethnographic Studies
  • Gesture Studies
  • Human-Computer Interactions
  • Natural Language Processing
  • Computer Vision/Image Processing
  • Deep Learning

We welcome contributions related to the following topics, but are not limited to:

  • Linguistic theoretical issues on gestures and signs in language interactions
  • Understanding multimodal and embodied actions in social interactions
  • Computer-Mediated Communication: human-computer/human-robot interaction, communication via video conference
  • Media-Mediated Interaction: remote human-agent interaction supported by computer technologies
  • Natural Language Processing: machine translation, discourse analysis, dialog, text generation
  • Computer Vision: action recognition and localization, face and emotion, gesture and pose, video analysis
  • Multimodal: language and vision, multi-task learning, knowledge transfer

Paper Categories

    We will have the following two categories for the contribution to the Workshop,

  • Workshop Papers (14-page full paper)
  • This is the regular category of the isAI workshop. Your paper must be unpublished. Your paper will be reviewed by the scientific committee. After the workshop, you may be recommended for submission to the Post-proceedings.

  • Idea Presentations (400-word abstract)
  • This is the brand new category created by the EmSemi Workshop. Submissions will be carried out as a 400-word abstract, not a paper. The presentation does not have to be unpublished. You may present your idea as long as it does not violate the copyright rules of the conference at which you have presented/will present your paper. Your presentation contents will be reviewed by the scientific committee. After the workshop, you will NOT be recommended for submission to the Post-proceedings.  

Important Dates

Workshop Papers (14-page full paper)

  • Submission Deadline for Workshop Papers: March 31, 2023
  • Notification of Acceptance of Workshop Papers: April 30, 2023
  • Submission Deadline for Camera-Ready Papers: May 15, 2023
  • Workshop Dates: June 4-6, 2023

Idea Presentations (400-word abstract)

  • Submission Deadline for Position Papers: March 31, 2023
  • Notification of Acceptance of Position Papers: April 30, 2023
  • Workshop Dates: June 4-6, 2023


Workshop Papers (14-page full paper)

Papers should be written in English, formatted according to the Springer Verlag LNCS style in a pdf form, which can be obtained from, and not exceed 14 pages including figures, references, etc. If you use a word file, please follow the instruction of the format, and then convert it into a pdf form and submit it at:

If a paper is accepted, at least one author of the paper must register for the workshop and present it. We strongly encourage online registration. If you cannot submit a paper by EasyChair System by some trouble, please send an email to:

bono[a] (please change [a] to @.)

Idea Presentations (400-word abstract)

Abstracts should be written in English. Please submit it at:


Early-bird: until May 21, 2023

  • Member: 7,000JPY (no tax)
  • Non-member: 13,000JPY (incl tax)
  • Student: 5,000JPY (incl tax)

After May 22, 2023

  • Member: 12,000JPY (no tax)
  • Non-member: 18,000JPY (incl tax)
  • Student: 8,000JPY (incl tax)

Online audience

  • *Speakers cannot select these categories. (At least one of the authors are requested to pay the above-mentioned registration fee.)
  • Online member or student audience*: free
  • Online non-member audience*: 2,000JPY (incl tax)


Workshop chair

  • Mayumi Bono, National Institute of Informatics, Japan

Workshop co-chair

  • Hideki Nakayama, The University of Tokyo, Japan

Program Committee

  • Katsuya Takanashi, University of Shiga Prefecture, Japan
  • Kouhei Kikuchi, Tsukuba University of Technology, Japan
  • Eiko Yasui, Nagoya University, Japan
  • Takeshi Enomoto, Osaka University, Japan
  • Rui Sakaida, Future University Hakodate, Japan
  • Naomi Harada, Tokyo Metropolitan University, Japan
  • Naoya Fujikawa, The University of Tokyo, Japan
  • Yutaka Osugi, Tsukuba University of Technology, Japan
  • Keiko Sagara, National Museum of Ethnology, Japan
  • Victor Skobov, National Institute of Informatics, Japan
  • Tomohiro Okada, National Institute of Informatics, Japan
  • Eiji Taira, Kwansei Gakuin University, Japan
  • Shin'ichi Satoh, National Institute of Informatics, Japan
  • Noriki Nishida, Riken, Japan
  • Yusuke Miyao, The University of Tokyo, Japan
  • Hideto Kazawa, Google, Japan
  • Shogo Okada, Japan Advanced Institute of Science and Technology, Japan
  • Ryosaku Makino, Waseda University, Japan
  • Tomoko Ohsuga, National Institute of Informatics, Japan

Sponsored by

Information on Kumamoto

  • TBA