1. Home
  2. Event List
  3. Summer camp 2011 “Interaction research and human-beings”

Event List

Summer camp 2011 “Interaction research and human-beings”


We will organize a summer camp “Interaction research and human-beings” from September 10th to 13th at Future University Hakodate. The aim of this event is to discuss the results of the grants, NII, Grand Challenge “A proposal for Coherent Data Collection of Ordinary Interactions” (2009-2011) and other collaborative research projects. The event is an open forum so that participants are able to view the data we collected and analyze. Those who are interested can present their analyses on the last day of the camp.

Our plenary speaker is Professor Yasuhiro Katagiri, Future University Hakodate. We also have presentations from other scholars working on the first wave of interaction research. Please see details below.


Location :
10th Hotel Grantia Hakodate Goryokaku ( http://www.hotel-grantia.co.jp/goryokaku/)
11th -13th Future University Hakodate

Plenary lecture

Professor Yasuhiro Katagiri, Future University Hakodate


10th (Sat) Hotel Grantia Hakodate Goryokaku, Restaurant area
15:30- registration
16:00-18:00 Opening ceremony, Data distribution, Description of data analysis
18:00-20:00 Dinner break
20:00-22:30 Session (3 presentations)
11th (Sun) Hakodate Future University
10:00-11:00 Data analysis session
11:00-12:00 Presentation 1 (Yugo Takeuchi, Shizuoka University)
12:00-13:00 Lunch break
13:00-14:00 Data session 1 (Kohei Kikuchi, NII)
14:00-15:00 Data session 2 (Eiji Toyama, Chiba University)
15:30-18:00 Plenary (Yasuhiro Katagiri, Future University Hakodate)
18:00-20:00 Happy hour
12th (Mon) Future University Hakodate
10:00-11:00 Data session 3 (Hiromichi Hosoma, The University of Shiga Prefecture)
11:00-12:00 Data session 4 (Yasuharu Den, Chiba University)
12:00-13:00 Lunch break
13:00-15:00 Presentation 2 (Kanayo Ogura, Japan Advanced Institute of Science and Technology)
14:00-15:00 Presentation 3 (Shogo Okada, Tokyo Institute of Technology)
15:30-18:00 Data analysis session
13th (Tue) Future University Hakodate
10:00-11:00 Grand Challenge 1 (Mika Enomoto, Tokyo University of Technology)
11:00-12:00 Grand Challenge 2 (Katsuya Takanashi, Sakigake/Kyoto University)
12:00-13:00 Lunch Break
13:00-14:00 Grand Challenge 3 (Mayumi Bono, NII)
14:00-15:00 Grand Challenge 4 (Sumi Yasuyuki, Future University Hakodate)
15:00-16:00 Presentations from participants
16:00 Closing

Abstracts for each session

Presentations from a collaborative research on “Interaction research and technology”
Collaborative research, Presentation 1, Yugo Takeuchi Shizuoka University
“The development of appropriate speech addressing strategies in multi-party video chats and the construction of fluent interaction environments”
This research developed a method to enable us to address others through an eye-contact in a multi-party video chatting system just like the way we do in a face-to-face environment. Additionally we analyze the role of spatiality among participants in multi-party interactions. These results not only produce a better environment for mutli-party video interaction, but encourage participants to willingly join the conversation through the system. Our experiments were conducted along with the following three conditions in order to observe and analyze interaction processes: (A)using the proposed system, (B)using a prototypical video-chat system where participants’images do not change by their eye gaze, and (c) having participants interact face-to-face. In the condition (B), participants other than the speaker lack the awareness that he or she is address such that it interferes a fluent turn-taking and response. However in the condition (A), there was no such disturbance and the interactions were close to those observed in (C).
Collaborative research, Presentation 2: Kanayo Ogura, Kazushi Nishimoto, Japan Advanced Institute of Science and Technology)
“The analysis of multi-party interactions for the purpose of eliminating separation and isolation”
In multi-party interaction, it is difficult for all the participants belong to a single interaction so that the group split and multiple small groups emerge (“separation”). Sometimes a separated group contains only one participants (“isolation”). We have been working for eliminating such separation and isolation. In our project supported by Research Collaboration Grant (NII, 2010), we conducted experiments in two types of multi-party interaction settings: a buffet style party and talks inside a car. The goals of these experiments were to obtain a basic understanding of the nature of a multi-party interaction, analyze causes of the problems, and discuss research methods. In the first setting, we proposed and validated an algorism which enables isolated participants by examining participants’ body positions and facial directions. In the second setting, our hypothesis was that different ranges of passengers’ fields of vision cause the separation and multiplexed of cognitive frames and as a result, interactional divisions across the front and the back and the driver’s isolation occur. This hypothesis was proven by analyzing the interactions taken place in a running car.
Collaborative research, Presentation 3: Shogo Okada, Tokyo Institute of Technology
“The analysis of multi-party interactions of cartoon description tasks using sequential pattern mining”
The importance of data-oriented, scientific analysis has been recently discussed. It is necessary to construct a research environment that enables us to record bodily expressions such as body positions, gestures, and eye gaze along with vocal linguistic expressions. This research focuses on the construction of data mining system for analyzing a large scale of non-verbal data. Based on perspectives and hypotheses from conversation analysts, it provides a data mining strategy based on machine learning that automatically annotates non-verbal data. It also provides a method for a sequential pattern mining to chronologically extract non-verbal patterns. Lastly it demonstrates some examples of the use of these methods in three-party conversations in which speakers were asked to describe cartoons they watch.
Grand Challenge “Interaction research and participants’ everyday lives: problems and challenges”
Presentation 1: Mika Enomoto, (Tokyo University of Technology)
“Medical practice of mental health provider and interaction research”
For those patients who suffer from neuropsychological deficits such as schizophrenia, everyday activities such as brushing teeth and taking a bath become obstacles because of their cognitive disorders. It is known that the patients are not aware of their symptoms. Thus the families of patients’ are frustrated and as a result, they compare the patients with those of premorbid states. Doctors prescribe medications to improve the patients’ conditions, but neither the emotional struggles nor the symptoms themselves are completely eliminated. How can interaction research contribute to such circumstances? This research project discusses what we can do to create a better communication environment that transcends the boundaries of confined relationships such as doctor-patient/caregiver-caretaker.
Presentation 2, Katsuya Takanashi, Presto, Sakigake/Kyoto University
“The purpose and challenge of continuous fieldwork in a project meeting”
A group meeting is a type of multi-party interaction and it plays an important role in making decisions, and sharing knowledge and information in various social settings. Research on multi-party interaction typically focuses on a short segment of a conversation. In studying consecutive project meetings, it is important to understand a big picture across each meeting and incorporate the picture into micro analyses. This presentation introduces features of different field sites and their appropriate research methods. Through describing how to build rapport with participants and overcome challenges in data analysis, it discusses the importance of data session with participants.
Presentation 3: Mayumi Bono, NII
“Sign Language Conversation Analysis: its methods and practices. Problems in interaction research with participants”
Research on Sign Language has been typically conducted based on theories established by hearing language studies and their hearing researchers whose mother tough is Japanese. In this process, the role of Deaf whose mother tongue is Japanese Sign Language has been as “Sign Language Model”. This is because many of traditional linguistic studies were conducted by interviewing people. This project aims to establish a research infrastructure on Sign Language conversation analysis incorporating approaches from gesture studies and conversation analysis. This presentation introduces how to organize research projects along with Deaf people who use Japanese Sign Language. Particularly it discusses problems that may arise in the relationship between the observed and the observer.
Presentation 4: Sumi Yasuyuki, (Future University Hakodate)
“The record of multimodal aspects in conversational interactions and its usage”
Conversation plays an important role in conveying knowledge, creating ideas, and sharing the sense of co-presence. Our goal is to establish a social agent and intelligence space that enable us to distribute knowledge distribution and service use. As a first step, we have been developing a system that measures and interpret human multi-party interactions in the hope of creating a grammar and dictionary of non-verbal interactions. This presentation focuses on attempts we made on interaction-mining and multi-party interaction analysis. It also introduces a developed tool that enables us to achieve non-synchronized conversations and mediated-conversations by using a new media technology.
Data session : Multiparty interaction and multimodality
  • Data session 1: Kohei Kikuchi, NII
  • Data session 2: Eiji Toyama, Chiba University
  • Data session 3: Hiromichi Hosoma, The University of Shiga Prefecture
  • Data session 4: Yasuharu Den, Chiba University
Night session
  • Night session 1: Akira Ichikawa, Waseda University
  • Night session2: Yugo Takeuchi, Shizuoka University
  • Night session 3: Hiromichi Hosoma, The University of Shiga Prefecture