Gestures play an important role in daily communication. However, it is not easy to identify the "meaning" of gestures. To address this issue, we are constructing a "multimodal semiotics" based on the method of "multimodal sequential analysis". We aim to develop a "next-generation corpus of gesture" and share it with academic communities.