Author(s)

Rui Ye

Corresponding Author

Rui Ye

Abstract

This article gives an emphasis on the interactivity of multimodal environment design in immersive experience. Multi-modal environment creation is a critical area as it can greatly advance user interaction experience in the age of digital technology. The goal of this work is to investigate how to create a good interaction mechanism in order to increase the level of immersion experienced by users within a multimodal environment. By making full use of the theoretical analysis methods, this article deeply studies the theory foundation of multimodal environment design and immersion experience, and explores the immersions influence of many factors in interaction mechanism on immersive experience like different interaction modes, user behavior need as well as environmental factor. Based on this, this article provides the principles to build interaction mechanism: naturality, consistency, adaptability and introduces how they are realized in detail in design level such as modal fusion, feedback mechanism and situational awareness. Reflection on the principles and strategies from a comprehensive perspective will promote the improvement of interaction quality in multimodal environment design, so that the interaction mechanism is more persevered to user requirements and thus truly provides users with immersive experience.

Keywords

Multi-modal environment design; Immersion experience; Interaction mechanism; Design principles; Design strategy