J. Feitsch, J. Lückhoff, C. Triebus, K. Nicolai, C. Geiger
Immersive design in educational user interfaces (UIs) uses advanced technologies such as virtual reality (VR), augmented reality (AR) and mixed reality (MR) to create engaging and effective learning environments. This approach aims to improve the educational experience by making it more interactive, intuitive and tailored to individual learning needs. Immersive UIs transform traditional learning by providing an interactive 3D / AR / VR environment where learners can dynamically engage with content. This active participation leads to better retention and understanding of the material.
As there are currently few standards in the field of VR user interfaces, the design of intuitive user experiences often has to be based on trial and error. In this article, we use two research projects to show how we design and develop innovative XR experiences that are novel, useful and sustainable by combining a user-centred design process with iterative prototyping. We describe the evaluation and development of several music interfaces for music education and the exploration of musical expression.
First, we selected a number of relevant VR applications for musical expression and had them evaluated by usability experts using a structured questionnaire. Based on the results, we then designed our own applications and realised them as testable prototypes.
The development of an immersive music interface for teaching rhythm to students aims to support music education through the use of modern technologies such as virtual reality. This interface is designed to help students develop a deep understanding and strong connection to rhythmic concepts by creating an interactive and engaging learning environment. In the second project, we built an immersive puzzle-based musical exploration using particle streams as a musical flow that must connect virtual and real objects to create a harmonic expression.
By using VR and AR, students can immerse themselves in a three-dimensional world where they experience rhythms visually and aurally. This immersive experience encourages active learning and improves understanding of complex rhythmic structures. The playful, video game-like design of the interface increases student motivation. They can navigate through different scenarios, solve problems and receive immediate feedback, making learning exciting and fun.
The interface can be customised to meet students' individual learning needs. Different levels of difficulty and personalised exercises optimise learning progress and cater for students' specific abilities and interests. The combination of visual, auditory and kinaesthetic elements enables multi-sensory learning. Students can not only hear rhythms, but also see them and imitate them through movement, which improves comprehension and memory.
Keywords: XR design, user experience, musical interfaces, virtual reality, augmented reality.