PsyErgo und HCI auf der ICMI '19

Seit über 20 Jahren findet die ICMI, die ACM International Conference on Multimodal Interaction, mittlerweile statt.  Sie gilt als internationales Forum für multimodale Interaktion, bei dem sich Wissenschaftler aus den unterschiedlichsten Disziplinen rund um das gemeinsame Thema der multimodalen Interaktion treffen und austauschen. In diesem Jahr fand die Konferenz in Suzhou, China statt.  Damit kehrte die ICMI in das Land ihrer Anfänge zurück. Sara Klüber und Erik Wolf (HCI) präsentierten das Paper „Paint that object yellow: Multimodal Interaction to Enhance Creativity During Design Tasks in VR“, welches unimodale und multimodale Interaktionsformen für die Anwendung in Designapplikationen in VR vergleicht. Die Arbeit wurde mit einem Best Paper Runner-Up ausgezeichnet.

Abstract:

Virtual Reality (VR) has always been considered a promising medium to support designers with alternative work environ- ments. Still, graphical user interfaces are prone to induce attention shifts between the user interface and the manipu- lated target objects which hampers the creative process. This work proposes a speech-and-gesture-based interaction para- digm for creative tasks in VR. We developed a multimodal toolbox (MTB) for VR-based design applications and com- pared it to a typical unimodal menu-based toolbox (UTB). The comparison uses a design-oriented use-case and mea- sures flow, usability, and presence as relevant characteristics for a VR-based design process. The multimodal approach (1) led to a lower perceived task duration and a higher reported feeling of flow. It (2) provided a higher intuitive use and a lower mental workload while not being slower than an UTB. Finally, it (3) generated a higher feeling of presence. Overall, our results confirm significant advantages of the proposed multimodal interaction paradigm and the developed MTB for important characteristics of design processes in VR.

Publikation:
Best Paper Runner-Up
Erik Wolf, Sara Klüber, Chris Zimmerer, Jean-Luc Lugrin, and Marc Erich Latoschik. 2019. ”Paint that object yellow”: Multimodal Interaction to Enhance Creativity During Design Tasks in VR. In 2019 International Conference on Multimodal Interaction (ICMI '19). ACM, New York, NY, USA, 195-204. DOI: https://doi.org/10.1145/3340555.3353724