Misleading effect and spatial learning in head-mounted mixed reality-based navigation

Abstract

Mixed reality technology has been increasingly used for navigation. While most MR-based navigation systems are currently based on hand-held devices, for example, smartphones, head-mounted MR devices have become more and more popular in navigation. Much research has been conducted to investigate the navigation experience in MR. However, it is still unclear how ordinary users react to the first-person view and FOV (field of view)-limited navigation experience, especially in terms of spatial learning. In our study, we investigate how visualization in MR navigation affects spatial learning. More specifically, we test two related hypotheses: incorrect virtual information can lead users into incorrect spatial learning, and the visualization style of direction can influence users’ spatial learning and experience. We designed a user interface in Microsoft HoloLens 2 and conducted a user study with 40 participants. The user study consists of a walking session in which users wear Microsoft HoloLens 2 to navigate to an unknown destination, pre- and post-walking questionnaires, sketch map drawing, and a semi-structured interview about the user interface design. The results provide preliminary confirmation that users’ spatial learning can be misled by incorrect information, even in a small study area, but this misleading effect can be compensated by considerate visualization, for example, including lines instead of using only arrows as direction indicators. Arrows with or without lines as two visualization alternatives also influenced the user’s spatial learning and evaluation of the designed elements. Besides, the study shows that users’ preferences for navigation interfaces are diverse, and an adaptable interface should be provided. The results contribute to the design of head-mounted MR-based navigation interfaces and the application of MR in navigation in general.