Interaction in Virtual Worlds

In Chap. 1, VR and AR have already been introduced as innovative forms of human–computer interaction. This chapter deals in detail with the design and realization of interaction and the resulting user interface of a VR/AR system. A user interacts with a virtual world to select (selection) and change (manipulation) virtual objects and to control the position and viewing direction in the virtual environment (navigation). In addition, the user interacts with the system itself (system control) to perform functions outside the virtual environment on a meta-level (e.g., loading a new virtual world). These basic tasks of system control, selection, manipulation and navigation are each dealt with in a subsection. Solutions for the realization of corresponding interactions are presented. It is essential to achieve good usability. This is a core issue of human–computer interaction in general. Therefore, the basics of human–computer interaction are discussed at the beginning of the chapter. Moreover, a subsection considers special design processes that guide a developer in the design and realization of VR/AR interactions. An essential aspect here is the repeated validation of interactions with users in the form of user tests. Methods for the execution and evaluation of user tests are therefore dealt with separately in a subsection. Interactions with VR/AR systems always have effects on the user. The related ethical and legal aspects are discussed in the last subsection.