Bulk, Jendrik
Loading...
5 results
Now showing 1 - 5 of 5
- Some of the metrics are blocked by yourconsent settings
Item type:Publication, Evaluating a Refined Augmented Reality Eye-Gaze and Voice Control System for Electric Wheelchairs: A User StudySelf-determined mobility is fundamental for social participation, yet conventional electric wheelchair controls present significant usability challenges for individuals with severe motor impairments like tetraplegia or ALS. While alternative specialized controls exist, they may introduce issues such as fatigue or reduced intuitiveness. This paper reports on the user evaluation of a refined assistive control system, previously introduced as work-in-progress, designed to address these limitations. The system employs a combination of eye-gaze tracking and voice commands, mediated through a Magic Leap 2 Augmented Reality (AR) headset, to operate both a wheelchair simulator and a real electric wheelchair via a Raspberry Pi interface. Initial prototypes highlighted the need for enhancements focused on user experience, control stability, and intentionality, particularly for real-world deployment. The evaluated system incorporates several key refinements: (1) A robust activation mechanism requiring sustained gaze within the interface boundaries for a defined duration to enable control, complemented by a configurable grace period upon gaze exit to prevent unintended deactivation during brief glances away. (2) Advanced stability features, including Kalman filtering or iterative Slerp smoothing of gaze rotation data to mitigate input jitter, alongside head rotation handling that detects high angular velocity to trigger a brief, timed recentering of the joystick input upon cessation, preventing uncontrolled continuation of turns. (3) Fine-tuned control mapping, utilizing non-linear response curves, minimal dead zones, sensitivity scaling, and output signal rate limiting to ensure smooth command delivery, provide fine control near the center, and prevent overly sensitive physical responses. (4) Raycast-based interaction logic for axis-snapping guide cubes and focusable object detection, replacing previous methods.The primary objective of this study was to comprehensively evaluate the usability, effectiveness, perceived workload, and user acceptance of this refined control system. The evaluation was conducted with individuals with spinal cord injuries at the BG Klinikum Hamburg. We aimed to assess the system's potential as a viable supplement or alternative to existing specialized wheelchair controls.A two-phase methodology was employed: participants first engaged with the system in a VR wheelchair simulator for familiarization and baseline assessment, followed by operating a real Ottobock Juvo B5 wheelchair using the AR interface in a controlled clinical environment. Tasks included fundamental maneuvers (activation/deactivation, forward/backward driving, turning in place), navigation along a simple marked path, and precision approach tasks. Data collection utilized a mixed-methods approach, combining objective performance metrics (e.g., task time, errors), standardized subjective questionnaires (System Usability Scale - SUS; NASA Task Load Index - NASA-TLX), and qualitative feedback via semi-structured interviews and direct observation, adhering to approved ethical guidelines.This paper presents the detailed findings from these user tests, focusing on the performance differences between VR and AR conditions, the perceived usability and workload associated with the system, the effectiveness of the specific activation and stability refinements, and overall user acceptance. The results provide empirical insights into the practical application of AR-based eye-gaze and voice control for wheelchairs, identifying strengths, limitations, and crucial areas for future development to enhance autonomous mobility for individuals with severe motor impairments.journal articleBand:19724 - Some of the metrics are blocked by yourconsent settings
Item type:Publication, Development of a Training Simulator and Testing Environment for Electric Wheelchair ControlsA training simulator is being designed as part of the interdisciplinary research project “Development of alternative control systems for wheelchairs”. This simulator serves as a platform for testing and evaluating innovative control concepts that are created in an iterative process involving users with electric wheelchairs, medical and technical specialists. The development focuses on integrating the physical properties of a real, electric wheelchair into a simulation. This wheelchair is typically controlled with the hand, chin or tongue joystick and has characteristics such as inertia and acceleration behaviour. The goal is to create a driving experience that is as realistic as possible. These adjustments are continually developed in close cooperation with the groups mentioned. This project aims to clarify how the transfer of the real wheelchair into the virtual simulation affects the learning behaviour, motivation, and satisfaction of patients who complete training with electric wheelchairs.Interviews with occupational therapists at the Center for Paraplegics in Hamburg have revealed an increased need for such a training simulator. Currently, training with electric wheelchairs is limited to real-world environments, which poses certain risks. The home environment is simulated in the clinic with markings on the floor. A safer and more efficient training method would be to use a variable, virtual environment in which patients can be familiarized with the new method of locomotion without risk. For this purpose, realistic training scenarios from everyday clinical practice are integrated into the virtual environment of the training software. A virtual reality headset allows patients to adapt to using the electric wheelchair without risk and at their own pace. In cooperation with a leading manufacturer of electric wheelchairs, the plan is to use the physical hardware of the wheelchair as an interactive input device for the simulator. It will also be possible to configure the specific comfort settings (including backrest, headrest, largest, armrests) within the training simulation. In particular, the adjustability of the backrest is an important element of driving training for mastering slopes and slides.The next phase of research is concerned with the development of an eye-controlled digital joystick for the Magic Leap 2 augmented reality glasses, which will eventually also be implemented in real wheelchairs. The joystick is initially used as a control element for a virtual wheelchair in a simulated test environment. A key development goal is to visualize the wheelchair's user-specific user interface (UI) on the AR display. It is also planned to enable control of the UI via eye control and voice commands to ensure intuitive and barrier-free interaction. Thanks to flexible setting options, the UI can be personalized to the requirements of the respective user.After a comprehensive evaluation of the control by the test subjects and medical staff regarding user-friendliness and safety, the innovative control is integrated into a physical wheelchair. In a further iterative process, the control is continuously optimized in close collaboration with the end users in a protected setting.journal articleBand:159105 - Some of the metrics are blocked by yourconsent settings
Item type:Publication, Verification of an alternative wheelchair control in a virtual environmentThis work presents a training simulator that is being developed in collaboration with electric wheelchair users and medical professionals. The main function of the software is to serve as a development platform for alternative control systems that enable people with paralysis to control a wheelchair themselves. The project developed two prototype control systems using technologies such as eye tracking and a brain-computer interface.journal article52 - Some of the metrics are blocked by yourconsent settings
Item type:Publication, Designing User-Guidance for eXtendend Reality Interfaces in Industrial EnvironmentsModern industrial environments evolve from collections of physical machines into networked extended reality environments, where in addition to the physical machines digital content becomes increasingly significant. Examples of such digital content include not only the necessary information to control the production, but also digital instructions and product information, information derived from embedded sensors or predictive models, as wells as digital twins of products, machines and entire factories. This means that user interface designers in such environments have to design interfaces that allow access to and interaction with both the virtual and physical aspects. The design of user interfaces for such eXtendend Reality (XR) environments faces a number of challenges including the change of the implementation platform from a “standardized” PC GUI to I/O devices and paradigms that are suitable for XR. Examples include mobile and wearable devices as well as virtual and augmented reality. There is still a lack of standards and best-practices regarding the design of XR interfaces, especially when interaction and data visualization techniques are required to support work across different platforms. This chapter focuses on guidance techniques that help users navigate the complex information and interaction tasks in XR environments, as this is an area for which little information is currently available. The chapter explains why different forms of user guidance are required in XR environments, why these pose a challenge for user interface designers, and presents techniques that can be used to aid the design process.journal article177 - Some of the metrics are blocked by yourconsent settings
Item type:Publication, 9
