Xiang Li

China 

Bend It, Aim It, Tap It: Designing On-Body Interactions in Mixed Reality

Abstract

Virtual Reality (VR) lets people explore and interact with 3D digital worlds—but choosing the right object in these spaces can be surprisingly difficult. Imagine trying to press a button, but it is half-hidden behind something else, or surrounded by many similar buttons. This is a common challenge in VR, and it is made worse when using only a straight laser pointer to select things.

My project explores a new way to improve accuracy and ease of selection in these crowded VR environments. Instead of just pointing in a straight line, we let users “bend” their virtual pointing path like a curve, shaped more like how a real finger moves. This helps them reach around other objects. But we did not stop there. To make things even more precise and natural, we also display nearby targets on the user’s own virtual forearm. Users can simply tap their arm to select, which also gives them a physical, self-generated touch just like feeling a real button. Our experiments showed that this method makes it easier and faster for people to choose the correct target in VR. It also makes the experience feel more natural and comfortable. This project shows how we can turn the human body into a smart and helpful interface for the digital world—making future VR more efficient and user-centric.

Abstract
Poster
Report