Joystick

Pure mathematics

Exploit

Implementation

Computer security

Operating system

Computer science

Virtual reality

Computer-mediated reality

Simulation

Mathematics

Mixed reality

Immersion (mathematics)

Programming language

VRML

Software deployment

Human–computer interaction

Virtual actor

IEEE Transactions on Dependable and Secure Computing

This is one of the first accounts for the security analysis of consumer immersive Virtual Reality (VR) systems. This work breaks new ground, coins new terms, and constructs proof of concept implementations of attacks related to immersive VR. Our work used the two most widely adopted immersive VR systems, the HTC Vive, and the Oculus Rift. More specifically, we were able to create attacks that can potentially disorient users, turn their Head Mounted Display (HMD) camera on without their knowledge, overlay images in their field of vision, and modify VR environmental factors that force them into hitting physical objects and walls. Finally, we illustrate through a human participant deception study the success of being able to exploit VR systems to control immersed users and move them to a location in physical space without their knowledge. We term this the Human Joystick Attack. We conclude our work with future research directions and ways to enhance the security of these systems.

Immersive Virtual Reality Attacks and the Human Joystick