Human–computer interaction

Image (mathematics)

Compositing

Variety (cybernetics)

Macroeconomics

Augmented reality

Artificial intelligence

Psychology

Economics

Video production

Software construction

Virtual reality

Programming language

Software

Production (economics)

Popularity

Computer science

Software walkthrough

Multimedia

Movie theater

Art history

Software development

Filmmaking

Social psychology

There is increased interest in using virtual reality in education, but it often remains an isolated experience that is difficult to integrate into current instructional experiences. In this work, we adapt virtual production techniques from filmmaking to enable mixed reality capture of instructors so that they appear to be standing directly in the virtual scene. We also capitalize on the growing popularity of live streaming software for video conferencing and live production. With XRStudio, we develop a pipeline for giving lectures in VR, enabling live compositing using a variety of presets and real-time output to traditional video and more immersive formats. We present interviews with media designers experienced in film and MOOC production that informed our design. Through walkthrough demonstrations of XRStudio with instructors experienced with VR, we learn how it could be used in a variety of domains. In end-to-end evaluations with students, we analyze and compare differences of traditional video vs. more immersive lectures with XRStudio.

XRStudio: A Virtual Production and Live Streaming System for Immersive Instructional Experiences