$ cd ~/projects Smartphone-Assisted VR Bachelor's Thesis — Technical University of Munich ──────────────────────────────────────────────────── My bachelor's thesis about using a smartphone to interact with VR applications. tags: Research, Game Development, Virtual Reality, JavaScript, Web Development ──────────────────────────────────────────────────── ## abstract Virtual Reality is an emerging medium that enables presence and interactivity in a three-dimensional space. Conventional input devices like a mouse or a keyboard are made for two-dimensional environments. They require complex movements to complete tasks in a three-dimensional environment. Most people own a smartphone that they use on a daily basis. Such phones have a variety of different sensors already built-in, feature wireless capabilities, and are able to run custom software. This makes them affordable general-purpose devices. A virtual representation of the phone can be displayed in a Virtual Environment using the orientational sensors. Therefore they are suitable to use as interaction devices for Virtual Reality. In this thesis, three interaction examples are presented to verify that a smartphone can be used as an input device for Virtual Reality. A model viewing application, a pointing tool, and a virtual keyboard were implemented and evaluated. The networking framework Ubi-Interact is used to make the proposed experiments reusable and abstracted from device-specific environments. ──────────────────────────────────────────────────── ## conclusion To show that the smartphone is a valuable device for interacting with Virtual Reality, typical input methods used in Virtual Reality were explored and evaluated. A study showed that all three experiments, the model viewer, the laser pointer, and the virtual keyboard experiment, were quite useable. The laser pointer is used to select elements in a scene or for similar pointing tasks. This experiment scored the highest amongst the ones presented in this thesis. The virtual keyboard experiment solves the problem of typing text while being immersed in a Virtual Environment. ──────────────────────────────────────────────────── ## Thesis source and evaluation data The thesis evaluates three smartphone interaction examples, a model viewer, a laser pointer, and a virtual keyboard. The public thesis repository contains the LaTeX source, study results, experiment recordings, and the survey export, so readers can inspect the evaluation alongside the paper. The work was submitted in September 2019. Its implementation uses Ubi-Interact to connect devices and keep interaction logic separate from device-specific input. Smartphone-Assisted VR thesis on GitHub https://github.com/michidk/bachelors-thesis ──────────────────────────────────────────────────── ## Ubi-Interact Ubi-Interact is the networking framework used by the experiments. It connects clients through a central server and exchanges device data through topics. This lets the smartphone provide input while interaction logic and the virtual environment run on other devices. The framework has its own project repository and documentation, separate from the thesis source. Ubi-Interact documentation https://github.com/SandroWeber/ubi-interact/wiki Ubi-Interact on GitHub https://github.com/SandroWeber/ubi-interact ──────────────────────────────────────────────────── $ ls ./links paper.pdf /files/projects/savr/paper.pdf slides.pdf /files/projects/savr/slides.pdf uni wiki https://wiki.tum.de/display/infar/%5B19SS+-+BA%5D+Smartphone-Assisted+Virtual+Reality+Using+Ubi-Interact github https://github.com/michidk/bachelors-thesis ──────────────────────────────────────────────────── $ ls ~/pages > about curl -L lohr.dev > projects curl -L lohr.dev/projects > blog curl -L lohr.dev/blog > stats curl -L lohr.dev/stats > contact curl -L lohr.dev/contact ──────────────────────────────────────────────────── https://lohr.dev