Augmented Reality in a Virtual Reality Setup

Augmented Reality in a Virtual Reality Setup: Video transfer and processing

Versluis, N.J.
Lau, C.

Eisemann, E. (mentor)

Electrical Engineering, Mathematics and Computer Science

Intelligent Systems

Electrical Engineering

2016-07-11

This thesis covers part of the development of the project "Augmented Reality in a Virtual Reality Setup". The covered part is about the communication between a Personal Computer (PC), and an FPGA (Field-Programmable Gate Array) and vice-versa. This communication is crucial for transfer of a camera stream from the FPGA to the PC and applying video processing there, and for getting the processed stream back to the FPGA in the correct format. What was achieved is the following datastream: The camera stream from the FPGA is sent to the computer using USB, at an average 14 frames per second in full colour. From there, the augmented reality overlay from the PC is created by rendering a frame and then replacing "transparent" pixels, pixels that should be replaced by the camera image, by pure green (RGB 0,255,0), which is a format the FPGA expects. The resulting video output can be sent back to the FPGA via HDMI, where further processing takes place. For the data transfer USB 2.0 is used, which is not ideal for the transfer, but is workable within the scope of the project our system is used in. For future projects, USB 3.0 or 3.1 is preferable.

augmented reality
AR
virtual reality
VR
FPGA
USB
DPTI

http://resolver.tudelft.nl/uuid:6525d43c-60c3-4600-9275-3ce589e9dffa

Student theses

bachelor thesis

(c) 2016 The Authors