The over­all aim of this work was to build a stereo cam­era rig to sup­port immer­sive video see-trough aug­ment­ed real­i­ty (AR) for the Ocu­lus Rift. An immer­sive expe­ri­ence implies that the video frame cap­tured by the cam­eras must match both the extents and dis­tri­b­u­tion of the Rift’s field of view (FOV) so that vir­tu­al and video spaces are per­cep­tu­al­ly aligned, and that this full frame should be aug­mentable. The vision of the project is to sup­port an immer­sive AR expe­ri­ence where the lines between what is real and what is vir­tu­al are blurred.

The arti­cles are split as follows:

• AR-Rift Intro­duc­tion (Part 1): the first in a series of sev­en arti­cles detail­ing the process of design­ing and build­ing a stereo cam­era rig for the Ocu­lus Rift.
• Cam­era Selec­tion (Part 2): Cam­era require­ments for a stereo rig for head-mount­ed video see-through AR for the Ocu­lus Rift. Mod­i­fied Log­itech C310 cam­eras selected.
• Build­ing the Stereo Cam­era (Part 3): Build­ing and mount­ing the cam­eras. A dis­cus­sion of stereo con­ver­gence methods.
• Wire­less Rift & 6DoF Track­ing (Part 4): Details of a wire­less solu­tion for the Rift and 6DoF track­ing for head and body.
• Align­ing Track­ing & Video Spaces (Part 5): Align­ing the track­ing coor­di­nate sys­tem & cam­era images. Ver­i­fy­ing and map­ping cam­era FOV. Match­ing phys­i­cal and vir­tu­al cam­era FOV dis­tri­b­u­tions. Real-time cam­era undis­tor­tion on the GPU.
• 3DUI for Immer­sive AR (Part 6): Design of a biman­u­al 3D user inter­face (3DUI) for immer­sive head-mount­ed AR.
• AR Show­case (Part 7): Real­i­sa­tion of the system.