Free-viewpoint video is filmed content that supports viewing with six degrees of freedom (6DoF). While people often use the more generic term “volumetric video” to identify free-viewpoint video, this can be confusing as there are a number of technologies that fall under this category (e.g. light field capture). In free-viewpoint video, a real-world performance is captured in a green-screen studio using an array of cameras. While arbitrary shapes can be captured, in practice this performance is usually a human character. The surface shape and appearance of the performance are then 3D reconstructed to create a video-textured, animated mesh. This mesh can then be viewed in AR and VR devices.
Investigating the Strengths and Limitations of Free-Viewpoint Video: Example scene
As part of our investigations into the user experience of free-viewpoint video, we conducted a qualitative study with experts in AR/VR content creation. We have made an example scene available to help readers assess how the type of content under discussion in this article compares against others. The demo scene can be downloaded here.