Volumetric Capture

Filming in 3D: Beyond the Flat Screen

Volumetric capture, also known as volumetric video, is a cutting-edge technology designed to record a subject not as a flat, two-dimensional image, but as a fully three-dimensional, moving hologram. Instead of a single camera, the process utilizes a specialized studio, often called a ‘capture stage,’ which is equipped with dozens, sometimes hundreds, of high-resolution cameras arranged to surround the subject from every possible angle.

The Capture and Creation Process

The process works by having all cameras record the subject simultaneously. This massive amount of video data is then fed into powerful computers that use complex algorithms to triangulate points in space and reconstruct the subject’s shape, texture, and motion frame by frame. The end result is not a traditional video file, but a sequence of 3D models, or a point cloud, that can be viewed from any perspective within a virtual environment. This allows a viewer to, for example, walk around a virtual performance of an actor as if they were physically in the room with them.

Applications in Film and Immersive Media

Volumetric capture is a game-changer for creating realistic digital humans and immersive content. Its key applications include:

• Digital Doubles: Creating hyper-realistic digital versions of actors for use in visual effects sequences in films and video games. This is an evolution of traditional motion capture, as it records the actor’s full appearance, not just their skeletal movement.
• Virtual and Augmented Reality (VR/AR): Providing content for immersive experiences. A user could interact with a volumetrically captured historical figure in a VR museum exhibit or see a hologram of their favorite athlete in their living room via an AR app.
• Live Performance: Broadcasting live events, like concerts or sports, as holographic experiences, allowing viewers to choose their own point of view.

While still a complex and expensive technology, volumetric capture is poised to become a foundational tool for the future of entertainment and communication in the metaverse.