Post
Recording real people as full 3D holograms that can be viewed from any angle, bringing live performance into game engines.
Volumetric capture records a subject from multiple cameras simultaneously, creating a full 3D representation that can be viewed from any angle in real-time. Unlike traditional motion capture (which records skeletal movement and maps it to a 3D model), volumetric capture records the actual appearance of the subject: clothing, skin, hair, and micro-expressions. Microsoft's Mixed Reality Capture Studios and similar facilities use 100+ synchronized cameras to capture performances at 30-60fps. The resulting data is massive (gigabytes per second) and requires sophisticated compression and streaming technology to be usable in real-time applications. The technology bridges the gap between live-action video and fully digital characters.
Example
Microsoft Flight Simulator uses volumetric capture to create photorealistic NPC characters in airport terminals. The Matrix Awakens demo on Unreal Engine 5 used volumetric-captured digital humans that were nearly indistinguishable from real footage. Some VR experiences use volumetric capture to place real actors in virtual environments, creating an effect that's more convincing than any hand-animated character because the subtle imperfections of real human movement are preserved.
Why it matters
Volumetric capture represents the convergence of live-action and digital entertainment. As the technology becomes cheaper and the data more compressible, it could change how game characters are created: instead of modeling and animating characters by hand, developers could simply record actors and drop photorealistic performances directly into game engines.
Related concepts