Welcome to the Depthkit Documentation Portal!

Depthkit is the first volumetric filmmaking tool designed to empower creators of all experience levels to participate in the cutting edge of immersive storytelling.


Verify Computer Performance

Computer Requirements

Depth Sensors

Tutorials

The Depthkit Workflow

The first in a suite of high quality, easy to use volumetric tools, Depthkit is a standalone, capture to export solution for 2.5D volumetric data. Designed for robustness and reliability, this tool provides visibility into your filmmaking process, showing real-time previews so you can be confident and precise with your captures.

Depthkit also provides flexibility in workflow and is designed for professional volumetric capture in a studio as well as capturing on location or out in the field. When it comes to designing a volumetric project with Depthkit, in the single application you can export assets for both the game engine as well as for VFX pipelines so you are free to explore what best suits your creative needs without capturing new footage.

What Do I Need?

To get started, you need a Windows PC and a depth sensor. Learn more about our recommended Computer Requirements. Please note that Depthkit does not yet run on Mac OS X. However, you can install Windows on your Mac using the Bootcamp Utility.

Support Depth Sensors

Don't have a depth sensor yet? No worries. Download and experiment with Depthkit demo data from your account downloads page.

Audio

Audio

Depthkit does not record audio at this time. You will need to capture audio with an external device and lay it back into the clip after exporting from Depthkit. For ease of syncing, remember to clap or have a slate at the beginning of your take so there is no doubt about the sync point between your Depthkit export and your audio file.

Where Can I Capture?

Depthkit supports workflows for both on location capture with portable rigs, as well as in studio production. You are not limited to a capture stage or green screen to segment characters from the background thanks to Depthkit's support of body index - body index - The detection of one or multiple bodies in the depth data. When generating your assets, this acts as a body mask, allowing you to simply hide the background for clean exports of your subjects. This eliminates the need to shoot on a green screen. segmentation on the Kinect for Windows v2. This feature can detect of one or multiple bodies in the depth data and remove the background. This acts as a mask, allowing you to simply hide the background for clean exports of your subjects with the Automatic Background removal.

Note that the automatic Kinect mask will not produce results that are as high quality as the Refinement Workflow. Read details and known issues when using the automatic Kinect mask.

Body Index Segmentation is Sensor Based

Currently only the Kinect for Windows v2 supports Automatic Background removal. Support for this feature for the Azure Kinect is in development.

Workflow Options & Overview

Depthkit Record Workflow

Depthkit Record is designed with portability and getting up and running with volumetric capture quickly. When you are capturing on location, you don't always have a green screen handy. Depthkit is ready for this with the help of body index - body index - The detection of one or multiple bodies in the depth data. When generating your assets, this acts as a body mask, allowing you to simply hide the background for clean exports of your subjects. This eliminates the need to shoot on a green screen. segmentation, or the automatic Kinect mask. Note that this feature is currently only available with the Kinect for Windows v2. This will allow you to record data in a range of situations and remove the background when ready to export. Background removal is non-destructive and acts as an export setting only.

Depthkit Record

Depthkit Record

Depthkit Pro & the Refinement Workflow

The Refinement Workflow Requires Depthkit Pro

Subscribe or upgrade to Depthkit Pro to increase the quality of your Depthkit assets.

If you are shooting on a green screen, we highly recommend capturing with Depthkit Pro for use of Depthkit's Refinement Algorithm. This consists of a robust algorithm that refines depth data, allowing for:

  • Export resolutions that match your color video, ensuring the highest export resolution possible.
  • Cleaner edges for your 2.5D assets.
  • Reduction of depth noise, an artifact commonly seen in most depth sensors.
  • Removal of depth artifacts.
  • Recovery of lost depth information, often caused by materials, lighting, and other capture conditions.

The Depthkit Pro Refinement workflow is designed for footage shot with a green screen, as it requires applying a refinement mask created by pulling a key from the color video. This acts as an input to tell Depthkit what area to apply the algorithm to.

If you have not captured on a green screen, you can also use tools like After Effect's Roto brush, to create a mask without pulling a key.

Refinement Mask

Refinement Mask

Sensor Capture & Cinema Capture

Sensor Capture offers a plug and capture solution for Depthkit. Get up and running quickly and easily with one of our supported depth sensors while capturing out in the field or in the studio.

Cinema Capture is an Early Access feature that provides a new level of quality in volumetric capture by allowing you to augment the Depthkit workflow with a traditional video camera. This feature is experimental and ideal when used with the Refinement Workflow.

Cinema Capture is an Early Access Feature

Cinema Capture is a feature that is actively in development and requires Depthkit's Early Access program to activate. Early Access it recommended for user testing and prototyping. We strongly recommend thorough testing before taking it into production.

Sign up for Early Access to explore Depthkit's Cinema Capture.

The Depthkit Workflow


Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.