Welcome to the Depthkit Documentation Portal!

Depthkit is the first volumetric filmmaking tool designed to empower creators of all experience levels to participate in the cutting edge of immersive storytelling.


Verify Computer Performance

Computer Requirements

Depth Sensors

Tutorials

The Depthkit Workflow

The first in a suite of high quality, easy to use volumetric tools, Depthkit is a standalone, capture to export solution for 2.5D volumetric data. Designed for robustness and reliability, this tool provides visibility into your filmmaking process, showing real-time previews so you can be confident and precise with your captures.

Depthkit also provides flexibility in workflow and is designed for professional volumetric capture in a studio as well as capturing on location or out in the field. When it comes to designing a volumetric project with Depthkit, in the single application you can export assets for both the game engine as well as for VFX pipelines so you are free to explore what best suits your creative needs without capturing new footage.

What Do I Need?

To get started, you need a Windows PC and a depth sensor. Learn more about our recommended Computer Requirements. Please note that Depthkit does not yet run on Mac OS X. However, you can install Windows on your Mac using the Bootcamp Utility.

Support Depth Sensors

Don't have a depth sensor yet? No worries. Download and experiment with Depthkit demo data from your account downloads page.

Audio

🚧

Audio

Depthkit does not record audio at this time. You will need to capture audio with an external device and lay it back into the clip after exporting from Depthkit. For ease of syncing, remember to clap or have a slate at the beginning of your take so there is no doubt about the sync point between your Depthkit export and your audio file.

Where Can I Capture?

Depthkit supports workflows for both on location capture with portable rigs, as well as in studio production. You are not limited to a capture stage or green screen to segment characters from the background thanks to Depthkit's support of body indexbody index - The detection of one or multiple bodies in the depth data. When generating your assets, this acts as a body mask, allowing you to simply hide the background for clean exports of your subjects. This eliminates the need to shoot on a green screen. segmentation on the Kinect for Windows v2. This feature can detect of one or multiple bodies in the depth data and remove the background. This acts as a mask, allowing you to simply hide the background for clean exports of your subjects with the Automatic Background removal.

Note that the automatic Kinect mask will not produce results that are as high quality as the Refinement Workflow. Read details and known issues when using the automatic Kinect mask.

📘

Body Index Segmentation is Sensor Based

Currently only the Kinect for Windows v2 supports Automatic Background removal. Support for this feature for the Azure Kinect is in development.

Workflow Options & Overview

Depthkit Record Workflow

Depthkit Record is designed with portability and getting up and running with volumetric capture quickly. When you are capturing on location, you don't always have a green screen handy. Depthkit is ready for this with the help of body indexbody index - The detection of one or multiple bodies in the depth data. When generating your assets, this acts as a body mask, allowing you to simply hide the background for clean exports of your subjects. This eliminates the need to shoot on a green screen. segmentation, or the automatic Kinect mask. Note that this feature is currently only available with the Kinect for Windows v2. This will allow you to record data in a range of situations and remove the background when ready to export. Background removal is non-destructive and acts as an export setting only.

Depthkit Record

Depthkit Pro & the Refinement Workflow

📘

The Refinement Workflow Requires Depthkit Pro

Subscribe or upgrade to Depthkit Pro to increase the quality of your Depthkit assets.

If you are shooting on a green screen, we highly recommend capturing with Depthkit Pro for use of Depthkit's Refinement Algorithm. This consists of a robust algorithm that refines depth data, allowing for:

  • Export resolutions that match your color video, ensuring the highest export resolution possible.
  • Cleaner edges for your 2.5D assets.
  • Reduction of depth noise, an artifact commonly seen in most depth sensors.
  • Removal of depth artifacts.
  • Recovery of lost depth information, often caused by materials, lighting, and other capture conditions.

The Depthkit Pro Refinement workflow is designed for footage shot with a green screen, as it requires applying a refinement mask created by pulling a key from the color video. This acts as an input to tell Depthkit what area to apply the algorithm to.

If you have not captured on a green screen, you can also use tools like After Effect's Roto brush, to create a mask without pulling a key.

Refinement Mask

Depthkit Cinema Workflow

With Depthkit Cinema, you can supplement the lush cinematic quality of your video camera with accessible depth sensing to create vivid, high resolution 2.5D volumetric captures up to 8K. Depthkit Cinema is a tool that supports the pairing the industry’s highest quality depth and video cameras for cinematic results out of your volumetric footage. This product is all about augmenting your existing video workflow with depth data, for maximum flexibility over your 2.5D capture, putting the power of high quality volumetric video at your fingertips.

Explore our Depthkit Cinema guide.

Updated 3 months ago

The Depthkit Workflow


Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.