Welcome to the Depthkit Documentation Portal!

Depthkit is the first volumetric filmmaking tool designed to empower creators of all experience levels to participate in the cutting edge of immersive storytelling.


Verify Computer Performance

Computer Requirements

Depth Sensors

Tutorials

Cameras & Equipment

Depthkit Cinema supports a wide range of cameras and depth sensor combinations, however there are several aspects to keep in mind when selecting your camera and sensor combination. See below for all of your equipment needs, including recommendations and best practices for selecting your camera and sensor combination.

To complete the Depthkit Cinema workflow, you will need:

  • Depth Sensor
  • Video Camera and a lens if one isn’t built in
  • Camera grip equipment to rig your sensor to your camera
  • Depthkit calibration chart
  • Adobe calibration chart, included with the Lens Profile Creator
  • Tripod
  • Stand or similar for placing the calibration chart.
  • Green Screen
  • Lighting
  • Audio recorder (optional)

Supported Depth Sensors

Recommended Cameras

In theory, you can pair any video camera when capturing with Depthkit Cinema. However we do suggest a few things to keep in mind.

Resolution
Select a camera that offers high resolution. The beauty of Depthkit Cinema is the control over output resolution. This means, if you shoot in 8k on something like a RED EPIC-W Helium, your Depthkit export can maintain that original resolution when using the Refinement Workflow. The higher resolution your video camera is, the more detailed the color information of your recording will be. Our team has been successful with cameras like the Blackmagic Pocket Cinema 6K or the Sony a7R III.

🚧

Depthkit supports 8k with H.265

When importing 8k videos into Depthkit, you will need to re-encode the files to H.265. Download the HEVC codec here. Ensure your hardware supports the playback of H.265 prior to recording in 8k for Depthkit.

High Dynamic Range
A camera with high dynamic range and low recording compression will give you more flexibility to color correct and grade your recordings. Cameras which record raw and intraframe compression codecs like ProRes are better to work with than cameras that are limited to interframe compression like h.264.

Frame rate
If you can, select a camera with a frame rate that matches your sensor, 30.0 frames per second in the case of the Azure Kinect. Many video cameras cannot record at 30.0, and although a frame rate of 29.97 works well for most projects, it may lead to drift and dropped frames for longer takes.

Selecting your Lens
Shoot with a wide angle lens with a full frame camera to match the FOV of your sensor. Check out depth sensor details to see what fov is available to you. The field of view of the depth sensor as well as that of your camera and lens combination are critical to the quality of your Depthkit capture. You can have the highest resolution camera in the world, but if its field of view is much different than your depth sensor, you will not be utilizing all of the recorded data. It is important to know the specifications that factor into the field of view, like focal length, size of the camera sensor, the amount of sensor crop at the resolution you will be filming.

Select a high-quality, rectilinear lens. Lenses with distortion characteristics can be difficult when generating your lens correction profilelens correction profile - A profile that solves for the lens distortion of a given camera and lens combination., so it is best to start with a low distortion characteristics. This can be tricky when matching the sensor’s wide field of view, as wider lenses tend to have higher distortion characteristics.

Supported Codecs

Depthkit currently supports video formats that are natively supported by Microsoft Media Foundation. Your camera may be set up to shoot in codec that is not supported by Microsoft Media Foundation. Don't worry! You can simply re-encode your footage using tools like FFmpeg or Adobe Media Encoder for quick and easy re-encoding for Depthkit Cinema.

Codec

Container

H.264

.mp4, .mov

Supported

H.265

.mp4, .mov

Required for 8k. Download the HEVC Video Extension

Grip Equipment

There are endless combinations of hardware out there to fit different camera and lens combinations. However you rig it, make sure that the position and orientation of the sensor is solidly fixed relative to the camera. See our rigging guide for one example of how we securely rig the Azure Kinect to a Sony a7R III.

Calibration Charts

All high quality workflows come with gear to ensure precision. With Depthkit Cinema, this is the calibration chartcalibration chart - A chessboard pattern used to calibrate multiple devices, either for a camera/lens combination or a camera/depth sensor combination., a chessboard pattern that is used in two stages to pair the camera with the depth sensor. The tricky bit is that these two stages use different versions of the calibration chartcalibration chart - A chessboard pattern used to calibrate multiple devices, either for a camera/lens combination or a camera/depth sensor combination..

📘

Two calibration charts required

You will need different calibration charts for different steps in the workflow.

Adobe Lens Calibration Chart
If using the Adobe Lens Profile Creator, the supported charts come with the free download of the Adobe utility. If you aren't sure which chart you have on hand, make sure your Lens Profile calibration chartcalibration chart - A chessboard pattern used to calibrate multiple devices, either for a camera/lens combination or a camera/depth sensor combination. has a black square at each corner as seen below.

Once downloaded, you will find your chart in the utility folder, in the calibration charts folder. There will be plenty of options to choose from. More on creating a Lens Correction Profile in a bit.

Calibration Chart for Lens Correction Profiles

Camera Pairing Calibration Chart

Download the Camera Pairing calibration chart here.

For best results, make sure you print your calibration chartcalibration chart - A chessboard pattern used to calibrate multiple devices, either for a camera/lens combination or a camera/depth sensor combination. on matte paper. Standard 9x11 printing paper works perfectly. There is no need to go out and print a giant chart on special paper.

The key in a good calibration chartcalibration chart - A chessboard pattern used to calibrate multiple devices, either for a camera/lens combination or a camera/depth sensor combination. is to keep it flat and wrinkle free. Apply the print out to foam core board or cardboard to keep the chart in good shape.

Calibration Chart for Camera Pairing

Updated about a month ago


Cameras & Equipment


Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.