Welcome to the Depthkit Documentation Portal!

Depthkit is the first volumetric filmmaking tool designed to empower creators of all experience levels to participate in the cutting edge of immersive storytelling.


Verify Computer Performance

Computer Requirements

Depth Sensors

Tutorials

Creating a Refinement Mask

Depthkit Pro

Let's say you shot on a green screen. This will allow you to isolate your subject with a refinement mask, allowing you to use Depthkit's enhancement algorithm to export enhanced Depthkit footage. The enhancement algorithm enables:

  • Higher export resolutions
  • Cleaner edges
  • Reduction of depth noise
  • Removal of depth artifacts

What is the Refinement Mask?

The refinement mask is a black and white matte that is created by pulling a key in a traditional video editing tool like After Effects or Premiere. Essentially, the mask is made by pulling a key on your source color footage and creating a white matte for the area that you want to enhance.

Source color video (left), Custom refinement mask (right)

The refinement mask should be a high contrast mask, meaning it should be 100% black and 100% white. Any grey areas that are included in the mask will be visible in Depthkit in your enhancement export, so you want to contrast between black and white to be as clean as possible. This also applies to edge feathering which would commonly be used in pulling a key, but is not recommended for a refinement mask.

Creating a Refinement Mask in After Effects with Keylight

Once you have made a comp with your imported video file, select the clip and draw a garbage mask around the subject.

Select your clip again and then go to Effect -> Keying -> Keylight 1.2.

Expand the clip and select the screen color dropper under Keylight to select an area on the green screen. This will remove the majority of the background.

In the Keylight dropdown, change your View to Combined Matte to clearly view what will be included in the matte.

Under Keylight, adjust the Screen Gain and Screen Balance to clean any bits of the green screen that have not been removed. You can also adjust this under Keylight -> Screen Matte with Clip Black and Clip White.

Now you are ready to export the mask! Export at H264 (mp4 or mov).

Now you can link the custom mask in your Depthkit project to move ahead with the enhancement workflow.

Creating a Refinement Mask in Premiere

There are many ways to pull in a key in Adobe Premiere. For this tutorial, we will stick with Ultra Key.

Import your footage and create a new sequence from the clip.

Drop the Ultra Key effect onto your clip. You can find Ultra Key by searching for it in the Effects panel as seen below.

Go to the effects control tab.

Use the eyedropper to select the green color on your video frame

In Output, change the setting to Alpha Channel so you have a clean black/white mask.

Clean up the mask with the settings under Matte Generation and Matte Cleanup until you have a clean black and white mask with minimal noise. This is key to create a clean

Creating a Refinement Mask in Davinci Resolve

Import your footage in the Media tab and create a new timeline from the clip.

Now click on the Color tab. This is where you will create your mask.

In Resolve, editing is done with a series of nodes. Use the following nodes to create a simple and clean mask for your project.

Node 1: Qualifier

You will see your source footage in the first node in the Nodes panel. Click on this first node and select the Qualifier to pull a key. This is the color picker icon. In the Qualifier dropdown, select 3D as seen in the image below. Now you can click and drag across the green screen to remove the background. Don't be shy about the color selection. This is the step that will isolate your subject from the green background.

At this point you will want to adjust your qualifier settings to clean up the mask. Here you will need to use the color picker tools under Selection Range to add of subtract shades of green from your mask. Once you get to a place where the selection is relatively clean, you can now tweak the Matte Finesse settings. These will clean up any remaining holes in the mask, reduce edge chatter in your selection, and generally clean up the result.

Node 2: Curves

Now you are ready to add another node. Right click on the first node, select add Node, and click Add Serial. This is how you can build your node system.

For this second node, you will need to change the input from the first node. By default, the input is coming from the color output, in green. However, you want to switch that, so the 2nd node is reading the alpha input, labeled in blue.

Now with the 2nd node selected, click on the Curves tool. This will convert your key into black and white. Adjust the curve as needed to clean up your mask.

Node 3: Garbage Mask

Add a 3rd node and select the Window tool. In this stage, you will create a garbage mask around your subject to remove bits of the background that you may not be able to key out. In the Window panel, select a curve and draw a mask around your subject in the preview window.

Now invert the garbage mask with the circular invert toggle in the Window panel.

Next, select the Color Wheels tab and increase the Lift color wheel. This will remove any black splotches outside the garbage mask.

Node 4: Invert

Add another serial node and select Curves. Invert the curve so that you have a clean inverted black and white mask. It should match the curve in the image below.

Export

Now you have a custom mask! At this point, you are ready to switch to the Deliver tab and set up your mask to export. Here you want to export with the source resolution. The export format QuickTime with codec H264 are recommended for export settings. Click add to render queue to export.

Now you can link your refinement mask in you Depthkit project to move ahead with the enhancement workflow.

Updated about a year ago

Creating a Refinement Mask


Depthkit Pro

Suggested Edits are limited on API Reference Pages

You can only suggest edits to Markdown body content, but not to the API spec.