Processing Studio captures

1. Enter the Editor context by clicking on the Editor tab. You can also navigate there by going to the View menu and selecting Editor.

2. As you can see in the recording library, the capture from each sensor is available to review. Double-click one of these clips and see all related sensor perspectives highlighted for the complete multi-sensor capture.

3. For each sensor perspective, we will set the optimal depth range per clip, and apply the refinement algorithm to enhance our depth data.

Depth Range

Located in the Isolate panel, the Depth Range is the range of distance from the sensor that you will be preserving. It's represented as a hue-encoded depth map, which you can preview in the Depth Preview window, with red/orange as the closest preserved depth data, and purple/pink as the farthest preserved depth data. Bringing these clipping planes as close to your subject without clipping them at any point in the recording will increase the spatial resolution of your asset.
Set the depth range via the slider in the Isolate panel, or by grabbing the corners of the frustum in the 3D viewport.

Cinema workflow

If you have recorded a Cinema clip for any of your sensors, you may apply them in the same fashion as a single-sensor capture. Follow the steps here to do so.

Refinement

🚧

Refinement is enabled on a per-sensor basis.

In order to get the most out of the Refinement workflow, enable and set the Refinement settings on each sensor so that all of them are set appropriately.

At this point you can export your clip for Unity. However, for best results, we recommend using the Refinement workflow.

Masked Refinement

See a full guide on applying Masked Refinement in our Applying Refinement section.

For best results when using the Masked Refinement, you'll need to make mattes for each sensor from the source videos found in the following location: <Project Folder>/<Take Folder>/sensor<#>/sensor.mp4

In the Isolate panel, link the masks to each corresponding recording.

Maskless-Refinement

It is possible to enable refinement without the use of a Refinement Mask. This will increase the resolution of the exported asset, but not leverage the other capabilities of the Refinement algorithm like hole-filling.

Select Enable Refinement in the Refine panel of each sensor, and set the appropriate sliders for Maskless Refinement.

🚧

Maskless Refinement parameters

If you are not applying a Refinement Mask as an input, it is recommended to reduce the Filter Size and Fill Amount to minimal values. While these higher values can repair depth artifacts, they work best when a Refinement Mask is applied, and may result in stray geometry added to your asset without a Refinement mask.

Isolate

Depth Range allows you to cull depth data closer than the Near Plane or farther than the Far Plane.

If you have enabled Refinement in the Refinement panel, you'll have access to additional parameters.

Link Refinement Mask will allow you to select a matte video for the Masked Refinement workflow.

Crop allows you to remove unused portions of your frame. Like the Depth Range, the closer you can get the crop parameters to your subject without clipping them at any point in the recording, the higher-resolution your output will be.

Crop with the horizontal and vertical crop sliders or via the interactive handles in the Color Preview window.