The Depthkit has been developed with increased capture stability and performance, allowing you to capture on portable machines. With this in mind you are not limited to a capture stage or green screen. The latter is due to Depthkit's support of body index - body index - The detection of one or multiple bodies in the depth data. When generating your assets, this acts as a body mask, allowing you to simply hide the background for clean exports of your subjects. This eliminates the need to shoot on a green screen. segmentation. This is the detection of one or multiple bodies in the depth data. When generating your assets, this acts as a body mask, allowing you to simply hide the background for clean exports of your subjects.
Once captured, you can then decided if you want to include or exclude the background in your export settings.
The Body Index is segmenting the background from the subjects.
Body Segmentation seen in Unity
The technology that makes the Kinect work relies on the near-infrared spectrum for illumination. If you use lights containing a lot of infrared content it can disrupt the Kinect, degrading your depth capture.
Fluorescent tube lights
LED Light Panels
A rule of thumb is that any lights that are hot to the touch (including our sun) generally introduce some near-infrared pollution, making them not ideal for scanning. When in doubt, we always recommend that you test your lights before shooting!
When considering how to light your scene for Depthkit we recommend taking into account the of the experience you are shooting for. Similar to an 'in-camera' lookdesigning your lighting for that context. For example, if I intend to place my subject so that they're illuminated from the left by a window in VR, then on set it's best if I put a large softbox to the left of my subject to mimic that light.
Avoid the use of transparent or reflective materials! This means glasses, mirrors, windows, shiny leather, waxed jeans, etc. These materials will degrade your depth data.
The Kinect relies on a small infrared emitter to visually detect depth of surfaces. This technology can fail if the material properties don't reflect the light back into the camera's lens. For example, it will not be able to detect transparent surfaces like glasses, windows or water. It will also represent reflective surfaces in strange ways – for example if I film something in a mirror, the object will appear to be inside the mirror.
It occasionally will also struggle with certain fabrics or materials. Black leather and some kinds of waxed or otherwise treated jeans will just not appear in the data stream. On critical shoots, always test your materials in the Kinect before shooting.
When choosing patterns or colors in clothing, adhere to all the same constraints that govern a typical film shoot – small repeating patterns can cause moire effects and if garments are too bright or too dark they will indeed appear bright or dark respectively when filmed with Depthkit.
|Setting up Depthkit|