If you have recorded audio from an external device, you can now sync it to your Depthkit combined-per-pixel video before taking your clip into the game engine. Since Depthkit exports a standard video file, this can easily be done by laying the audio file back in any video editing program.
Simultaneous playback in Unity
In the past, we have mentioned applying the audio file as a component in Unity. We do not recommend this, as it will often fall out of sync with the Depthkit clip.
- Create a new project in Premiere and import both your combined-per-pixel video and the audio file. Create a sequence from your Depthkit export to ensure that is has the same resolution and framerate as the combined-per-pixel video.
- Find the clap in your video and audio for an accurate synchronization.
- You can now remove the clap from your clip so you only have the intended select to take into Unity.
- Export your clip. It is important to match the source settings from the original combined-per-pixel video file. Reducing the bitrate too much can impact the quality of the asset in Unity, so keep this setting above 5Mbps.
Keep an eye on your color management settings when exporting your Depthkit clip from any video editing tool. Many video editing programs allow you to set your own color workspace. When exporting depth data, it is key to match the source settings of the combined-per-pixel. Introducing altered color settings may introduce artifacts when viewing in Unity. An easy way to avoid this is to export via Adobe Media Encoder, which will not pick up any custom color management settings that are commonly configured in tools like After Effects.
Once exported, your combined-per-pixel clip with audio is ready for Unity, and can be used with the original poster image and metadata file.
Updated about 1 year ago