Unity + Jetset (Camera Motion-tracking) Virtual Production Pipeline Tech-Demo

This is the non-polished proof-of-concept quality output of my current Unity Virtual Production pipeline. I’m using Unity Game Engine to originate a digital world. I export the scene to Jetset to record motion tracked video clips using iPhone. I wirelessly mirror my iPhone display creating an on-set confidence monitor during the filming process.

Recordings are run through Blender as an intermediary (Jetset lacks direct Unity support at the moment). Video is run through Final Cut Pro 11 and magnetic mask Ai rotoscoping is used to remove subject from a non-greenscreen background. The resulting Blender scene and Image Sequence are imported into Unity. Due to differences in Blender & Unity’s coordinate systems, three manual interventions are necessitated for successful compositing (Full tutorial walkthrough is upcoming).

Final virtual re-lighting, volumetric atmospherics, and post-processing are added from within Unity RealTime Engine. Final export happens through Unity Recorder or (for higher quality offline [non-realtime] renders: Deckard Renderer.

#unity3d #unity3dtutorial #unitytechnologies #unity3dengine #realtime #realtimeVFX #fcpx #finalcut #finalcutpro #finalcutprox
[+] Show More

Was this helpful?

Thanks for your feedback!