T265 Virtual Camera

Over the course of this week, I set up a virtual camera that was controlled by the Intel RealSense T265. First, I tested it in Aximmetry with REtracker Genlock as the conduit to link the T265 to Aximmetry, which then impacted a virtual camera in an Unreal scene. I also combined it with live footage from my cellphone overlaid on the virtual camera. To enhance this I set up a quick key of the green screen to get a real-world element into the virtual world. This technique had subpar results out of the box.

But I found the purely Unreal Engine approach worked better. To do this I used the REtracker FreeD and the LiveLink FreeD Unreal Plugin. Then on the virtual cinecamera, I parented it to an Actor. Additionally, I set up a Livelink controller component to control to match the movement of the T265 to the real world. A great feature of this method is we can relatively easily calibrate its possession with an Acuro tag, chessboard, and a Lens object in Unreal and the real world. Moreover, we can do keying on real-world footage with this technique as well. Thus, the purely Unreal approach is easier to set up, control, and teach to new users.

-Tyson