XR Storytelling

XR Storytelling

Sign in Subscribe

Latest — Aug 4, 2023

Virtual Production Demos

In the past week, Emma and I did a couple of filming sessions using the lab's virtual production tools. In the first session, we focused on the virtual tools in Unreal engine using the Rokoko Smartsuit Pro v2, the Intel T265 Realsense camera, and the iPhone 12 for

More issues

ECS 567 Virtual Production Setup

This week we had a chaotic meeting with Emma and David which our setup bugged out on multiple accounts. First, the virtual camera wasn’t connecting and that was because the NDisplay I was setting up that morning had an error in the ip it was operating on. My hypothesis

Axibo Setup

Over the past week, I set up Axibo and tested it in the Unreal Livelink. But while setting up the slider I dropped the rig and the slider motor isn’t being detected now. After further exploration, we discovered that the motors chip sits on top of the cylindrical metal

Livelink across networks

While working with IM4 we needed to set up a way for students using virtual machines to record facial mocap from their iPhone to the VM. But, normally this needs to be done on the same network and is how the cellphone transmits the data to the computer. To solve

T265 Virtual Camera

Over the course of this week, I set up a virtual camera that was controlled by the Intel RealSense T265. First, I tested it in Aximmetry with REtracker Genlock as the conduit to link the T265 to Aximmetry, which then impacted a virtual camera in an Unreal scene. I also

EasyMocap Empty 3dkeypoints for multiple people

While working with EasyMocap to capture multiple people at the same time my output was producing empty JSON files for the 3dkeypoints. After experimentation, I have discovered 2 reasons this can occur. The first is cameras being too sparse, which is different from single-person mocap where the cameras don'

Fixing delay and lag problems

Last week I ran into a couple of problems while trying to livestream mocap data from Rokoko to Unreal and project it with Optoma 4K laser cinema on the white wall in our lab. One thing that I have noticed is the difference between the image on PC vs. on

Repairing Rokoko suit

Earlier this week I encountered a problem with our Rokoko suit - the sensors were constantly in bootloader mode and the suit would not calibrate. After going through the power circle (https://support.rokoko.com/hc/en-us/articles/4410479064849-Some-or-all-of-the-sensors-on-the-Smartsuit-Pro-do-not-work ) multiple times in different days and failing, I realized that something

EasyMocap BVH to Unreal

The following file has instructions on getting the mocap data from EasyMocap into Unreal Engine. If a user is very comfortable in Unreal retargeting they could use add a character to the mocap data in Blender and do all retargeting in Unreal. But the rig produced from EasyMocap isn'

EasyMocap Log + Instructions

This week I filmed my own unique footage and the required calibration footage for EasyMocap. For materials, I used my cellphone, the GoPro Hero 9, and a paper print of a chessboard for calibration. To calibrate the extrinsic footage I had to set a chessboard pattern on the floor in

About

XR Storytelling

Experiences from the Summer2023 UVIC Interns in their learning adventures

Topics

Nick

Sofiia

Tyson