XR Storytelling

Sign in Subscribe

Yvonne Coady

Invisible moving character that casts shadows in UE5

In order to make a moving character invisible, go to the character's blueprint, click on the skeletal mesh (on the right side) and then click on the material in the details (on the left). Now, we are in the material graph of the material instance. Inside details set

Recording motion capture in the Unreal

So, after we got all the pieces working we were able to record in both Rokoko and Unreal takes like: * Metahuman in the meadow, enjoying the nature and stretching * Holding objects and sitting down in the chair * Fighting * Directional jumps Observations: * Interaction with objects went good mostly because Rokoko gloves

Moving On From Azure

I have once again been stopped in my tracks, a common theme for this project. Currently there is a large demand for fine-tuning models on Azure. In light of this they have decided to indefinitely region lock the use of this service, and therefore there is no chance of fine-tuning

Easy Mocap Software Setup

For the majority of this week, I worked on EasyMocap. I worked on getting everything installed and running the demo from EasyMocap’s provided files. I had to use Python 3.9 for all other add-ons/packages to function as intended. By the end of the week, I had gotten

Live stream from Rokoko to Unreal

In the beginning of my fifth week I was asked to create a Meadow scene in UE5, so we could have Emma (a graduate student in the writing department) come in and record a couple of demo scenes. During the first half of the week I learned how to easily

NeRF scans in Volinga

This week I have learned about how to import NeRF scans into UE5 using Volinga. To begin with, I have followed the documentation on Volinga’s official website and tried to set up the scene from sample .nvol files. It strangely not work until I deleted everything from the scene

Switching to Azure

My ambitious goals of having a fine-tuned model by the end of last week have been blocked by the number of free tokens I can send to chatgpt, so now I am going to switch to learning how to use Azure and create an OpenAI model using their service. Although

Markerless Mocap From Single Feed

* For the ladder part of this week, I experimented with some markerless mocap options from a single camera feed. First, I tested Dollar Mocap which seemed to work for simple mocap but freaked out when occlusion occurred. It is also capable of streaming into Unreal Engine. I also set up

Camera To PC Stream

I worked on getting a live mocap to feed into Unreal Engine using Rokoko, Faceware, and Unreal. Everything is able to be streamed in unison but the only major detriment is that the small cameras we have, SjcamAir 4000 and Insta360 One R, can only stream to a cellphone instead

Making a static copy of a website

Today Nick and I learned together how to create a static website copy: Using Hugo tutorial ( https://gohugo.io/getting-started/quick-start/ and https://github.com/jbarone/ghostToHugo and https://blog.notmyhostna.me/posts/my-ghost-to-hugo-migration/ ) download information from your Ghost website, new theme and template etc. Then, make sure that all