Live stream from Rokoko to Unreal

In the beginning of my fifth week I was asked to create a Meadow scene in UE5, so we could have Emma (a graduate student in the writing department) come in and record a couple of demo scenes. During the first half of the week I learned how to easily make an outdoor scene with a Foliage tool in the UE5, set up the Rokoko Studio and the suit, as well as the LiveLink to the Unreal. Here is a great video for setting up the blueprints for the live mocap (start at 45:50) https://www.youtube.com/watch?v=2cTCpsUokFc&t=2750s. After I made all the necessary changes to my Metahuman it still was not working properly, so here is an additional tip on how to set up the livestreaming from Rokoko to UE5:

  • If the Metahuman still does not react when you hit play or moves in a wrong way, go to the f_med_nrw_animbp and under the default tap on the right change Rokoko Actor Name to your Actor name in the Rokoko studio (i.e. Newton). Don’t forget to click apply, then compile and save the blueprint! This should fix any streaming problems you have had before.

The only thing to keep in mind is whenever you want to switch your actor profile in Rokoko, you also need to change the Rokoko Actor Name in both Metahuman blueprint and in f_med_nrw_animbp. Now your everything is set up and good to go!

Another important thing to know about working with the Rokoko suit is sometimes when you plug in the suit, you might get an alert saying the sensors are in the bootloader mode. In this case your steps should be:

  • go to the Firmware panel and click "Set all Sensors in Bootloader Mode"
  • click “Re-install Firmware”
  • After it is done, unplug and plug the suit back

Please do not panic and wait at least for 30 seconds before plugging the wires back. “Patience is a virtue” - Nick.

After that we were able to calibrate the actor and stream this data to unreal successfully!

–Sofiia


Subscribe to XR Storytelling

Don’t miss out on the latest issues. Sign up now to get access to the library of members-only issues.
jamie@example.com
Subscribe