Virtual Production 102: Unreal Engine 5 Mocap course + animation pack
Category:
WORK
December 20, 2023
Why Join This Course?
Hands-On Learning: Step into the world of Unreal Engine 5 with practical, project-based learning.
Downloadable Resources: Get access to exclusive Unreal project files and motion assets to use in your creations.
Expert Guidance: Learn from industry professionals with years of experience in 3D animation and game development.
Community Support: Join a community of like-minded individuals and share your progress and creations.
What Will You Achieve?
Master Unreal Engine 5: Understand the core concepts and tools of UE5 for animation.
Bring Characters to Life: Learn how to animate characters and objects with realism and flair.
Build Your Portfolio: Create stunning animations that you can add to your professional portfolio.
Special thanks to enstudios.pl for trusting me with this project!
👋 Join me and Emanuelle Bains to explore Real-Time Animation in Unreal Engine: “Acting & Skateboarding in mocap”. Experimental 3D way and I’m SUPER excited to share this today. Shot 100% live with live audience. 🙌 Interested in hasztag#virtualproduction ? Start using software like Epic Games #unrealengine and many more tools like Blender. Like to use cool hardware? Learn how a 6-axis space mouse mice and keyboard ecosystem in Unreal helps A LOT to work with virtual cameras or #realtime animation.
Course Description:
Dive into the dynamic world of real-time animation, specifically designed to leverage the power of Unreal Engine’s cutting-edge virtual production capabilities. This course is a transformative opportunity for aspiring animators, filmmakers, visual effects artists, and game developers eager to master the art of real-time animation using world-
class motion capture systems.
What am I getting into and why?
You can see how performance capture works on different tier levels. You also learn that you can put your own twist on the content thanks to the provided mocap and source files + brief instruction + hands-on training with actual data from a professional studio motion capture sessions + video reference.
After exploring the high end you learn the indie way of mocap using apps like Move AI or dual cam setups. Clean-up is needed no matter how amazing the technolog so providing the high-fidelity data captured from industry-leading systems like OptiTrack and Rokoko you see what suits best for your animation needs and most important – you get to play with along the course! Classes include Unreal Project files to delve into.
Metahuman Animator: Tips and tricks to get the best performance data -Develop your character animation skills using advanced Metahuman Animator captures, with exclusive actress performance captures for hands-on experience. iClone8 connection with Unreal working with metahumans.
Delve into innovative animation with motion capture technology with just a iPhone in Real-World Examples: Next, work fully in unreal using Control Rig in Unreal Engine for clean-up strategies , additive blending for cleaning up animations.
Budget-Friendly Learning Experience: Discover cost-effective solutions I cover, ideal for those working within a budget.
For Who is this intended?
Aspiring and professional animators
Visual effects artists
Filmmakers and content creators
Game developers
Anyone interested in animation and virtual production
From CAD to Animation: A Complete Journey
Over the past months, I've had the privilege of working alongside Epic Games' exceptional team, talented instructors, and an amazing technical artist to master Control Rig. This tutorial documents the complete workflow for rigging the SO-ARM 100 educational robot entirely within Unreal Engine.
Prerequisites
• Unreal Engine 5.5+ (with Control Rig enabled)
• FreeCAD - Open source CAD software
• SO-ARM 100 STEP files from manufacturer
• Basic understanding of 3D modeling concepts
Phase 1: Converting CAD Models
Step 1: Download STEP Files
STEP files (.step or .stp) are the industry standard for CAD data exchange. Engineers use these for manufacturing, rapid prototyping, and robotics applications.
Why STEP files?
• Parametric data preservation
• Industry-standard format
• Contains accurate assembly hierarchies
• Maintains precise measurements
[SCREENSHOT: SO-ARM 100 STEP files]
Step 2: Convert STEP to glTF Using FreeCAD
Download FreeCAD: https://www.freecad.org/downloads.php
Conversion Process:
1. Launch FreeCAD and open your STEP file (File > Open)
2. Verify the import - check all parts are visible
3. Export as glTF 2.0 (File > Export > glTF 2.0)
4. Choose .gltf format (not .glb) for easier debugging
[SCREENSHOT: FreeCAD import interface]
Why glTF? Native Unreal support, preserves hierarchies, open standard, maintains materials.
Phase 2: Preparing the Mesh in Unreal
Step 3: Import and Transform Correction
1. Import the glTF: Drag and drop into Content Browser
2. Fix Transform Offsets: STEP files often have arbitrary pivot points
3. Use Modeling Mode tools to correct positioning
4. Apply transforms: Right-click mesh → Bake Transform
[SCREENSHOT: Unreal Modeling Mode]
Position the arm from contracted to relaxed/extended state for easier bone placement.
Step 4: Convert to Skeletal Mesh
1. Select all prepared Static Meshes
2. Right-click → Convert to Skeletal Mesh
3. Unreal creates a basic skeleton structure
[SCREENSHOT: Convert to Skeletal Mesh option]
Phase 3: Skeleton and Weight Painting
Step 5: Manual Bone Placement
This is where precision matters. Place bones at servo motor locations.
My Strategy:
• Lock viewport to Left/Side orthographic view
• Use "Place Bones Into Mesh" tool
• Place bones ONLY at servo motor locations
• Bones import as: joint1, joint2, joint3, etc.
[SCREENSHOT: Bone placement in orthographic view]
Step 6: Weight Painting Strategy
My Workflow:
1. Open Skeletal Mesh in Mesh Paint Mode
2. Work part-by-part: Select bone, paint arm segment WHITE (1.0)
3. Keep servo housing BLACK (0.0)
4. Real-time testing: Switch between Paint and Animation modes
5. Rotate bones to check for vertex issues
6. Iterate: Paint → Test → Fix → Repeat
[SCREENSHOT: Weight painting interface]
Critical: Real-time viewport feedback made this incredibly efficient!
Phase 4: Control Rig Implementation
Step 7: Create Modular Control Rig
The moment we've been working toward!
1. Right-click Skeletal Mesh in Content Browser
2. Select: Create → Control Rig → Modular Control Rig
3. Opens Modular Control Rig Editor
[SCREENSHOT: Create Control Rig menu]
Step 8: Add Physics Dynamics
Make the digital robot feel like the physical one!
1. In Modular Rig Hierarchy, locate Chain Dynamics module
2. Drag it into your rig
3. Configure dynamics:
• Adjust Damping for oscillation settling
• Tweak Stiffness to match servo holding force
• Set Mass based on physical arm segments
4. Enable Live Preview and test
[SCREENSHOT: Chain Dynamics settings]
Result: Fully rigged robot with realistic physics in just a few clicks!
The Learning Process: Iteration as Meditation
I've discovered that redoing projects in Unreal is like meditation. There's a rhythm:
1. Observe - Watch professionals demonstrate
2. Attempt - Try it yourself
3. Execute - Complete it, learning from errors
4. Refine - Redo it properly with understanding
Thank You
Massive thanks to the Epic Games Team, incredible instructors, amazing TA, and fellow riggers who made this journey possible.
Special thanks to: Julie Lottering, Chase Cooper, Jeremie Passerin, Matt Ringot, Sara Schvartzman, Ferris Webby, Helge Mathee, Benoit Gaudreau, James Burton, Shenaz Baksh, Sean Spitzer, and Kevin Miller.
Why This Matters
This workflow proves Unreal can be a complete content creation environment. For my work in medical education and AR/VR training with POCUS technology, rigging complex medical devices entirely in Unreal eliminates pipeline friction.
The SO-ARM 100 now moves with precision and purpose—100% rigged in Unreal Engine.
Your Turn!
Have you explored Control Rig for mechanical rigging? Share your experiences in the comments!