Human and Cloth Interaction in VFX

How can complex human-cloth interactions be achieved for digital media using accessible tools while ensuring a scalable pipeline for future projects?

SUMMARY

Within the learning community of Immersive Technologies and Storytelling, Saxion has gathered external partners to challenge the students with exciting and unique projects. For a 5 month period, the research group was tasked to learn, design and develop solutions to real problems found in the creative industry in the form of a product or prototype. The task at hand was to tackle, explore and create different pipelines for the making of complex humans and their interaction with cloth within the digital world.

Challenges & Constraints
🛑 Learning curve for simulation software like Houdini
🛑 Limited access to specialized equipment due to the COVID-19 lockdown
🛑 Integration issues between Software
🛑 Complex geometry causing unpredictable simulation results

🎯 Goals
✅ Develop a scalable pipeline for cloth simulation
✅ Create realistic human-cloth interaction
✅ Minimize manual interventions through procedural workflows
✅ Ensure high-quality rendering for presentation and client delivery

👩‍🚀 Role
3D Artist, Researcher
I led the research, prototyping, and production phases. I collaborated closely with environment artists, asset creators, and technical artists. My contributions included developing custom simulations, troubleshooting complex dynamics, and optimizing workflows for maximum realism.

🏆 Results
✅ Visual Realism: Delivered a visually stunning showreel demonstrating dynamic cloth simulation in various environments.
✅ Scalable Workflow: Developed a reusable pipeline for future projects.
✅ Technical Advancements: Solved integration challenges between Houdini and Unreal Engine, enhancing simulation accuracy.

DESIGN PROCESS OVERVIEW

We employed the Design Thinking Framework to guide our iterative approach:

1. Discover:
   Conducted extensive industry research on workflows, tools, and technologies. Defined project roles and responsibilities.

2. Interpret:
   Identified core challenges related to cloth physics and human-model integration. Established SCRUM management practices.

3. Ideate:
   Conceptualized culturally diverse characters with distinct clothing styles (Japanese kimono, Nordic tunics, Native American breechcloths).

4. Experiment:
   Iteratively tested pipelines in Houdini, Marvelous Designer, and Unreal Engine while troubleshooting simulation artifacts.

5. Evolve:
   Delivered a polished showreel showcasing simulation fidelity, artistic quality, and technical achievements.

6. 
   
   

TECHNICAL SOLUTIONS IMPLEMENTED

• Modeling & Asset Creation:
  ZBrush for sculpting human models and Marvelous Designer for garment construction.

• Cloth Simulation:
  Houdini’s Vellum solver enabled high-fidelity simulations, ensuring realistic cloth behavior.

• Pipeline Integration:
  Exported simulations from Houdini to Unreal Engine using Alembic files, solving UV mapping and collision challenges.

• Hair Simulation:
  Used Houdini’s procedural tools for hair and fur dynamics, enhancing character realism.

• Environment & Rendering:
  Built immersive environments with Unreal Engine, utilizing procedural foliage systems and lighting tools.

CONCLUSION AND REFLECTION

This project deepened my understanding of complex simulation pipelines and real-time rendering. By balancing technical precision with artistic direction, we achieved a visually compelling result that showcases the potential of cutting-edge tools in digital media production.

Next Steps:

• Expand the pipeline to support additional character assets.

• Automate asset export processes using Houdini Engine.

• Explore AI-driven garment design for increased production efficiency.

Documentation & References:

• Research Blog: Seamrippers Project Blog

• Relevant Tools: Houdini, Unreal Engine, Marvelous Designer, ZBrush
  
  

IN-DEPTH CASE