Dr. Supernova's Evil Plan

USC's first virtual production thesis using LED wall technology

Dr. Supernova's Evil Plan LED Wall Setup

Project Overview

"Dr. Supernova's Evil Plan" was one of USC School of Cinematic Arts' first-ever virtual production thesis project, created between January and June 2024. This innovative project combined traditional filmmaking with cutting-edge virtual production techniques to bring a comedic story to life.

The narrative follows a supervillain juggling his dastardly plans with unexpected "bring your daughter to work day" responsibilities. As he attempts to activate his super laser and deal with an incoming hero, he must also care for his daughter, creating a humorous contrast between his evil persona and parental duties.

🎯

Goal

Create USC's first virtual production thesis using LED wall technology.

⏱️

Timeline

January 2024 - June 2024

🧠

Role

LED Wall Operator and VAD (Virtual Art Department) team member

🛠️

Tools & Technologies

Unreal Engine, LED walls, Motiv motion capture, Luma AI for NeRFs

Technology & Setup

Virtual Production Environment

The project utilized a state-of-the-art virtual production stage featuring LED wall technology that displayed real-time computer-generated environments. This setup allowed for in-camera visual effects where digital backgrounds appeared directly in the camera's frame during filming.

  • LED wall display system for real-time environments
  • Camera tracking system for perspective-correct rendering
  • Real-time rendering pipeline using Unreal Engine

Advanced Technologies

The production leveraged several cutting-edge technologies to create a seamless blend between physical actors and digital environments.

  • Motiv motion capture system for performance tracking
  • NeRF (Neural Radiance Fields) and gaussian splat rendering
  • Luma AI scanning for creating 3D assets

Overview of the virtual production set for Dr. Supernova's Evil Plan

Production Process

This project provided valuable hands-on experience with next-generation filmmaking tools and workflows, demonstrating how virtual production can enable filmmakers to blend physical and digital elements in real-time.

1

Stage Calibration

Before filming could begin, the LED wall and camera tracking system required precise calibration to ensure accurate perspective rendering as the camera moved around the physical space.

2

Motion Capture Operation

Operating the Motiv motion capture system was crucial for tracking performances and enabling interactive elements within the virtual environment.

3

Asset Integration

The production incorporated Luma AI scans to create gaussian splat assets that were integrated into the virtual environment, enhancing the realism and detail of the digital world.

4

Live Filming

During filming, the LED wall displayed the virtual environment in real-time, responding to camera movements to maintain proper perspective while actors performed in the physical space.

Key Takeaways

This project provided valuable exposure to cutting-edge virtual production technology and workflows, offering insights into both its capabilities and implementation considerations.

Technical Insights

  • Virtual Production Pipeline: Gained practical insight into the complete virtual production pipeline from environment creation to final filming.
  • Integration Challenges: Experienced firsthand the technical complexities of merging physical and digital production elements.
  • Emerging Technologies: Worked with cutting-edge tools including LED walls, real-time rendering, and NeRF/gaussian splat assets.

Reflection

Participating in USC's first virtual production thesis project provided valuable exposure to next-generation filmmaking techniques, even in a supporting role. While virtual production technology presents exciting creative possibilities, this experience highlighted the significant technical complexity and resource requirements involved in such productions.

Personal Takeaway

This project underscored the importance of understanding both the creative potential and practical limitations of emerging technologies in filmmaking. It reinforced my belief in selecting the right tools for specific storytelling needs rather than adopting new technology simply for its novelty.