Active Prototypes

SAM2 Roto Assistant

SAM2-powered segmentation assistant for complex VFX plates

Segmentation & Roto v0.8
SAM2 PyTorch Nuke Python

Interactive rotoscoping tool that reduces manual segmentation time by 78%. Integrates with Nuke for production workflows, handling motion blur, occlusion, and fine detail preservation.

Last updated: Nov 2024 View details →

Neural Material Explorer

Text-to-material workflows for lookdev acceleration

Neural Materials v0.2
SDXL MaterialX USD ComfyUI

Generates MaterialX-compliant physically-based texture sets from text prompts. Produces albedo, roughness, normal, and displacement maps optimized for production rendering.

Last updated: Oct 2024 View details →

VFX Corpus Visualization

Knowledge graph connecting shots, annotations, and model lineage

Data Corpus v0.1
Neo4j React D3.js Python

Interactive visualization of VFX production data lineage. Tracks relationships between shots, annotations, model versions, and artist feedback to create a queryable production knowledge graph.

Last updated: Sep 2024 View details →

Generative Previz

AI-assisted scene composition for virtual production

Virtual Production v0.1
ControlNet Unreal Engine USD

Rapid scene layout tool for virtual production. Generates camera-ready environments from rough sketches and text descriptions, exporting to Unreal Engine for real-time rendering.

Last updated: Aug 2024 View details →

Shot Complexity Estimator

ML-based pipeline scheduling and resource allocation

Production Infrastructure v0.3
XGBoost Pandas ShotGrid API

Predictive model trained on historical shot data to estimate VFX complexity, render time, and artist hours. Integrates with production tracking systems for smarter bidding and scheduling.

Last updated: Jul 2024 View details →

Neural Relighting Assistant

Real-time lighting inference from single HDRI probes

Neural Rendering v0.2
NeRF PyTorch OpenEXR

Infers full scene lighting from a single HDRI capture. Enables interactive relighting of live-action plates for faster lookdev iterations and client reviews.

Last updated: Jun 2024 View details →