Testing SAM2 on motion-blurred footage

Nov 28, 2024
Segmentation SAM2

Evaluated SAM2's handling of fast-moving subjects with heavy motion blur. Found that temporal consistency breaks down above 180-degree shutter angles. Investigating frame interpolation preprocessing as a workaround.

Read note →

MaterialX export pipeline for neural materials

Nov 15, 2024
Neural Materials MaterialX

Built automated MaterialX export from SDXL-generated texture sets. Successfully validated PBR compliance in Arnold and Karma. Next: testing displacement map fidelity at production resolutions (8K+).

Read note →

Knowledge graph schema for shot dependencies

Oct 30, 2024
Data Pipelines Neo4j

Designed Neo4j schema linking shots, assets, annotations, and model checkpoints. Can now query "which shots were affected by model version X" and "show me all annotations that influenced this training run." Promising for pipeline observability.

Read note →

ControlNet depth maps for virtual production blocking

Oct 12, 2024
Virtual Production ControlNet

Testing ControlNet with depth conditioning for rapid environment generation. Can produce coherent scene layouts from director sketches in under 30 seconds. Quality sufficient for previz but requires manual cleanup for finals.

Read note →

Shot complexity features from production databases

Sep 25, 2024
ML Infrastructure ShotGrid

Extracted 47 features from ShotGrid data (FX elements, character count, camera complexity, etc.). XGBoost model achieving 82% accuracy in predicting artist hours within ±20% margin. Ready for pilot deployment.

Read note →

NeRF-accelerated lookdev for on-set lighting

Sep 10, 2024
Neural Rendering NeRF

Trained NeRF models on set reference photography to provide interactive relighting previews for DOP review. Reduced feedback cycle from 24 hours (traditional render) to real-time. Artists love it for client approvals.

Read note →

Gaussian Splatting vs NeRF for production assets

Aug 28, 2024
Neural Rendering Gaussian Splatting

Compared 3D Gaussian Splatting and NeRF for asset capture workflows. Gaussian Splatting trains 10x faster and exports cleaner point clouds. NeRF still wins on view synthesis quality. Hybrid approach looking promising.

Read note →

Latency constraints for interactive AI tools

Aug 15, 2024
Production Infrastructure UX

Interviewed 12 artists about acceptable latency for AI-assisted tools. Consensus: under 2 seconds for "feels instant", under 10 seconds for "feels responsive", above 30 seconds loses context. Design accordingly.

Read note →

Human-in-the-loop feedback for model improvement

Jul 30, 2024
ML Infrastructure RLHF

Designed annotation capture system for artist corrections on ML-generated masks. Data goes into retraining pipeline automatically. Early results: 15% quality improvement after one production cycle of feedback.

Read note →

USD interoperability for AI-generated assets

Jul 12, 2024
USD Pipelines

Standardized USD schema for AI-generated geometry and materials. Enables round-tripping between generative tools (Stable Diffusion, NeRF) and production DCCs (Maya, Houdini, Katana). Schema now in internal production use.

Read note →