Testing SAM2 on motion-blurred footage
Nov 28, 2024Evaluated SAM2's handling of fast-moving subjects with heavy motion blur. Found that temporal consistency breaks down above 180-degree shutter angles. Investigating frame interpolation preprocessing as a workaround.
Read note →MaterialX export pipeline for neural materials
Nov 15, 2024Built automated MaterialX export from SDXL-generated texture sets. Successfully validated PBR compliance in Arnold and Karma. Next: testing displacement map fidelity at production resolutions (8K+).
Read note →Knowledge graph schema for shot dependencies
Oct 30, 2024Designed Neo4j schema linking shots, assets, annotations, and model checkpoints. Can now query "which shots were affected by model version X" and "show me all annotations that influenced this training run." Promising for pipeline observability.
Read note →ControlNet depth maps for virtual production blocking
Oct 12, 2024Testing ControlNet with depth conditioning for rapid environment generation. Can produce coherent scene layouts from director sketches in under 30 seconds. Quality sufficient for previz but requires manual cleanup for finals.
Read note →Shot complexity features from production databases
Sep 25, 2024Extracted 47 features from ShotGrid data (FX elements, character count, camera complexity, etc.). XGBoost model achieving 82% accuracy in predicting artist hours within ±20% margin. Ready for pilot deployment.
Read note →NeRF-accelerated lookdev for on-set lighting
Sep 10, 2024Trained NeRF models on set reference photography to provide interactive relighting previews for DOP review. Reduced feedback cycle from 24 hours (traditional render) to real-time. Artists love it for client approvals.
Read note →Gaussian Splatting vs NeRF for production assets
Aug 28, 2024Compared 3D Gaussian Splatting and NeRF for asset capture workflows. Gaussian Splatting trains 10x faster and exports cleaner point clouds. NeRF still wins on view synthesis quality. Hybrid approach looking promising.
Read note →Latency constraints for interactive AI tools
Aug 15, 2024Interviewed 12 artists about acceptable latency for AI-assisted tools. Consensus: under 2 seconds for "feels instant", under 10 seconds for "feels responsive", above 30 seconds loses context. Design accordingly.
Read note →Human-in-the-loop feedback for model improvement
Jul 30, 2024Designed annotation capture system for artist corrections on ML-generated masks. Data goes into retraining pipeline automatically. Early results: 15% quality improvement after one production cycle of feedback.
Read note →USD interoperability for AI-generated assets
Jul 12, 2024Standardized USD schema for AI-generated geometry and materials. Enables round-tripping between generative tools (Stable Diffusion, NeRF) and production DCCs (Maya, Houdini, Katana). Schema now in internal production use.
Read note →