AI Cinematic Director
Status: planned. This feature is not currently in the codebase (prototype removed 2026-07).
Describe a cinematic sequence and the AI creates a multi-shot storyboard with camera choreography, then renders it to video.
The sections below describe the intended design. No cinematic store, panel, or Cloud Function currently ships.
Concepts
Shot
A single camera movement within a storyboard:
| Field | Type | Description |
|---|---|---|
startFrame / endFrame | number | Frame range |
cameraPath | Array | Keyframed camera positions + lookAt targets |
focusObjectId | string? | Object to track |
note | string? | Director's note |
Storyboard
A sequence of shots that compose a complete video:
| Field | Type | Description |
|---|---|---|
shots | Shot[] | Ordered shot list |
totalFrames | number | Total video length in frames |
fps | 30 | 60 | Frame rate |
style | string? | cinematic, documentary, music-video, commercial |
voiceover | Array? | Timed voiceover text cues |
Render Job
| Status flow | queued → rendering → encoding → done |
|---|---|
| Output | MP4 video uploaded to Cloud Storage |
AI Prompt
The planned cinematic-director prompt would instruct the AI to:
- Analyze the scene graph
- Identify hero objects and compositional anchors
- Design shots with specific functions (establish, reveal, emphasize, transition)
- Output a valid
StoryboardJSON - Map style keywords to pacing (cinematic = slow, music-video = fast cuts)
UI
A CinematicPanel would provide:
- Storyboard list with create/delete
- Shot timeline preview (visual blocks)
- A "Render" button (would call a
renderStoryboardCloud Function) - Render job status + video download