AI Cinematic Director
Describe a cinematic sequence and the AI creates a multi-shot storyboard with camera choreography, then renders it to video.
Status: Scaffolded. Storyboard data model, store, and panel are in place. The render worker (headless R3F + ffmpeg) is not yet built.
Concepts
Shot
A single camera movement within a storyboard:
| Field | Type | Description |
|---|---|---|
startFrame / endFrame | number | Frame range |
cameraPath | Array | Keyframed camera positions + lookAt targets |
focusObjectId | string? | Object to track |
note | string? | Director's note |
Storyboard
A sequence of shots that compose a complete video:
| Field | Type | Description |
|---|---|---|
shots | Shot[] | Ordered shot list |
totalFrames | number | Total video length in frames |
fps | 30 | 60 | Frame rate |
style | string? | cinematic, documentary, music-video, commercial |
voiceover | Array? | Timed voiceover text cues |
Render Job
| Status flow | queued → rendering → encoding → done |
|---|---|
| Output | MP4 video uploaded to Cloud Storage |
AI Prompt
The CINEMATIC_DIRECTOR_PROMPT instructs Claude to:
- Analyze the scene graph
- Identify hero objects and compositional anchors
- Design shots with specific functions (establish, reveal, emphasize, transition)
- Output a valid
StoryboardJSON - Map style keywords to pacing (cinematic = slow, music-video = fast cuts)
UI
The CinematicPanel (via bottom-left drawer) provides:
- Storyboard list with create/delete
- Shot timeline preview (visual blocks)
- "Render" button (calls
renderStoryboardCloud Function) - Render job status + video download