Skip to main content

Phase Roadmap

All 16 phases are approved. Phases 1-11 are deployed and live. Phases 12-16 are planned — their earlier prototype scaffolding (vertical stores, service stubs, panel UIs, Cloud Function stubs) was removed in the 2026-07 cleanup. The ROS 2 / robotics and industrial-catalog integrations that overlap them remain as real, in-progress code.

Phase Status

PhaseFeatureStatusKey Files
1Auth (Google OAuth only)LiveAuthPage, useAuthStore, auth.ts
2Landing page with WebGL heroLiveyugma-landing/
3Scene templates + loaderLivesceneTemplates.ts, ProjectInfoPanel
4Share links (URL-encoded)LiveshareLinkService, urlEncoder
5Library panel (primitives + GLTF + first-party libraries)LiveLibraryPanel/
6Real-time collaboration (room codes, cursors)LivecollabService, CollabOverlay
7AI Scene ComposerLiveAIPanel, aiCompose, aiSerializer
8Real-model asset libraries (v1 catalog + v2 world library, side by side)LiveCatalogSection, LibraryV2Section, OmniverseUsdSection
9Advanced collab (comments, feed)LiveCommentPin, ChangeFeed
10Export (GLB, screenshot, embed)LiveexportUtils, EmbedPage
11AI Materials (30 presets, AI gen)LivematerialPresets, AITextureSection
12Video-to-3D reconstructionPlannedprototype removed 2026-07
13Industrial digital twinsPlannedoverlaps the live ROS 2 stack (ros/, robotics/)
14Product vibe-coderPlannedprototype removed 2026-07
15Factory simulation (physics)PartialRapier physics live for catalog models (physicsWorld.ts, useYgmPhysicsStore)
16AI cinematic directorPlannedprototype removed 2026-07

AI Enhancements (Cross-Phase)

These enhancements improve the AI layer across all phases:

EnhancementStatusFiles
Spatial preprocessor (circle/grid/stack/spiral/line/scatter)CompletespatialPreprocessor.ts
Cross-session memory (Firestore)CompleteaiService.ts (loadLastSession/saveAISession)
Style fingerprint + memoryCompletestyleFingerprint.ts
Agentic tool-use loop (replaced the two-pass planner)CompletecomposeCore.ts (loop, default 3 / max 5 iterations)
Real focus_camera (smooth tween)CompleteCameraController.tsx, useSceneStore
YSL v1.5 schema (userData, semanticRole, relationships)Completescene.types.ts, aiSerializer.ts

What Each Planned Phase Needs to Go Live

Phase 12 — Video-to-3D

Build a Cloud Run orchestrator that chains: SAM2 segmentation → monocular depth estimation → object classification → auto-rigging → scene composition. A startVideoReconstruction Cloud Function would create the job doc; the orchestrator processes it and writes back resultGlbUrl. (The earlier stub was removed 2026-07.)

Phase 13 — Digital Twins

  1. Add RTDB rules for /sensors/* back to database.rules.json (they were removed in the 2026-07 cleanup) and deploy (firebase deploy --only database)
  2. Build an MQTT→RTDB bridge (Cloud Run or Cloud Function) that receives sensor readings and writes to sensors/{id}/latest
  3. Rebuild the twin store + sensor-subscription → updateObject pipeline (the prototype was removed 2026-07); the live ROS 2 stack in ros/ and robotics/ already streams telemetry into the scene and is the natural foundation

Phase 14 — Product Vibe-Coder

  1. Set NEXAR_API_KEY secret for the Octopart/Nexar GraphQL API
  2. Build an octopartProxy Cloud Function that queries the real API (the mock-data prototype was removed 2026-07)
  3. Wire enclosure geometry into SceneRenderer (convert Enclosure → box with mounting hole subtractions)

Phase 15 — Factory Simulation

Rapier physics is already live for imported catalog / YGM models (utils/physicsWorld.ts + urdfToPhysics.ts, driven by useYgmPhysicsStore). To extend it to a general factory-simulation vertical for arbitrary primitives, wrap the scene in <Physics> and add RigidBody bodies per SceneObject. (The old generic PhysicsWorld / usePhysicsStore stub was removed 2026-07.)

Phase 16 — AI Cinematic Director

  1. Build a renderStoryboard Cloud Function: headless R3F render → ffmpeg → video upload
  2. Add a cinematic-director prompt + Cloud Function that takes a scene + brief and returns a Storyboard JSON
  3. Build a shot-timeline player in a CinematicPanel that drives setCameraTarget per shot

(The Phase 16 prototype — store, panel, and stub function — was removed 2026-07.)