OOJU x Manus AI Hackathon in Singapore

Workflow Overview

OOJU enables web (WIP)-to-XR development through browser-based asset creation and Unity plugin integration.

Part 1: Web App

1. AI Asset Creation: Generate 3D models via text prompts

2. Asset Discovery: Search Sketchfab's 3D library

3. Scene Composition: Arrange assets on 3D canvas

4. Export: ZIP file + 3D asset cloud sync to OOJU account

   1. No ‘list view/preview’ available yet.

Part 2: Unity Plugin

XR Setup

• One-click VR/MR project optimization

• Scene templates and skybox themes

Manager (Core Features)

• Import: Load web scenes (ZIP) or synced assets

• AI Script Generation: Generate C# from text prompts (e.g., "Make this door open when I point at it")

• AI Interaction Suggestions: Context-aware behavior recommendations

• Test Mode: Keyboard/mouse testing without headset

3D Development Fundamentals

Key Principles

• Golden Rule: Use X/Y/Z axes (Gizmo) for precise positioning, never direct grab

• Animation Types: Simple (translate/rotate/scale) vs. Complex (requires rigging)

• Asset Strategy: Use pre-rigged models or simple mechanical objects

Unity Development Cycle

1. Scripting: Write C# code

2. Compiling: Unity processes code

3. Editing: Assign scripts to GameObjects

4. Playing: Test in Play Mode

5. Building: Create executable

---

MCP Cocktail Examples

The Holo-Wallstreet (FinTech)

• MCPs

  • polygon-io (stock data)

  • @antv/chart (visualization)

  • unsplash (logos)

• AI Prompt: "When stock increases 5%, pulse green. If drops 5%, pulse red."

The AI Quest Designer (Game Development)

• MCPs

  • cognee (NPC memory)

  • markmap (logic visualization)

  • rijksmuseum (inspiration)

• AI Prompt: "Create blacksmith quest: bring 10 Iron Ore + 1 Dragon Scale, receive Hero's Sword"

The Vibe Traveler (Virtual Travel)

• MCPs

  • Google-maps (location)

  • Weather (atmosphere)

  • Unsplash (textures)

  • kokoro-tts (narration)

• AI Prompt: "When user looks up, display real-world time/temperature"

The Sound Sculptor (Music Creation)

• MCPs

  • Melrose (MIDI generation)

  • ffmpeg (audio processing)

  • discogs (genre data)

• AI Prompt: "Map cube X-position to pitch, Y-position to volume, size to note length"

The GitVR Commits Explorer (Developer Tools)

• MCPs

  • GitHub (repository data)

  • FileScopeMCP (code analysis)

  • Posthog (analytics)

• AI Prompt: "Select two commits, draw a line between them, show file differences"

The Living Scrapbook (Interactive Storytelling)

• MCPs

  • imagen3 (image generation)

  • memory (knowledge graph), voice-mcp (text-to-speech)

• Unity: Grab/pinch memory objects, wave cycles images

• AI Prompt: "When user picks up the Music Box, play the sound and trigger the AI story about birthday"

The XR Stage Director (AI Orchestration)

• MCPs: unsplash (references), filesystem/asset database (3D models)

• Unity: Point designates location, grab resizes objects

• AI Prompt: "Make mushrooms emit soft blue pulsating light"

The Auto Mechanic (Training Simulation)

• MCPs

  • ragdocs (technical manuals)

  • run-python (physics validation)

• Unity: Precise pinch for screws, firm grab for large parts

• AI Prompt: "If Part B is attached before Part A, glow red and shake, AI says 'Try gasket first'"

The Material Weaver (Creative Tools)

• MCPs

  • metmuseum (pattern inspiration)

  • imagen3 (texture generation)

  • imagesorcery (processing)

• Unity: Point selects model, pinch drags textures, wave cycles properties

• AI Prompt: "Create detail brush: pinch and paint applies gold stitching texture along path"