An AI-guided mixed-reality task-assistance platform, prototyped on Meta Quest 3 while targeting AR glasses.
Project snapshot
Guide Kit began as an XRCC “Scrap the manual” hackathon concept. It did not reach submission status, but the idea continues as a foundation for an AR glasses guidance experience.
The project explores how AI can guide real-world tasks through voice-first narration, spatial overlays, and camera-aware assistance. The reference prototype focuses on hands-on assembly work, using Meta Quest 3 as a practical prototyping platform for a future lightweight AR glasses experience.
Technical direction
Guide Kit is designed around three core operating models: voice-only guidance for the lightest-weight use case, voice with mobile augmentation when a companion screen helps, and spatial guidance using Quest 3, AR glasses, or an XR headset where overlays can be anchored directly into the user’s workspace.
Domain-neutral guidance engine with task-specific content packs.
Audio, mobile companion, and spatial-overlay presentation modes from shared task data.
Voice navigation, step narration, and AI-assisted coaching concepts.
Spatial UI overlays intended to support hands-on work without relying on paper instructions.
Development status
COMPLETED / WORKING
Initial Quest 3 prototype foundation for MR task guidance.
Early task and content manifest support for guided steps.
Initial voice and spatial guidance flows.
Core architecture for a domain-neutral guidance system with content packs.
NEXT / IN PROGRESS
Refine the Quest 3 prototype into a stronger demo flow.
AR glasses interaction model with XREAL Aura or Mentra Live when available.
Polish guidance UI, voice flow, and spatial overlay behavior.
Add visual assets, screenshots, and prototype capture.