Turn creative prompts into interactive XR experiences with Gemini

This post introduces how Google's Gemini AI can convert creative text prompts into interactive XR (Extended Reality) experiences via WebXR APIs and the Canvas feature.

• •Gemini Canvas generates interactive 3D web graphics using WebGL and Three.js, which can be viewed in XR by pressing an "Enter XR" button via WebXR APIs
• •A blood cell biology simulation was built as a proof-of-concept, demonstrating Gemini's ability to produce fully realized, immersive XR content
• •Users need a Samsung Galaxy XR headset and Gemini 3 Pro; setup involves configuring an XR Blocks Gem with an ultra-prompt for advanced AR physics
• •Gemini Live can be embedded within XR sessions to allow voice-based interaction and continued creation without leaving the immersive environment
• •Completed XR creations are exported as shareable web links accessible to anyone