In an era where technology continuously reshapes our interaction with knowledge, EON Reality stands at the forefront of this transformation. Today, they proudly announced a groundbreaking initiative – the integration of DeepMind’s Genie 2 and World Labs AI into the EON-XR platform, set to revolutionize global spatial AI learning, training, and performance.

Strategic Technology Integration

This strategic integration combines EON Reality’s proven educational framework with cutting-edge AI capabilities, enabling instant creation of persistent 3D learning environments while maintaining EON Reality’s established strengths in enterprise and academic environments across 85+ languages and 30+ device types. 

Generating 3D Worlds

The EON-XR Integration represents the first step towards full immersive spatial intelligence: an AI system that generates 3D worlds from a single image or sentence for the purpose of knowledge transfer i.e. Learn, Train and Perform. This lets you step into any image and explore it in 3D.

Courtesy of World Labs

Most AI tools make 2D content like images or videos. Generating in 3D instead improves control and consistency. This changes how we make simulators, recreate historical scenes or explore travel destinations and other digital manifestations of our physical world.

The EON-XR platform integration will allow you to instantly generate new 3D worlds from a single image or text, rendered live in your browser. You’ll also experience different camera effects, 3D effects, and dive into classic paintings. 

Explore a World

It’s your turn to explore some worlds! Below we show examples of 3D worlds generated from fantastical images and everyday photos. 

Courtesy of World Labs

Courtesy of World Labs

3D Effects

Most generative models predict pixels. Predicting a 3D scene instead has many benefits:

• Persistent Reality: Once a world is generated, it’s there to stay. The scene won’t change behind your back if you look away and come back.
• Real-Time Control: After generating a scene, you can move around it in real-time. You can linger on the details of a flower, or peek around a corner to see what is revealed.
• Correct Geometry: Our generated worlds obey basic physical rules of 3D geometry. They have a sense of solidity and depth that contrasts with the dream-like nature of some AI-generated video.

Build Interactive 3D Environments  From A Sentence

By integrating EON-XR with Google’s Genie 2 from Google DeepMind you can generate interactive 3D worlds from a single image and text description.

This advanced technology creates diverse virtual environments that can be explored and manipulated using keyboard and mouse inputs, simulating actions like jumping and swimming.

Courtesy of Google DeepMind Genie 2

Key Features and Capabilities:

• 3D World Generation: You can create expansive and interactive 3D environments from a single image prompt, complete with objects, characters, and interactive elements
• Diverse Perspectives: The model can generate environments from various viewpoints, including first-person, isometric, and third-person views
• Long-term Consistency: The 3D environment maintains consistent world states for up to a minute, generating new and plausible content on the fly
• Advanced Memory: The model remembers off-screen elements, accurately rendering them upon reappearance
• Training Simulations: The technology will be integrated with EON Reality’s four knowledge simulators to create realistic scenarios for learning and practice.
• Avatar Interaction: EON Reality with Google’s Genie 2 stands out with its ability to create highly interactive and complex 3D worlds. Unlike its counterparts, it supports user actions such as jumping and swimming, simulating experiences akin to advanced simulators
• Physics Engine: The model incorporates advanced features like object movements, animations, realistic reflections, and a robust physics engine, surpassing the capabilities of World Labs and Oasis in terms of interaction sophistication.

Courtesy of Google DeepMind Genie 2

Ten Revolutionary EON-XR Platform Enhancements

1. AI-Powered Dynamic 3D Environment Generation 

Capability: Instantly creates interactive 3D environments from text/image inputs Key Enhancement: Reduces full 3D environment creation time from weeks to minutes 

Use Case: Medical Training

• Generates comprehensive hospital scenarios instantly
• Enables real-time environment modification based on changed text prompt
• Impact: 99% reduction in scenario development time vs traditional 3D modelling

2. Advanced Persistent World Memory 

Capability: Maintains environment consistency across multiple sessions 

Key Enhancement: Enables long-term project development and collaboration 

Use Case: Engineering Design

• Preserves factory lay-out configurations
• Tracks modifications across multiple sessions
• Enables team collaboration on persistent projects 
• Impact: improvement in project completion efficiency

3. High-Fidelity Physics System (Genie 2) 

Capability: Simulates complex physical behaviors including fluids and materials Key Enhancement: Enables true-to-life interaction and material behavior 

Use Case: Logistics

• Realistic Newtonian physics in packing & stacking of boxes
• Accurate behaviour
• Impact: increase in skill transfer to real procedures

4. Real-Time Environmental Evolution 

Capability: Dynamically adapts environments based on user actions 

Key Enhancement: Creates responsive, evolving training scenarios 

Use Case: Emergency Response Training

• Progressive disaster scenario development, explosion
• Dynamic stakeholder reactions
• Multiple consequence paths 
• Impact: improved decision-making capability

Courtesy of World Labs

5. Natural Object Interaction 

Capability: Enables intuitive object manipulation with persistent states 

Key Enhancement: Creates realistic hands-on training experiences 

Use Case: Manufacturing Training

• Natural tool handling
• Realistic assembly processes
• Accurate equipment behavior Impact: faster skill acquisition

6. Advanced Character Animation System 

Capability: Delivers sophisticated AI-driven character movement and interaction Key Enhancement: Creates natural human-like behavior and responses 

Use Case: Healthcare Communication Training

• Realistic patient behavior 
• Natural responses
• Dynamic condition presentation 
• Impact: improvement in patient interaction scores

7. Multi-Dimensional Perspective System 

Capability: Enables seamless viewing from any angle while maintaining consistency 

Key Enhancement: Provides comprehensive spatial understanding 

Use Case: Complex Procedures

• Multiple viewing angles for team training
• Cross-sectional visualization
• Real-time perspective switching 
• Impact: 85% improved spatial awareness in complex procedures

Courtesy of World Labs

8. Environmental Effects Engine 

Capability: Creates photorealistic lighting and atmospheric conditions 

Key Enhancement: Enables true-to-life environmental simulation 

Use Case: Aviation Weather Training

• Dynamic weather pattern simulation
• Complex atmospheric effects
• Real-time visibility changes 
• Impact: improved weather-related decision-making

9. Real-Time Scenario Generation 

Capability: Creates multiple outcome paths from single starting points 

Key Enhancement: Enables comprehensive consequence training 

Use Case: Crisis Management

• Multiple branching scenarios
• Dynamic stakeholder responses
• Real-time consequence visualization 
• Impact: 80% improvement in crisis response effectiveness

10. Temporal Memory System 

Capability: Tracks and simulates long-term environmental changes 

Key Enhancement: Enables progressive development simulation 

Use Case: Industrial Equipment Maintenance

• Diagnostic simulation
• Maintenance impact tracking
• Lifecycle visualization 
• Impact: reduction in maintenance-related downtime

Courtesy of Google DeepMind Genie 2

Measurable Platform Improvements

The integration delivers unprecedented improvements:

• 99% reduction in content 3D creation time
• increase in learning effectiveness
• increase in scenario variety
• improvement in knowledge retention
• 60% reduction in training costs

This visionary integration redefines the boundaries of knowledge creation, sharing, and absorption, empowering educators, learners, and professionals with unprecedented tools to visualize and interact with complex concepts.

As the launch in early 2025 approaches, EON Reality reinforces its commitment to shaping the future of education and industry through innovation – learn more about it the press release.

With DeepMind’s cutting-edge AI and World Labs’ advanced spatial computing capabilities, the EON-XR platform promises to bridge gaps, foster global collaboration, and make learning more immersive and accessible than ever before. This is not just a step forward in technology—it is a leap toward a smarter, more connected world. Stay tuned as EON Reality continues to pioneer the transformation of how we learn and grow in the digital age.