PREDICTIVE EXTENDED REALITY SYSTEM

Smart overview of the Invention

The invention focuses on enhancing extended reality (XR) systems by predicting user and device movements to improve responsiveness. It utilizes a server-based method to process brain machine interface (BMI) data and position data from XR devices. This data is used to compute pose predictions for future time frames, allowing the system to prepare XR pre-frames that are sent back to the XR device, thereby enhancing the user experience by reducing latency.

Technical Field

The system is part of the extended reality field, which encompasses augmented reality (AR), virtual reality (VR), and mixed reality (MR). Each type offers different levels of interaction with digital and physical environments, providing users with immersive experiences. The invention specifically addresses the prediction of XR headset movements to improve real-time responsiveness and interaction quality in XR environments.

Background

Extended reality (XR) combines real and virtual environments using various technologies. AR overlays digital content on the real world, VR creates entirely simulated environments, and MR integrates digital effects into the real world with enhanced interaction. XR devices, equipped with displays and sensors, facilitate these experiences by mapping and tracking the environment and user movements.

System Functionality

The server application receives BMI and position data from XR devices to compute future pose predictions. Using these predictions, it generates XR pre-frames for upcoming time frames and sends them to the XR device. The XR device then matches the current pose with the predicted pose and renders the XR pre-frame accordingly, ensuring a seamless and immersive experience.

Implementation

The system can be implemented in various computing environments, including software-defined networking (SDN) and network function virtualization (NFV) networks. It involves a combination of hardware and software components, such as processors and non-transitory computer-readable storage media, to execute the server application. The invention's modular design allows for integration with existing XR systems, enhancing their performance through accurate movement prediction and timely data delivery.