US20260245304
2026-08-20
Physics
G06T17/05
The invention introduces a route guidance device and system that leverages augmented reality (AR) and mixed reality (MR) technologies to enhance vehicle navigation. It comprises a transceiver and receiver for communication with a vehicle and a cloud server, an interface unit for receiving environmental images and vehicle state information, an AR engine for rendering AR views, and a MR engine for mixed reality views. A processor identifies the appropriate view image for the current driving situation and controls the display of these images on the vehicle's screen.
Recent advancements in AR technology have enabled the display of graphic objects through vehicle windshields or head-up displays (HUDs), providing drivers with intuitive information about their surroundings and driving conditions. However, AR's reliance on real-world images can lead to inaccuracies in adverse weather or complex traffic conditions. Mixed reality (MR) technology, which uses digital twin simulations, offers an alternative by providing consistent information regardless of real-world image quality, but it struggles with accurately representing smaller or dynamic objects.
The invention addresses the limitations of both AR and MR technologies by integrating them into a single system. It compensates for AR's shortcomings with MR's strengths, offering reliable path navigation even when AR is less effective. The system can enhance visibility and provide comprehensive information about objects within and beyond the driver's current viewing angle, improving overall navigation accuracy.
The route guidance device includes a telecommunication unit for cloud server communication, an interface unit for receiving vehicle environment images, and an AR module for rendering AR information. A digital twin image generating unit creates MR images with virtual objects based on real-world data. The processor manages the display of AR or MR images, switching views based on driving conditions such as road type, weather, traffic congestion, and vehicle speed.
The processor dynamically adjusts the display according to various factors, such as whether the vehicle is on a highway or city road, road conditions, time of day, weather, and traffic congestion. It also considers potential collision warnings and adjusts the view based on the vehicle's driving path, switching between AR and MR images as necessary to provide the most relevant navigation information.