ROUTE GUIDANCE DEVICE AND ROUTE GUIDANCE SYSTEM BASED ON AUGMENTED REALITY AND MIXED REALITY

Smart overview of the Invention

The route guidance device integrates mixed reality (MR) and augmented reality (AR) technologies to enhance navigation for vehicles. It includes a mixed reality module that renders MR information, such as virtual objects and vehicle representations, based on map data. This is combined with an interface unit that interacts with the vehicle's systems, allowing a processor to manage the MR module and display relevant MR imagery on the vehicle's display. This integration aims to present a virtual vehicle leading the actual vehicle along a designated route, improving navigation accuracy and user experience.

Technical Challenges

Current AR technologies face limitations, especially in adverse weather or complex traffic situations, where cameras may not accurately capture real-world images. Issues such as rain, snow, or shadows can obscure lane recognition, leading to discrepancies between AR objects and the actual environment. Moreover, AR struggles with accurately displaying objects on roads with varying elevations or complex curves. These challenges necessitate the development of MR technologies that can simulate environments using digital twin technology to provide more reliable navigation information.

Mixed Reality Advantages

MR technology offers several advantages over traditional AR by using a digitized 3D map to display virtual objects. This approach reduces reliance on real-world images, mitigating discrepancies caused by environmental complexities. MR can present detailed vehicle-related information, even for routes previously unexplored by the driver, by simulating a bird's-eye view or other advantageous perspectives. However, MR also faces challenges in perfectly replicating real-world environments, particularly for smaller objects like people or animals, which limits its ability to fully replace AR.

Solution Approach

The disclosed system addresses these challenges by combining AR and MR to compensate for each technology's limitations. It enhances AR visibility and supplements it with MR when AR is insufficient. The system provides comprehensive information both within and outside the driver's immediate field of view, leveraging cloud-based data and vehicle sensors to dynamically adjust the displayed imagery. This ensures accurate and reliable route guidance, regardless of environmental conditions or route complexity.

System Functionality

The device's processor plays a crucial role in determining the appropriate view image based on various factors such as road type, conditions, time, weather, and traffic situations. It dynamically switches between AR and MR views to best match the vehicle's traveling situation. For instance, during straightforward travel, AR views are prioritized, but in complex scenarios like junctions or poor visibility, MR views are employed. The system also calculates road curvature and slope variations to optimize AR object fitting, ensuring accurate navigation guidance.