US20260014865
2026-01-15
Performing operations; transporting
B60K35/28
A system is proposed to enhance driver awareness using hybrid augmented reality head-up displays. It processes sensor data from a vehicle's environment, identifying vulnerable road users like pedestrians and cyclists, even those outside the driver's line of sight. By classifying these users and assessing potential threats, the system provides graphical alerts to the driver via augmented reality overlays and virtual images on the vehicle's windshield.
The system receives data from various sensors, including cameras, RADAR, and LIDAR, to detect road users outside the driver's view. It classifies these users and determines their locations relative to the vehicle. The system assesses threat levels by evaluating the distance and trajectory between the vehicle and the road users, generating alerts that help drivers make informed decisions.
The head-up display system includes both augmented reality and blackout displays. Alerts are projected onto the windshield, with augmented reality images on clear sections and virtual images on blackout sections. This method ensures that drivers receive timely and relevant information without distraction, integrating seamlessly with their natural line of sight.
The system integrates multiple sensor types to enhance detection accuracy. It calculates vehicle trajectories and distances to predict interactions with road users, adjusting threat assessments accordingly. This proactive approach provides drivers with early warnings, enabling them to take corrective actions promptly.
Advanced processing hardware and software algorithms, potentially utilizing large language models, are employed for classifying road users from sensor data. This technology reduces bias in threat assessment and improves safety by highlighting users that might otherwise go unnoticed, offering a significant advancement in vehicle safety systems.