US20260170772
2026-06-18
Physics
G06T19/006
The invention addresses the need for real-time volumetric telepresence, enabling users to communicate as if co-located in augmented or mixed reality environments. It captures a live 3D representation of a person and transmits the data to a remote location, rendering the person as a spatially anchored hologram. This system allows participants to interact naturally through speech, gesture, and motion, maintaining true scale and spatial alignment.
A network of depth-sensing cameras surrounds a capture zone to collect synchronized depth and color data of a person. A processing subsystem fuses this data to create a volumetric representation, compressing and encoding it for transmission. The remote AR or MR display device decodes this data, rendering a holographic image that aligns with the viewer's local environment.
The system ensures geometric consistency between physical and virtual spaces using positional anchors, fiducial markers, or depth registration algorithms. This alignment allows for bidirectional holographic communication, where each participant is rendered as a volumetric hologram visible to the other. The system supports low-latency transmission to maintain natural interaction.
The system can incorporate auxiliary digital content, like 2D or 3D images or medical data, into the spatial environment. Participants can interact with this content using gestures or voice commands while maintaining visual contact with the holographic representation. This feature enables collaborative review and manipulation of shared digital materials.
The system dynamically adjusts calibration parameters to compensate for environmental changes, ensuring the hologram remains accurately rendered. It uses motion-prediction filtering to reduce jitter and adjusts hologram lighting to match ambient conditions. The display device supports six-degree-of-freedom parallax, preserving depth perception and perspective for the viewer.