US20260350930
2026-11-05
Physics
G06T19/006
The patent application details a system for enhancing live video streams with visual effects directly integrated into the video feed. The system involves devices, methods, and non-transitory program storage devices that enable real-time augmentation of video streams. This technology is particularly relevant for portable devices like smartphones and tablets, which are commonly used for video capture and streaming.
The process begins with an electronic device obtaining a video stream. Each image in the stream undergoes segmentation to distinguish between foreground and background. Depth values are assigned to these segments, and visual effects are added with their own depth values. These elements are then composited to create an augmented image that can be displayed or transmitted to another device.
This technology is applicable in videoconferencing and other audiovisual content sharing. It allows users to leverage high-quality image capture devices, potentially separate from the streaming device, enhancing the quality of shared video. The system supports various visual effects, including virtual lighting and graphical windows, improving the overall experience of live video communication.
The system offers several enhancements, such as improved resolution and audiovisual synchronization, particularly beneficial when combining content from multiple sources. Visual effects can include virtual lighting, graphical content, and even reactions of human subjects captured in the scene. These effects are depth-aware, allowing for a more realistic integration into the video stream.
The flexibility of the system is evident in its ability to connect with image capture devices through wired or wireless means, or via integration into the device itself. The technology supports various configurations, allowing for custom visual effects and enhancements tailored to specific needs, such as adjusting audio timing for synchronized playback across devices.