Invention Title:

REAL TIME VOICE MODE GENERATIVE RESPONSE ENGINE WITH INTERRUPTION DETECTION

Publication number:

US20260311693

Publication date:
Section:

Physics

Class:

G10L15/22

Inventors:

Assignee:

Applicant:

Smart overview of the Invention

The technology focuses on enhancing real-time interactions with generative response engines, particularly in speech-based applications. It aims to deliver more natural and dynamic user experiences by addressing challenges such as latency and interruptions. The system can transmit audio frames to a generative response engine and detect interruptions, allowing for adjustments in the response to align better with user intent.

Challenges in Speech-Based Interactions

Generative response engines have traditionally excelled in text-based tasks but face difficulties in real-time speech interactions. Human speech often includes pauses and interruptions, complicating the identification of complete speech instances. High latency can disrupt the conversation flow, making interactions feel less natural. Optimizing server infrastructure and model efficiency is crucial to reduce latency and enhance user experience.

Limitations of Conventional Methods

Traditional sliding window-based algorithms for speech detection add latency and may not accurately capture the end of a speech instance. They can either delay response time or prematurely end speech detection, leading to incomplete user input. Additionally, generative response engines typically process input as discrete messages, lacking the ability to handle mid-sentence interruptions effectively.

Innovations in Real-Time Mode

The system introduces dynamic speech detection by identifying silence and determining if the input represents a complete thought. It can incorporate video frames selectively to provide context without overwhelming the engine. An interruption detection engine enhances conversation quality by allowing the generative response engine to adjust or halt responses based on user interruptions.

System Components and Interaction

Users interact with the generative response engine through a front-end interface, which includes graphical user interfaces and APIs. These components facilitate communication and presentation of responses. The generative response engine, capable of generating various content types, interfaces with users and applications, ensuring seamless interaction and response delivery.