METHOD AND APPARATUS FOR IMPLEMENTING ENHANCED VIRTUAL DIGITAL REPRESENTATION IN METAVERSE

Smart overview of the Invention

The invention focuses on enhancing virtual digital representation within the metaverse by leveraging artificial intelligence technologies. It emphasizes the monitoring of virtual digital objects and user interactions, determining when these interactions should occur, and utilizing virtual avatars to facilitate communication. This approach aims to improve user experience by reducing the need for specialized knowledge and enabling more intelligent and proactive interactions.

Background and Challenges

Digital twins, which are virtual representations of physical objects or systems, have seen widespread use in various sectors such as industry, agriculture, and healthcare. However, current implementations often require users to have a high level of expertise to interpret data and interact effectively. Additionally, interactions tend to be passive, lacking the dynamic and intuitive qualities of human communication. These limitations highlight the need for more intelligent and accessible digital twin technologies.

Proposed Method

The method involves monitoring the attributes of virtual digital objects and user information, obtaining state decision data, and determining the necessity of user interactions. If interaction is deemed necessary, the system uses virtual avatars to communicate state decision data to users. This process includes identifying scenario types and user roles, and customizing avatar characteristics to enhance the interaction experience.

Technical Implementation

• State decision data can include current and future state data, requirements, or suggestions.
• Interactions are facilitated through a virtual avatar generator and a user dialog system, incorporating technologies like natural language understanding and speech synthesis.
• The system can customize avatars' appearance, pose, emotional expression, and voice based on scenario and user role.
• Attribute information of virtual objects is derived from self-features and environmental features, with state data inferred using knowledge bases or pre-trained models.

Interaction Dynamics

Determining when to trigger interactions involves assessing abnormal states or proximity between users and virtual objects. The system dynamically updates avatars' dialogue and style based on ongoing interactions, ensuring a responsive and engaging user experience. This intelligent interaction framework aims to bridge the gap between virtual and real-world communications, making digital twin technologies more accessible and effective.