US20260182727
2026-07-02
Human necessities
A45D44/005
The patent application describes a system and method for providing a virtual try-on (VTO) experience for hairstyles using generative artificial intelligence (Gen AI). This system leverages a diffusion-based Gen AI model and a conditioning network to generate realistic hairstyle images on a user's face. The process involves using conditioning images, including a hairstyle mask and an edge detection result, to guide the shape and structure of the new hairstyle. These conditioning images are derived from a 3D model of a sample hairstyle, which is aligned with the user's face pose to ensure accuracy.
A computing system is configured with processors and storage devices that execute instructions to invoke the Gen AI model. The model receives an image of the user's face along with conditioning images to generate a new hairstyle. The process includes removing the existing hairstyle from the image using a dilated hair mask and inpainting techniques. The Gen AI model, which includes a diffusion-based model and a conditioning network, responds to spatial conditioning to produce the desired hairstyle effect. Text-based prompts can also be used to control the generation process.
The system architecture includes one or more computing devices, such as smartphones or tablets, and servers that provide web or cloud-based services. The VTO experience is delivered as a service via a client/server model, where the user's device communicates with a server over a network. The user's device captures an initial image, which is then processed by the server to simulate a new hairstyle. Users can select sample hairstyles from a database, which are represented in 3D models stored in a data store.
The user interface allows users to select from various hairstyle options and colors to virtually try on. The interface presents images of sample hairstyles, enabling users to make selections through intuitive inputs. The system also offers additional features, such as recommending hair products or salons and facilitating e-commerce transactions for purchasing hair products. This enhances the overall user experience by providing comprehensive solutions related to hair styling.
The described system provides a more controlled and realistic VTO experience compared to traditional methods. It addresses challenges such as simulating difficult hair transitions and offers precise control over the hairstyle outcome. This technology allows users to make informed decisions about new hairstyles before visiting a salon, thereby enhancing satisfaction and reducing the risk of undesirable results. The integration of Gen AI ensures photorealistic outputs, making the virtual try-on experience both practical and appealing.