Invention Title:

CROSS-REALITY DEVICE, STORAGE MEDIUM, PROCESSING DEVICE, GENERATION METHOD, AND PROCESSING METHOD

Publication number:

US20250123678

Publication date:

2025-04-17

Section:

Physics

Class:

G06F3/011

Inventors:

Hiroaki NAKAMURA Kawasaki Kanagawa, Japan

Yoshiyuki HIRAHARA Mishima Shizuoka, Japan

Takanori YOSHII Kawasaki Kanagawa, Japan

Takehiro KATO Yokohama Kanagawa, Japan

Yasuo NAMIOKA Nerima Tokyo, Japan

Kyotaro HAYASHI Yokohama Kanagawa, Japan

Applicant:

KABUSHIKI KAISHA TOSHIBA Tokyo, Japan

Smart overview of the Invention

The cross-reality device integrates an imaging device, a display device, and a processing device to facilitate interaction within a virtual space. The imaging device captures images, while the display device presents a virtual environment. The processing device identifies hand movements from the images and generates virtual objects in response to user commands. It can also adjust the position and size of these objects based on hand movements.

Field of Application

This technology pertains to cross-reality devices, including mixed reality (MR), virtual reality (VR), augmented reality (AR), and substitutional reality (SR) devices. These devices enhance task performance by displaying virtual objects. The invention addresses the need for more accessible creation and manipulation of virtual objects within these environments.

System Components

Key components of the system include a processing device, imaging device, display device, input device, and storage device. The processing device handles tasks like detecting hands in images, interpreting commands, and managing virtual objects. The imaging device continuously captures body images, while the display device shows the virtual space. User inputs are received through various input devices, including microphones and gesture recognition.

Functionality

The processing system operates by acquiring images and detecting hand gestures or voice commands. It uses these inputs to generate or modify virtual objects within the displayed environment. The system includes features like hand tracking and voice recognition to interpret user interactions effectively, allowing dynamic adjustments of virtual objects based on detected gestures or spoken commands.

Implementation Example

An example implementation is a mixed reality (MR) device featuring components like projection devices, cameras, sensors, and microphones integrated into a head-mounted display. This setup allows users to interact with a superimposed virtual space over their real-world view. The MR device projects information onto lenses that are transparent, enabling users to see both the real environment and overlaid virtual elements.