Sony, Spatial Content System Showcased

CES2024

Sony develops immersive spatial content production system. Equipped with a high-definition XR head-mounted display, enabling intuitive interaction in virtual space [CES2024]

Sony has developed an immersive display that supports advanced creative work in spatial content production, with an XR head-mounted display equipped with a high-resolution 4K OLED microdisplay and video see-through function, and a controller optimized for precise manipulation of 3D objects. Developed a spatial content production system. This system is scheduled to be released in 2024. Detailed release dates, regions, prices, sales channels, specifications, and compatibility with each software will be announced by Sony and each partner in the future.

The spatial content production system is equipped with a 4K OLED microdisplay and unique rendering technology, making it possible to express the texture of 3D objects and human facial expressions in real time and in high definition. In addition to video see-through and spatial recognition functions using a total of six cameras and sensors, a ring-type controller that allows users to intuitively manipulate objects in virtual space and a pointing controller. It is possible to work using a keyboard while wearing a head-mounted display.

Intuitive operation with Ring Controller (image)

Accurate spatial point specification using pointing controller (image)

Sony Develops Spatial Content System

This system allows users to create and modify 3D models, which would be difficult to do with a general-purpose controller, while checking the full-size model in an XR environment using a high-definition display. In addition, it supports simultaneous reviews between remote locations by linking with applications, allowing users to work through a series of processes in an intuitive and immersive environment while wearing this system.

The platform uses the latest XR processor, Snapdragon XR2+ Gen 2, manufactured by Qualcomm Technologies, Inc. It supports a high-quality video experience with a 4K OLED microdisplay and a seamless XR experience with a spatial recognition function, and is designed to meet the high performance standards required by creators’ production workflows.

Mocopi – Motion Capture system

Sony is developing the mobile motion capture “mocopi,” an app that realizes motion capture and real-time motion input into VR using only a small, lightweight sensor using proprietary technology and a dedicated application for smartphones, as well as realistic 3D video (3DCG). By introducing this system and related software technology, and collaborating with 3D production software development partners, the company aims to create an immersive spatial content creation experience that allows creators to seamlessly move between reality and virtual space.

Cedric Naike, Member of the Board of Management and CEO of Digital Industries, Siemens AG, had the following to say related to the development of Sony’s Spatial Content prgrams:

Siemens collaborates with Sony to enable immersive engineering, a key cornerstone of the industrial metaverse. By providing an environment where customers can experience real-world physics without time constraints, we fundamentally transform the way our customers work and collaborate.

Saeed Bakadir, Senior Director of XR Product Management, Qualcomm Technologies, Inc., commented:

Sony introduces spatial content production system for industry, supporting developers and creators in pursuing immersive production experiences with more realistic, high-definition, intuitive and accurate MR/VR experiences using the Snapdragon XR platform. It is exciting times indeed.