CES2025
At CES 2025, Sony unveiled a new solution called XYN to support spatial content production. By introducing Sony’s proprietary technology, it is possible to accurately capture the space. XYN is also planned to be incorporated into a wide range of external tools and existing workflows.
What is XYN?
The introduction of XYN will enable the capture of the real world and the movements of people in it, as well as the reproduction and display of spaces, and the realization of interactions between people in the virtual world and the real world.
The target users are spatial content creators, and this solution will be expanded to creators active around the world, not only in the entertainment field but also in the industrial field and elsewhere.
The goal is to make it easier and more convenient for a wide range of people, not just sound creators, CG creators, and motion creators, but also companies, local governments, and others to create 3D.
In current production sites, the creation of 3DCG assets and motions requires a lot of man-hours. The production process is time-consuming, the quality is prone to inconsistency, and there are various limitations in the confirmation process. Another major issue is the limited performance of hardware.
XYN provides a solution to these issues. In terms of production, it offers a means to achieve highly efficient and high-quality asset production, and in terms of review, it enables more reliable review with vivid spatial representation and intuitive operability.
Based on this concept, Sony is announcing three products: “XYN Spatial Capture Solution,” “XYN Motion Studio,” and “XYN Headset.”
XYN Headset Unveiling from Sony
The first product announced was the development of the XYN Headset. At CES in January 2024, Sony Imaging announced the development of the XR head-mounted display “SRH-S1”. At this year’s CES, the company announced the development of a new headset, the “XYN Headset”. The SRH-S1 was a 3D CAD compatible headset compatible with Siemens’ NX software, but the XYN Headset will expand the target market to include entertainment and industrial fields.
In the entertainment field, it can be applied as a new workflow for CG production, previsualization on film production sites, and work confirmation. In the industrial field, the headset can be used at various stages, such as design confirmation, in-factory simulation, and operation training. All of these are defined as spatial content, and will be released as a new headset under the XYN brand.
Key features include a 4K OLED microdisplay, mixed reality functionality with video see-through functionality, and compatibility with a variety of 3D production software. Based on the same technology as the SRH-S1, it is planned to be expanded into new fields. This is a development announcement, and detailed specifications have not yet been announced. They will be released separately at a later date.
Spatial Content Development
The second product is a solution that generates CG that realistically reproduces real-world objects and spaces from images taken with a mirrorless camera or other device. Sony’s unique generation algorithm allows it to generate high-quality CG never before seen, and it provides a photography assistant app that enables anyone to easily take high-quality photos. In addition, it strengthens the connection with existing headsets and spatial reproduction displays to achieve a seamless workflow. Although detailed specifications and functions were not disclosed at the time of announcement, the generated 3D CG is so realistic that it is indistinguishable from photographs and videos, and can be reproduced as a three-dimensional space.
This technology can be used for creating background CG for virtual productions. It is also expected to be used for a wide range of purposes, such as prop shooting for movies and games, digital twin simulation, and digital archiving of valuable artworks. It can also be used to digitize and exhibit valuable artworks as a high-quality digital archive. This solution is scheduled for a beta release in 2025, and will be gradually released with the aim of commercialization.
“mocopi” Professional Mode and “XYN Motion Studio” Unveiled
mocopi is a mobile system that allows you to easily capture motion anywhere. mocopi aims to make motion capture accessible to many people and allow them to express themselves freely in the metaverse. It is especially used by VTubers and VRChat users.
Since its release, it has been updated every three months to enhance its features for VTubers and VRChat users. As a result of the repeated enhancements to its features for creators, it has come to be used in many production sites. However, there has also been an increasing demand for direct operation on a PC, more precise capture, and motion editing functions.
In this update, both the software and hardware of “XYN” have been revamped. mocopi is equipped with a professional mode, and by linking it with software called XYN Motion Studio, more advanced motion capture is possible.
In professional mode, mocopi now provides an environment where up to 12 sensors can be connected to a PC. Previously, mocopi used a smartphone as a receiver, but in professional mode, a dedicated receiver has been introduced to enable stable connection of 12 sensors. In addition, “XYN Motion Studio” will be introduced as the PC software.
Samples
XYN Motion Studio has two main functions. The capture function utilizes a PC environment to capture up to 12 points of motion with greater precision. In addition to the traditional head, waist, wrists, and ankles, sensors can now be attached to both arms and under the thighs, and even the backs of the hands and feet by changing the mode, allowing for more detailed motion capture.
After shooting the motion, the editing function becomes very important. Like a normal video editing software, you can arrange the shot motion on a timeline and easily perform operations such as editing and trimming.
Furthermore, by utilizing the motion generation technology developed with mocopi, advanced editing such as smoothly connecting the gaps between two motions will also be possible.
Breakdown of mocopi
*This screen is currently in the development stage, and specifications and design may be changed or updated in the future.The motions created can be backed up to a cloud-based motion database, and by tagging motions, users can efficiently search and use them with automatic classification by Sony’s algorithm.
Release Dates
The mocopi sensor data receiver, mocopi sensor band, and XYN Motion Studio are scheduled to be released in late March. The prices are as follows:
Product name | Model name | release date | price |
PC app “XYZ Motion Studio” | Late March | Monthly fee of 1,100 yen (tax included) (subscription) * Compatible with Microsoft Windows. Available for purchase at the Microsoft Store. |
|
mocopi sensor data receiver | QM-PR1 | Late March | 16,500 yen (tax included) Sony Store sales price |
mocopi sensor band | QM-PB1 | Late March | 9,900 yen (tax included) Sony Store sales price |
Mobile motion capture “mocopi” | QM-SS1 | Available now | Open price Reference: Selling price at Sony Store: 49,500 yen including tax |