Sony has an interesting product called Mocopi, which consists of six motion-tracking tapes worn on the arms, legs, back and head, and costs 49,500 yen (about $358). The goal is to allow you to track your body to create videos or control avatars in real time using metaverse apps like VRChat. It even provides an SDK that allows you to import motion data into 3D animation applications.
According to Sony, Mocopi’s six color-coded lightweight motion sensors appear to be a play on the term “mocap” (motion capture) using “proprietary technology and smartphones” and a dedicated app. “Typically, video production using motion capture requires special equipment and operators,” writes Sony. “Using our proprietary algorithm, Mocopi provides highly accurate motion measurement using a small number of sensors, freeing VTubers [virtual YouTubers] and film and animation makers from the constraints of time and place.”
On December 15, Sony will provide a software development kit (SDK) for connecting motion capture data to metaverse services, as well as the Unity real-time development platform and Autodesk’s MotionBuilder animation and motion capture application. “The SDK expands the use of motion data for activities such as full-body tracking, enabling the development of new services in areas such as the metaverse and fitness.”
In the how-to video (below), Sony shows you how to pair the sensors with the app, tether them to your body, and calibrate them. From there, you can start dancing or doing other moves and see how the app’s avatar mimics your movements. The second video shows some of the avatar animations (above) that look good but expose typical mocap issues like shaking and sliding legs.
This is an ambitious product, not only for those interested in the Metaverse, but also for animation professionals and filmmakers. Sony says that if your device is running iOS 15.7.1 or Android 11, you can use existing VRM avatars and export recorded videos as MP4. Pre-orders will begin in mid-December 2022 and sales will begin in late December-January 2023, but availability in North America is not yet known.
Post time: Jan-16-2023