disguise and Move.ai unveil Invisible real-time markerless motion capture solution
Invisible, a complete technology bundle for real-time markerless motion capture developed by disguise in partnership with Move.ai, is now available. Removing the need for markers, wearable suits or long calibration set ups, the Invisible solution allows anyone to mirror their movements onto a character rig within disguise’s Designer software in real time.
The solution – which can track up to two people at once – leverages Move.ai’s patented Invisible real-time markerless mocap software to extract natural human motion from video using advanced AI.
Whether it’s for a live broadcast watched by millions, a concert crossing into the metaverse, or the latest feature film, creative teams can leverage the Invisible solution to stand out to audiences in new ways. For broadcasters, the motion capture data can be used to drive gesture-triggered graphs and scene changes or accurate shadows for talent on set. For filmmakers, it enables the capture of 3D characters that seamlessly interact with real actors or even drive movement-triggered effects like smoke and fire. For live event companies, the Invisible solution can transport performers into a game universe with avatars that instantly replicate their movements, without restrictive and expensive mocap suits.
No compromises need be made to creative vision, with motion capture data directly integrated into disguise Designer software for complete control and visibility throughout production. The Invisible software integrates with the scalable processing capabilities of disguise hardware, ensuring a high-fidelity real-time output to LED stages and virtual production volumes of various sizes.
To demonstrate the integration that stems from the disguise and Move.ai partnership, experimental creative studio FutureDeluxe took its multi-platform Spirits 3.0 avatars into Unreal Engine. It then built a custom environment for an interactive, markerless motion capture experience on stage at Cannes Film Festival earlier this month.
Svet Lapcheva, executive producer/client partner at FutureDeluxe, said: “We’re exceptionally excited to have created the demo for the Invisible solution showcase at Cannes. Working directly with disguise and Move.ai allowed us to create a visual experience which looked and worked brilliantly thanks to the seamless integration between both platforms. Markerless motion tracking in Unreal Engine opens up vast creative possibilities that allow directors, designers and artists to achieve much more and in a faster and more reliable way, while seeing a final quality product at every stage of creation.”
The Invisible solution is a bundled offering supported exclusively by disguise. It includes disguise MX Move data processing hardware, purpose-built to run the Invisible software; FLIR Blackfly S GigE machine vision cameras; Tamron 2.8mm, Goyo 3.5mm or LCM 4mm fixed focal length camera lenses, depending on the size of the LED volume; and a Netgear MS510TXPP network switch, supplying power over Ethernet for the cameras.
The bundle is now available and comes in three different sizes – small, medium and large – depending on setup size and the number of performers that need to be tracked. To enable real-time markerless motion capture with the Invisible solution, a minimum of one disguise vx or gx machine is also needed for graphics processing and one disguise rx II for real-time rendering.