Persona paves the way for a new era in live digital facial performance, one where human actors, digital characters and audiences can co-exist and interact. This is because Persona captures and translates an actor’s performance onto their digital counterpart, in real-time. Designed from the ground up for live performance, Persona enables immediate character animation in real-time engines such as Epic’s Unreal 4.
Persona supports multiple actors each wearing a bespoke HMC and on-body animation system facilitating a completely untethered performance and allowing the actor to move freely around the stage or volume.
What is Persona?
Persona is powered by Cubic Motion’s high fidelity, facial animation technologies. Technologies that have been proven at a host of live events including GDC and FMX and that won the 2016 Siggraph award for Real-Time Live. These advanced, proprietary computer vision techniques allow Persona to accurately capture an actor’s performance with stunning detail in order to bring digital characters to life.
The result is a system that can deliver animated characters who respond and engage with real-world events immediately, and whose performance may be interwoven with human actors. Providing a faithful reproduction of the actor’s performance whether for immediate broadcast at a live event or for character previsualisation during capture.
Persona supports multiple actors each wearing a bespoke Helmet-Mounted Camera (HMC) and on-body animation system facilitating a completely untethered performance. This allows the actor to move freely around the stage or performance volume.
The Persona HMC system is Cubic Motion’s proprietary design. It is optimised for comfort, stability and ease of use allowing Persona to deliver superb results over prolonged periods.
Persona‘s HMC carries Cubic Motion’s signature front-facing and profile camera configuration. This works in conjunction with the inbuilt infrared lighting to ensure the unambiguous recovery of even the most subtle mouth shapes and poses under a variety of environmental conditions.
The facial performance is captured and solved onto the character by the ‘Performance Pipeline’, an on-body computing appliance that is the heart of every actor’s setup. Each Performance Pipeline is simple to configure using our Identity System. This ensures a faithful representation of the actor’s performance is acquired and that an engaging and intimate portrayal of the character is delivered.
The Performance Pipeline also provides a full capture capability so that all video and animation data can be reused after the event or polished and finessed before final broadcast.
The pipeline is lightweight and battery powered. It may be tethered or wireless and comes with a flexible harness system giving uninhibited freedom to direct actors.
Performance Manager is a GUI application that allows operators to oversee all performances. It provides the ability to configure and monitor every aspect of an actor’s performance from a remote interface. Actors are automatically discovered by Performance Manager and single instance can be used to manage multiple actors simultaneously.
Cubic Motion’s Identity System allows a purpose-built tracking model for the actor to be matched with a bespoke solver model for the character rig. This is in a form that is ready to be used by Persona.
The Identities are constructed using state of the art machine learning algorithms. These analyse the appearance of the actor and the capabilities of the character rig in order to specifically tailor Persona for every unique human and digital character pairing.
Let your digital characters take center stage
Free your game and movie characters from the confines of their digital worlds. With Persona they can explode onto the stage at your next live event.
Connect with fans on social media
Let a human actor portray your digital character and make them interactive, responding and engaging to fans in real-time conversations. Use Persona to create short video replies from your characters or even host a live AMA event online!
Reuse your existing game and movie assets
Persona is able to drive a variety of digital character assets and rigs. You may not be far from seeing your character face-to-face.
Nothing like the real thing
With the astonishing fidelity that Persona provides it’s ready to drive the very best in digital humans. Why not fill your stage with famous faces including those no longer with us?
See what’s coming
Persona is not just the future of live digital performance but is also changing performance capture today as the perfect character previsualisation solution. Don’t just monitor a video of the actor, let Persona show you the character perform. Record both video and animation to ensure you leave the session with the complete performance ready for immediate review.
Our comprehensive user guide and resource centre is available to ensure you’re always getting the best out of Persona.
We also have a dedicated Support team available to answer any queries on the software or hardware.
Our embeddable software development kit for computer vision applications allows you to build your own models for computer vision.