Ubisoft Unveils a Groundbreaking Prototype: Game Play with Voice-Activated AI Allies

Ubisoft has unveiled an innovative game prototype called “Teammates,” which features voice-controlled AI companions that can process visual context and understand natural language. This project builds on the Neo NPCs showcased in collaboration with Nvidia in 2024 and aims to create AI that engages more authentically with players. A significant advancement this time around is that Teammates is currently undergoing closed playtests with a select group of “a few hundred players,” as stated by Ubisoft.

Even though Ubisoft refers to Teammates as a playable “experimental research project,” it utilizes foundational concepts from the first-person shooter genre. Players assume the role of a resistance fighter navigating through an enemy stronghold to rescue five lost team members. Effectively directing AI characters is crucial for accomplishing mission objectives. The prototype features three AI NPCs: “Jaspar,” an AI assistant knowledgeable about game lore and flexible enough to adjust settings in real-time, alongside “Pablo” and “Sofia,” robotic characters who interact based on player commands.

Jaspar acts as both a character within the story and an external guide in Teammates. (Ubisoft)

Video clips provided to Engadget reveal that Ubisoft’s AI not only comprehends vocal instructions but also recognizes the player’s visual focus. For instance, when instructed to “stand behind a barrel,” Sofia exhibits the capability to consider the player’s line of sight and situate itself accordingly. In the closed playtest version of Teammates, Jaspar serves to onboard players, introducing them to game fundamentals. While the AI characters tend to be quite talkative, Ubisoft is experimenting with personalization options, including traits for Sofia and Pablo—one intriguing option labeled “Bad Cat and Good Boy”—for varied character expressions.

“This technology opens doors to unique, tailored experiences,” stated Ubisoft’s Data & AI Director, Rémi Labory, during the announcement of Teammates. “Player choices influence character responses in real time, something traditional game development cannot replicate. We’re also offering a complete experience pipeline that guides players from onboarding to debriefing, an industry first.”

Ubisoft has also delved into generative AI for other development processes previously. The company’s Ghostwriter tool, launched in 2023, employs AI to create initial drafts of in-game dialogue. Recently, Ubisoft admitted to releasing Anno 117: Pax Romana with AI-generated loading screen artwork, highlighting its ongoing commitment to integrating AI.

Looking ahead, the technology behind Teammates could find its way into future Ubisoft projects. The company is actively gathering feedback from playtest participants to enhance future endeavors. With the middleware developed for Teammates already compatible with both the Snowdrop and Anvil engines, the potential for its adoption by other development teams is promising.