Sony's Leaked Video Reveals AI-Driven Aloy Prototype for PlayStation

A leaked internal video has revealed that Sony is exploring the realm of AI-powered PlayStation characters, sparking intrigue and discussion across the gaming community. The Verge reported on this development, showcasing a video created by PlayStation Studios' advanced technology group. The video, which featured Aloy from the Horizon series, was quickly pulled from YouTube due to a copyright claim by Muso, a company that works with Sony Interactive Entertainment, suggesting its authenticity. IGN has reached out to Sony for further clarification on this matter.

In the video, Sharwin Raghoebardajal, Sony Interactive Entertainment's director of software engineering, engages in a conversation with an AI-powered Aloy. This interaction is facilitated through voice prompts, with the AI employing OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) system for speech, and Sony's Mockingbird technology for facial animations. During their exchange, Aloy discusses her condition and her quest to find her mother, showcasing the AI's ability to handle nuanced conversation topics.

Despite the technological prowess on display, the AI-generated voice of Aloy does not match the original voice actress, Ashly Burch, and instead sounds robotic. Additionally, the facial animations appear stiff, highlighting the challenges of achieving lifelike character interactions with current AI technology. The demo also transitions into the world of Horizon Forbidden West, where Raghoebardajal continues the conversation while playing the game, adding an intriguing layer to the player-character dynamic.

This demo is described as a prototype developed in collaboration with Horizon studio Guerrilla Games to showcase internal tech capabilities. Raghoebardajal emphasizes that this is merely a "glimpse of what is possible," yet Sony has not confirmed plans to integrate this technology into public PlayStation products. It's noteworthy, however, that Sony's competitors, such as Microsoft with its AI Muse for game design, are also heavily investing in AI technology.

The broader context of AI in gaming is marked by both enthusiasm and criticism. Generative AI has become a focal point in the entertainment industry, despite facing significant layoffs. Companies like Keywords Studios have attempted to create games using AI but faced setbacks due to AI's limitations in replacing human creativity. Meanwhile, giants like EA and Capcom are actively exploring AI's potential for enhancing game environments and personalization.

Asad Qizilbash, head of PlayStation Productions and product at PlayStation Studios, highlighted the importance of AI in catering to the personalization demands of Gen Z and Gen Alpha gamers. He suggested that AI could enable non-player characters to interact more personally with players, enhancing the gaming experience for these digitally native generations.

Recent examples of AI integration in gaming include Activision's use of generative AI for Call of Duty: Black Ops 6 assets, which faced backlash due to an AI-generated "zombie Santa" loading screen. This underscores the ongoing debate about the role and impact of AI in video game development and player experience.

What's The Best PlayStation 5 Game?

Pick a winner

New duel1ST2ND3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results