Sony Leaks AI-Powered PlayStation Prototype

A leaked internal video reveals Sony's exploration of AI-powered PlayStation characters. The Verge reported on a video, allegedly from PlayStation Studios' advanced technology group, showcasing AI-driven Aloy from the *Horizon* games. The video's subsequent removal from YouTube following a copyright claim from Muso (a company listing Sony Interactive Entertainment as a client) suggests its authenticity. IGN has reached out to Sony for comment.

The video, as detailed by The Verge, features Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, conversing with an AI-powered Aloy. The technology integrates OpenAI's Whisper for speech-to-text, GPT-4 and Llama 3 for dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) for speech, and Sony's Mockingbird technology for facial animation.

The conversation demonstrates Aloy's AI capabilities, responding naturally to Raghoebardajal's prompts. However, the AI Aloy's voice, unlike that of Ashly Burch (the game's voice actress), is robotic. Her facial animations are also stiff and unnatural. Despite this, the AI accurately reflects Aloy's backstory, including her discovery of being a clone of Dr. Elizabeth Sobeck.

The demo seamlessly transitions into *Horizon Forbidden West*'s game world, allowing Raghoebardajal to continue the conversation within the game environment. This integration, while innovative, highlights the somewhat jarring experience of conversing with a character one is simultaneously controlling, especially considering the thematic irony given *Horizon*'s narrative.

The prototype, developed with Guerrilla Games, serves as an internal demonstration of Sony's AI capabilities. While promising, Sony hasn't confirmed plans to integrate this technology into any public-facing PlayStation products, and its feasibility within current PS5 games remains unclear.

Sony's exploration of AI in gaming aligns with industry trends. Competitors like Microsoft (with its AI, Muse) are heavily invested in AI technology. The use of generative AI, however, faces criticism regarding ethical concerns, rights issues, and its ability to consistently produce high-quality, engaging content. Keywords Studios' failed AI-driven game development exemplifies these challenges.

Despite these challenges, major players like EA and Capcom are actively experimenting with generative AI. Asad Qizilbash, Head of PlayStation Productions and Head of Product at PlayStation Studios, emphasizes the importance of AI-driven personalization for younger Gen Z and Gen Alpha gamers, citing the potential for more engaging NPC interactions.

Activision's recent admission of using generative AI for some *Call of Duty: Black Ops 6* assets, amidst criticism over an AI-generated loading screen, further illustrates the complex landscape of AI integration in game development.

What's The Best PlayStation 5 Game?

Pick a winner