A leaked internal video has surfaced, revealing that Sony is actively exploring the use of AI-powered characters in PlayStation games. The Verge reported on the video, which was created by PlayStation Studios' advanced technology group and features Aloy from the Horizon series. The video, which was briefly available on YouTube before being removed due to a copyright claim by Muso (a company associated with Sony Interactive Entertainment), showcases a conversation between Sony Interactive Entertainment's director of software engineering, Sharwin Raghoebardajal, and an AI-powered version of Aloy.

The demonstration uses a variety of AI technologies: OpenAI's Whisper for speech-to-text conversion, GPT-4 and Llama 3 for generating dialogue and decision-making, Sony's Emotional Voice Synthesis (EVS) system for speech synthesis, and Sony's Mockingbird technology for facial animations. In the video, Raghoebardajal engages with Aloy, who responds to questions about her well-being and her journey in the Horizon narrative. However, the AI-generated voice and facial animations fall short of the quality provided by human voice actor Ashly Burch, resulting in a robotic tone and stiff, lifeless facial expressions.

The tech demo transitions into gameplay within the Horizon Forbidden West world, highlighting the potential for integrating AI characters into actual game environments. Despite the intriguing possibilities, Sony has not yet announced plans to implement this technology in any public-facing PlayStation products, and it remains uncertain whether it could be effectively integrated into PS5 games at this stage.

Sony's experimentation with AI aligns with broader industry trends, as competitors like Microsoft are also heavily investing in AI technologies, such as the recently announced Muse AI for game design. The use of generative AI in video games is a hot topic, particularly given the recent layoffs in the industry and the technology's mixed reception due to ethical, rights, and quality concerns. For instance, Keywords Studios' attempt to create a game using AI failed, and EA has emphasized AI as central to its business strategy. Capcom is also experimenting with AI to generate ideas for in-game environments.

Asad Qizilbash, head of PlayStation Productions and head of product at PlayStation Studios, emphasized the importance of AI in meeting the demands of younger gamers from Gen Z and Gen Alpha, who seek personalized and meaningful gaming experiences. This sentiment was echoed by Activision, which admitted using generative AI for some assets in Call of Duty: Black Ops 6, amidst controversy over an AI-generated loading screen.

What's The Best PlayStation 5 Game?

Pick a winner

New duel1ST2ND3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results