Sony is actively working on implementing generative AI in its PlayStation games, creating prototypes of characters that can interact with players. A version featuring an AI-powered Aloy character from Horizon Forbidden West was recently demonstrated, capable of holding a conversation with the player using voice prompts. This prototype was developed in collaboration with Guerrilla Games and is currently only an internal technology demonstration.
To create dialogues, Sony uses OpenAI Whisper technology for speech-to-text conversion, as well as GPT-4 and Llama 3 for conversation and decision-making. Sony also employs its proprietary Emotional Voice Synthesis system for speech generation and the Mockingbird technology for facial animation. Although the demonstration took place on a PC, the company is experimenting with the possibility of running parts of this technology directly on PS5 consoles.
Sony’s developments draw attention to the role of AI in video game creation, especially ahead of the Game Developers Conference in San Francisco. Such technologies could significantly change the game development process, from scripting to character interaction, sparking interest and discussion in the gaming industry.
Other companies, such as Nvidia and Microsoft, are also exploring the possibilities of generative AI in video games. Nvidia has already introduced its Ace technology, which enables free-form conversations with game characters, while Microsoft is partnering with Inworld AI to bring AI-powered characters to Xbox platforms.
