Skyrim Mod Powered by ChatGPT Gives NPCs Memories

A new mod for Skyrim allows for in-game NPCS to hold memories, and generate conversations with the player using ChatGPT. The gaming community has had a long fascination with creating immersive environments and realistic NPCs.

The ChatGPT-powered mod is so powerful, that communities online have taken notice, and is evidence that game studies aren’t the only ones in search of ways to use AI to create more engaging gaming experiences. You can see a short clip of the mod in action below:

For those unfamiliar with the game, Skyrim is a game that has been around for a long time but continues to be popular due to its vast open world and the dedicated modding community. With the advent of virtual reality, Skyrim VR offers an even more immersive experience than before. But now, the modder behind this latest AI-powered mod wanted to take immersion even further.

Using a combination of ChatGPT, xVASynth, and Whisper, the modder has created a memory system for each NPC that remembers past conversations with the player. ChatGPT is given the basic background of the character and asked to roleplay as them, while Whisper converts the player’s voice to text, which is then passed to the NPC to respond appropriately using ChatGPT. This system allows NPCs to recall previous encounters with the player, making conversations more realistic.

Additionally, the modder has used ChatGPT to create a system that summarizes the conversation upon exit so that each past conversation is remembered in a condensed form. While the AI is currently limited in its capabilities, it is a demonstration of what is possible in the future of gaming when it comes to adding variety and diversity to environments.

While this mod is currently limited to Skyrim, the community has suggested using ChatGPT in other games like Fallout, GTA, or Cyberpunk 2077 to create more immersive NPC encounters due to the open-world nature of those titles. The potential for this technology to revolutionize the gaming industry is vast.

But as reported, AI in gaming isn’t limited to just players and modding. Last year, Blizzard Entertainment patented software that would create custom music for players. Taking its cues from player actions, quests, progress, and other factors, the goal of the program was to build even more immersion for the player.

And it’s not just immersion that gaming companies are hoping AI can fill in roles. Earlier this year, Ubisoft introduced “Ghostwriter“, an AI-powered script writer to provide NPCs dialogue under the supervision of human writers.

Whether it’s through player communities, studios, or a mix, it seems that AI is poised to help further shape the gaming industry moving forward.

Originally posted on OpenDataScience.com

Read more data science articles on OpenDataScience.com, including tutorials and guides from beginner to advanced levels! Subscribe to our weekly newsletter here and receive the latest news every Thursday. You can also get data science training on-demand wherever you are with our Ai+ Training platform. Subscribe to our fast-growing Medium Publication too, the ODSC Journal, and inquire about becoming a writer.