A new Skyrim VR mod plugs into OpenAI’s ChatGPT to generate endless responses when talking to NPCs, and these conversations can be started with spells. xVASynth’s text-to-speech enables NPCs to be fully voiced, while Whisper’s speech-to-text lets players can talk into their microphone so the NPCs can understand them.
This mod was developed by ‘Art From The Machine’ and allows NPCs to remember previous conversations as well as events. In other words, ChatGPT can summarize the conversation on exit and condense it for future prompts. What’s next? The modder hopes to integrate LangChain, which chains together different components to create more advanced use cases around LLMs.
- Experience total immersion with 3D positional audio, hand tracking and easy-to-use controllers working together to make virtual worlds feel real.
- Explore an expanding universe of over 500 titles across gaming, fitness, social/multiplayer and entertainment, including exclusive releases and...
- Enjoy fast, smooth gameplay and immersive graphics as high-speed action unfolds around you with a fast processor and immersive graphics.
I haven’t scripted anything specific to the VR version so it should also work on the non-VR versions. ChatGPT does a pretty good job of picking up context. From the conversations I have had so far it feels like the NPCs do have some personality differences between them. From what I have tested so far ChatGPT is pretty knowledgeable about the Elder Scrolls world (not just Skyrim), I guess ChatGPT already has this information in its training data,” said Art From The Machine.
