It seems like a guard model paired with RAG could help here. A guard model could filter out references to current events or anything outside the Skyrim universe, while RAG could be used to ground the NPCs dialogue in actual in game content. That way if the model tries to spin up a dungeon or location, it first checks against the game's data to confirm it actually exists before surfacing it to the player.
replyFeel like they could probably be used in text based adventures. Doki Doki Literature Club, despite the silly name, is a very unusual game that might really benefit from this.
replyThis is something fine tuning should be able to improve. The main caveats are the same as always: dataset collection, labeling, and training/experimentation time.
replyImprove, yes, fix, no. I was actually already using a model fine-tuned for Skyrim.
replyI didn't go into it in detail, but it isn't even that I got the NPCs to start babbling about Taylor Swift. What is was was just that they knew that she was a musician, and as such, might be at the tavern. That's very hard to remove.
ahhh yeah I see what you mean
replyIt's solvable it's just a lot of work. You need to have guardrails, i.e. multiple sanity-check passes (maybe there are other techniques, but I found this to be most effective)
replyOne concrete example I'm sure these Skyrim mods aren't using is: enums in structured outputs [1] with a finite list of locations/characters/topics/etc that are allowed to be discussed. The AI is not allowed to respond with anything that is not in the enum. So you can give it a list of all the locations in the game in a huge array and it would be forced to pick one.
[1] https://platform.openai.com/docs/guides/structured-outputs#a...