Improve, yes, fix, no. I was actually already using a model fine-tuned for Skyrim.

I didn't go into it in detail, but it isn't even that I got the NPCs to start babbling about Taylor Swift. What is was was just that they knew that she was a musician, and as such, might be at the tavern. That's very hard to remove.