I think you were intending for novels, but poetry books typically don't really have much in the way of "story", just aesthetics. Even for novels, there are many that I primarily appreciate the prose. I love everything about the Kingkiller Chronicle books, but the prose itself is quite pleasant in isolation, and I could probably appreciate the books even if the story and worldbuilding weren't good.
Plenty of RPGs don't have much in the way of story. The story of the first Final Fantasy is nearly absent. Same with the first Diablo, and most roguelikes. Obviously, you can enjoy an RPG without caring for the story or characters, because the main point the vast majority of games is to play them.
The closest thing would be telling someone they’re reading a choose-your-own-adventure book wrong somehow, and even then it’s a stretch.
If someone revealed to you that they enjoyed "You are a shark" as much as "Cave of Time", and after inquiring you learned that they don't read the page, they just skip to the decision, and backtrack if they get a The End:
Did they enjoy the game? If there are enough of these type 2 readers should the industry start catering to them over legacy type 1 page readers?
Saying “you didn’t like it right” is gatekeeping.
Would it be so wrong for someone to enjoy something in a different way than you do? Or should they be chastised for enjoying it the wrong way?
You’re welcome to ask what brings them enjoyment, to broaden your views, instead of dismissing them.