I'm not aphantasic, but that's exactly the experience I get when coming out of a lucid dream. Except it's my expected surroundings not black. Gets a bit weird and inceptiony when it's the wrong surroundings! Given the number of cultural references along these lines, I suspect it's not uncommon.