The problem with inpainting is that it suggests there is a generator that knows how to fill in that spot before the "witnessing" part of the visual system then gets to work. This is perhaps best thought about from a more extreme example of dreamining: witnessing visuals with the eyes complete closed. In short, the visual system isn't like a projector screen with the finish fixed-up image that some interior witness views.

I believe that most researchers have a very different model, that of the controlled hallucination. What we experience isn't the photons hitting the array of rods and cones like a 2D array of pixels. Instead, we have an internal model of what we are looking at and visual input is there to provide feedback to keep the model of the world updated. The blind spot isn't experienced because we aren't looking at the 2D grid of pixels -- our model is coherent, and the presence of the blind spot simply means that no corrective feedback comes from that area of that one eye.

One compelling bit of information is there while there are neurons feeding processed visual information forward into the brain, there are more feeding back from that area to the visual system. That is, the the visual system is providing error signals and not the image we are experiencing. When something not predicted appears, the visual system sends forward information guiding the internal model to be updated.

Have you ever had the experience where you have been asked to close your eyes and put into a novel environment before then being allowed to open your eyes? It takes less than a second, but you can feel a moment of disorientation while your brain builds that world model. Another way is via some optical illusions (Necker Cube) or Escher drawings. You can look at a part of the drawing and everything is fine, but then as you change your focus there is a transitory feeling of unease as that world model is in flux as it tries to resolve the new visual input with the model it had been using.

There are dedicated optical illusion/explainers that give you the experience of the brain patching over the space with neutral background, even if there's something there, like a symbol or a star.

So if it's something featureless or continuous, like a wall of your room that's a solid color, or a sheet of college ruled paper, the pattern can just be continued.

That said I would stress there's limits to how much of that you can do just by pattern extrapolation as opposed to deriving images from distinct and specific information in a given region of the visual field. You have to know enough about a stretch of visual space to know that it's appropriate to spread a pattern over it, and that's the thing the blind spot doesn't know.