The link above mentions Ørberg who did something similar for Latin (Lingua Latina Per Se Illustrata, ebook and audiobook), which I've read through with good success. It's known as the immersive Ørberg method after him.