Why don't you switch to CDs then? Something is telling me this isn't quite the full story.
I'm sure lots of people who don't really need to use Spotify use Spotify all the time, if you really do listen to just a few albums, why not buy those off Bandcamp/Beatport/Whatever then listen to those and stop paying Spotify? I'd easily switch away from Spotify if I no longer saw/agreed with the convenience, but hard to beat it for discovery right now.
But the concept holds. I have a directory in a copyparty share that I stream music from constantly. It's probably 20 albums worth of music, and it's just in a mix that I put on almost every day, whether I'm driving or I'm working.
I tend to tune into livestreams on YouTube for the discovery aspect.