Similar to you, I also noticed that if I miss good sleep for several days, it stacks. I treat sleep like a battery. A day uses up 20% and good sleep fills it back up, but only like 30%. One missed night isn’t that bad but I also can’t recover several nights’ worth.