The climate is varying in long cycles, and the deglaciation 20 thousand years ago (last glacial maximum) was driven by a spike in summer temperatures, and this peak has already long passed. Ice ages and interglacial periods have a certain momentum to them, so it takes more than just that to go back to full ice age..