Even if the app is no longer using that memory it is not released until Windows thinks another app needs it.

And then people complain about how unresponsive applications are, all these little stutters as things pop in.