The problem is the opportunity cost of destructible terrain was too high. Developers could get fun for lower effort by creating linear levels with better design/graphics/etc as destructible terrain makes everything "blocky" without significant developer work.