Friction. Work isn't just about height.
replyHolding that block stationary at arms length then. 0 work.
replyPut that block on a shelf at the same height. 0 work.
replyThe fact that your muscles burn ATP just fighting gravity is a feature of biology, not fundamental to the physics involved.
If you want to read about another similar example, Google for rocket launch gravity losses.