I guess it's the classic case of one not being able to outrun a bad diet.

If fueling during the activity stops you from overeating afterwards and possibly allows you to exercise a bit longer it is worth it, even though it seems counter productive.