Well, apparently telling them that you have hold-out data (for eg a perforance optimisation challenge) seems to make them overfit less.

So your idea might work.