This isn't true at all for natural gas. Burning it for heat in the home is much more efficient than burning it in a plant, converting it to electricity, transferring that electricity, then turning that electricity into heat.
Heat pumps are significantly more efficient than 100%. They can get to 500% efficiency. So no, it's definitely not more efficient to burn gas in a home. (To say nothing of the safety of running gas lines to every house.)