The House is a group of individuals that are so afraid to defy the president because the President can send a bunch of money to primary any one who disagrees with them. Big districts require a lot of money to run a campaign. Small districts mean you don't need a lot of money, and heck they might already know you. A larger house means more political independence from the bully-pulpit.
And the House is MEANT to be cacophonous and boisterous. Objections based on convenience and space, are not serious in terms of the meaning of the House. Within a decade or two, it will be 1M citizens per House Rep. Adn everyone of them will bought, because you have to be bought to get elected.