Give them another option after they vacate the nest in the fall. You likely have the materials that they would use but they are not in prime locations for carpenter bee nests so they choose your home with a nice morning sun exposure and pre-existing nests. [0]

[0]https://gardenbetty.com/carpenter-bees/

I have carpenter bees, mason bees, bumblebees, honeybees, wasps, etc including bees of every size. I also have planted my property in native plants and wildflowers to make sure these native insects have a place to hang out. I provide water for insects and wandering animals using washtubs with stacked rocks and solar powered fountains to discourage algae. I think that you could improve your chances of keeping the bees without them destroying your siding or trim if you follow the guidance about bee house placement.

You can make a bee house block or buy one that will attract multiple native bees and they will use it for years. Here is one option with additional info about carpenter bees.[1]

[1]https://www.thewallednursery.com/do-carpenter-bee-houses-wor...

The holes in the bee house need to be about 1/2" (12-13mm) if you are attracting carpenter bees. For mason or orchard bees they should be smaller, 3/16" to 5/16" (5-7mm).

In my neighbourhood it has become popular to build "bee hotels" to have in the garden. They are commonly built by cutting logs into lengths, stacking them up and drilling multiple holes in one end of each log, each hole sized just enough for a wild bee to enter.

However, the holes need to be deep enough for the bees to be safe from bee-eating birds. Otherwise, the log will instead function as a bee trap, allowing a bird to pick off one helpless bee after the other.

I actually just put some wood in the backyard for them so they can chill out there and they stopped burrowing in my house and porch etc. I'm still not sure why they stopped rather than just do both, but I kept patching up their holes so maybe we have an understanding somehow.