Historically speaking marriage did not mean a man agreed to be sexually exclusive with a particular woman.

It meant a woman agreed to be sexually exclusive with a particular man + various legal entitlements. The legal entitlements were what distinguished it from concubinage.