Farmers did well compared to hunter gatherers, but they were in turn devastated by pastoralists - who, in Europe at least, had a lot of hunter gatherer ancestry.