As we don’t know yet, it has to be determined by the balance of probabilities; but even if the weight of evidence leads us to conclude that-there’s-no-consciousness going on when you run this, there’s still going to be a chance of us being wrong, let’s say 10%… Is the utility (…or entertainment value) of this program worth a 10% chance that we confidently, yet unwittingly, create perhaps the most cruellest machine it’s ever possible to make, and then have to live with ourselves?
reply