upvote
Unfortunately some approximation of a human emulation (a slice of it) comes out of emulating Common Crawl. They do have neurons for emotions because those are necessary to predict next token.

Whether that implies anything about subjective experience... I think that question is unknowable by definition. Either substrate matters (in which case things have to be made of carbon for some reason?), or it doesn't (in which case... God only knows what that implies. Windows XP might have subjective experience).

reply
Emotions exist outside of immediate reaction. This is necessary for stuff like motivation.
reply
Human value has rarely existed. Pre-industrial world didn't have much human value. Your were a lord or a serf. There was not much in between. A lord's life had value, a serf's value was nothing.

Post-industrial world needed human capital. Hence, the need for human value. If you notice most of this "need" has arisen out of then need for industrial expansion.

Post-AI will be interesting. Will we go back to pre-industrial or get something better.

reply
I don't think this is factually accurate. What it really boils down is a question of scale of societies.

Most of us humans inherently value each other. There are exceptions, and small communities can get nasty. But for the most part, small human communities tend to be supportive and valuing each other.

This really only stops being the case when you get large-scale societies that allow humans to view others through an overly abstract lens. Combine that with an unchecked accumulation of power, and you have the potential for those in power to view the rest as without value.

reply
I agree with you. I recently watched a bunch of videos from a YouTuber 'Mike Okay' and he visits some random, obscure and non-standard countries to travel.

Most of the people he encounters are super friendly, welcoming and willing to bend over backwards to help him out. It's genuine human connection and willingness. He will speak to people from every possible background, including people in the Taliban and honestly at the end of the day, we're all humans and most people respect that.

Things have become blurred with social media, digital life, closed and private nature of the modern world but if you take a step back, you can realize humans are typically, very helpful, friendly and unique characters.

reply
The concept of fundamental human rights is certainly new, but our notion of intrinsic human value (and intrinsic value of other life and things) arises from our empathy, which at least in its degree is perhaps our most important defining trait as a species. (Our empathy may have been a prerequisite for the emergence of our intelligence.)

Conflating the two is why some people have trouble understanding why religions like Buddhism and Christianity seemed to tolerate so much inequality and violence; or more generally just assumed people writ large were historically more callous and uncaring than today.

Arguably one of the downsides, though, to a focus on rights vs intrinsic value is that rights are typically couched in materialist terms. Most of the time that's probably for the better, but sometimes maybe not.

reply
It's telling how blithely you're missing the point of what the pope(s) mean by human value. Their intended meaning is that far gone from modern consciousness, even among people who meant to champion some kind of human value themselves.

They're not talking about the economic value of humans or even the psychological value of humans as subjects with experiences and a right to liberty or care or something. The idea they're trying to recall and reinvigorate is a sense of human value that transcends that temporal, material noise altogether and that is truly universal. It's the human value that welcomed slaves, prostitutes, wretches, merchants and kings as peers in something grander than economy or state or lineage or tribe or creed.

Now, you can make a well-developed case that that's hogwash and that the human value that matters is the one that alleviates suffering or grants liberty or even the one that grants material reward for some virtue or bloodline or whatever, but that's not what these guys are talking about. They mean a human nature that is always there and always worthy, just as much when it's experiencing temporal poverty/suffering/abuse as when it's basking in temporal wealth/success/freedom.

The idea is that Christian or not, Catholic or not, it does good for everyone to think of human value that way and the critique -- for a long time now -- is that for all the flash and glimmer of technology and its material benefits, it sometimes makes it very very easy to forget.

reply
What rot. Tell that to native Americans who were forcibly converted and enslaved. Tell that to people in the inquisition. Tell that to peoples in India and the east that were forcibly converted so that the pope could fill his coffers. Tell that to all the children murdered in Christian and catholic schools.

Christianity and Catholicism doesn’t fool me. If you’ve ever wanted to see the mythical devil - look to those preaching and they legacy of hate that they carry.

reply
There's really no argument against the institutional and historical hypocisy. There's no shortage of people and groups that have done or currently do horrible violence against others, sometimes even in the name of these ideas.

But I don't know if that takes away from the idea itself and what fruitful counterpoint it might play in modern discourse.

reply
So your argument is that if some people who claim allegiance to an idea do evil things, that renders all who claim such allegiance, and even the idea itself, evil? That is a pretty poor argument. It's also one that I don't think you would actually accept in another context. I bet you anything that I can find some ideal you uphold which was espoused by some vile people at some point, and I also bet that you wouldn't go "ok, I guess I have to give that ideal up now".
reply
People really should stop making up history from childrens books. People were valuing people to various degrees and tool seriously the human value question in every single period we have records from.

And varrying degrees apply to post-industrial too - your human value did not meant much in very much industrial third reich fans hands.

reply
If my definition of 'value' was something that was totally contingent on both post-industrial society and an ultracapitalist approach to production, and it made me deduce that human being's lives over thousands of years or in other societies were worth "nothing", I think I would interpret this as a 'reductio-ad-absurdum'. That is, by deducing an absurd conclusion from the premise, that makes a strong argument that my definition of 'value' must be so narrow as to be effectively broken. I would respond by looking for a different, more wide definition of value, among the various ones that have been proposed.
reply
Serfs were of value to the lord, and they were usually not treated that badly compared to many workplaces today.
reply
Arguably from very early on the Church has been at the forefront of "Serfs are of value to the Lord" if you will (St Lawrence, et al).

So far none of the AI stuff I've seen has really been about "the computer has no soul" and more around the danger that dehumanization can bring (which has been a refrain since the previous Leo, mind you).

reply
deleted
reply
I also wonder if it’s just harder to rule a much larger population in the modern world than in those times. Any jackass can show up and say that he was chosen to lead by some higher power. But you must still convince enough people that that is the case or at least have a military large enough that you can control.
reply
Martin Heidegger discussed it already. Technology isn't just a tool, but the way we shape the World. The question with technology and AI should not be only "what should we do with it", but beside it, "what does technology do with us"
reply
A cursory look at the fall of extreme poverty across the world, over the last few decades, is enough to refute the idea that the world is largely based on exploitation.
reply
I agree that things are getting better, but your sentiment feels a bit premature; exploitation is still alive and well in many supply chains. The people who manufacture the products you buy often live much harder lives than you.

https://www.dol.gov/agencies/ilab/reports/child-labor/list-o...

reply
Has wealth been distributed from exploiter to exploited? Doesn't seem like it. It just seems like the 99% are being exploited a little more evenhandedly.
reply
You assume that exploitation and material improvement can not coexist. You can be exploited just as well, by that I mean you're not getting a fair share for what you contribute to the system.
reply
"UM ACTUALLY THOSE SWEATSHOP WORKERS ARE LUCKY TO BE WORKING FOR PENNIES AN HOUR TO MAKE MY OVERPRICED CONSUMER ELECTRONICS AND THESE FLY-ASS Js"
reply
I suggest a look at the recent economic development of Bangladesh, if you want something less abstract to illustrate the point that the reduction in poverty is very noticeable.

You would think that a great reduction in extreme poverty would give people pause, but it is almost always barely acknowledged. The strange conclusion is that people who tell you they care the most about poverty do not actually care about it in the slightest. It is just a vehicle for their resentment.

reply
My last impression of Bangladesh was the fire accord stuff, i.e. build emergency exits and get garment factory owners to stop locking their workers inside since they keep going up in flames.

Maybe they've grown. Is Bangladesh at the stage where they outsource labour to other countries yet?

reply
> I hope the speech isn't something dumb like "remember only humans have souls" because I think that's really premature and pretty obvious that AIs are not people at this point.

It really is en vogue to have this attitude that everyone in church is stupid for believing but it's a huge disservice to yourself to not understand the Vatican is full of the equivalent of the best PhDs sourced from all over the world centered around their specific topic of interest, theology.

Also for the time being you can see that the Vatican understands AI much better than you already, just have a read here: https://www.vatican.va/roman_curia/congregations/cfaith/docu... [0]

> ANTIQUA ET NOVA > Note on the Relationship Between Artificial Intelligence and Human Intelligence

reply
> I'm an atheist, but most of what I have heard from popes in recent years seems like sound and possibly needed advice.

This is a bad sign. I'm an atheist too, but I don't think religions should appeal to outsiders.

The idea is that by relaxing norms, he wants to gain more members. But it doesn't actually go that way. It alienates the core, and the people for whom compromises are made don't want to join anyway.

You can see this with the number of members for Unitarian churches (declining) vs Amish (growing).

It's the same with Gamergate. Games which chase inclusivity often fail, because the very people they appeal to don't actually want to play video games.

reply
> I don't think religions should appeal to outsiders

You'd made strange bedfellows with cranky Catholics who thought so too, 60 years ago after the Vatican II modernization reforms.

> You can see this with the number of members for Unitarian churches (declining) vs Amish (growing).

Hold on a sec, you should clarify what you mean by "gain more members" - Amish women have a very high birthrate, averaging 6.1 kids. Unitarians are below the replacement rate.

> Games which chase inclusivity often fail, because the very people they appeal to don't actually want to play video games.

How is this old culture-wars canard still being rolled out? A glance at the character rosters on the Game of the Year winners for the past 10 years proves you wrong.

reply
It's been over 12 years since gamergate. 10 years since it was co-opted by parasites. You've got to let it go.
reply
For better or worse, the Catholic church has shaped most of western philosophy for at least 1500 years, including topics not necessarily related to existence of a deity or belief in that existence. It's not surprising that some of their thoughts seem sound and consistent with your ethics.
reply
yeah I'm not impressed. Its not like the worlds religions have consistently held the moral high ground.

That catholic church has a long and sordid history of protecting its own.

reply
When it’s necessary for the pope to tell the orange one to calm down about wiping out a civilisation, you know things are bad.
reply
This would be more of an indictment if we were closer to the 19th century rather than 5 popes deep into public denouncements of American militarism.
reply