upvote
The thing is why that this feels so good future is; it is a system with no constraints. A bit like Star Trek universe in Roddenberry's imagination. This kind of utopia can only be achieved with all honest actors, but in reality systems are usually designed around bad actors.

Even with all morally good actors locally, there is no guarantees for external forces. Thinking it hypothetically, even with global coordination ( all good actors ) there is not a proven path that would lead us to better place from any starting point from past.

reply
It's probably more predictive to model actors as being neither good nor bad but constrained by various collective dilemmas, such as prisoners dilemma, the security spiral, tragedy of the commons, race dynamics, collective action or first mover problems, information asymmetries, the commitment problem, among others. Those are the hardest problems to solve because they're pathologies that result from the global, largely amoral structure rather than consequences of the individual exercise of morality.

In the AI case, each firm is in an arms race, and nobody can slow down without effectively collapsing due to positive gross margins only being viable with a frontier model that attracts marginal demand. An appeal to morality might have an impact but more effective action would be to address the structure that the AI companies are situated in that causes this dynamic in the first place. In practice, thats going to be a global agreement to slow down, and global regulations.

reply
Yeah but this is a system problem; if we had this utopic system from the beginning we would not even have AI probably.
reply
To get from here to Roddenberry's communism, according to Roddenberry's lore, we passed through the Eugenics Wars, the Second Civil War, and then fifty years of World War Three and the 'post-atomic horror' before coming to our senses.
reply
This sort of rationalization of evil is a core of technocratic support for Trumpism, I find, and has parallels to the evangelical prosperity gospel. Choice tenets:

  - Fuck you, got mine
  - If I don’t do it, someone else will
  - Might makes right
  - Greed is good
It’s always cloaked in a veil of realism, but it’s just the classic 14-year-old-boy-just-got-introduced-to-the-prisoners-dilemma situation. There’s nothing philosophically interesting about it.

Ironically, these are often the same people denouncing multiculturalism, yet the culture they strive for is completely morally bankrupt.

reply
And it's funny because the "realism" has been proven wrong over and over and over again for millennia. People do all sorts of selfless and generous things all the time! The entire premise is trivially disprovable by just going and asking a neighbor for some help with something.

That's not to say we should be naive about greed or malice existing or being powerful motivators (especially the former), but it is obviously not true that they're the only forces at play and therefore you are "just doing the logical thing" by succumbing to them. It's just the more destructive version of the same naiveté.

reply
Seems you and I have together struck a nerve. Maybe our sentiments would have been better received in an alternate subthread, but it’s all I could think about while reading the parent / cousin comments.

I haven’t read the full Magnifica Humanitas yet, but I would be pleasantly surprised if he touched on not just dehumanization of the other, but dehumanization of the self. Expanding on your thought, succumbing to those forces under the guise of just doing the logical thing is in a way self-dehumanization - to believe you are only capable of the “logical” thing instead of the moral thing.

reply
This was not my point at all. Maybe I could explained better, but main criticism I have is: you can bundle together objectives ( which are inherently good ) and create an utopia. But those cannot always be achievable.

Everything in life in trade-offs. Simple example is speed/quality/cost. I can tell easily:

- services should be cheap - services should be fast - services should be high quality

Now I created an utopia. Obviously this is amazing to listener. They agree. But is it achievable?

It is not saying greed is good or might makes right. But system means you need to construct from this ideals best outcome ( which comes at some trade offs)

reply
Yeah there were probably more appropriate subthreads to have responded to. My point wasn’t quite neatly directed against yours.
reply
Your idea and its (perhaps unsatisfying to you) resolution can be summed up easily by John Quincy Adams’ quote:

“Duty is ours. Results are God's”

reply
> I think reading this helps me imagine a version of the future I'd actually like to live in. A version where technology is used well (rather than preaching for abstinence from technology)

I believe the Amish figured this out over a century ago.

reply
> I believe the Amish figured this out over a century ago.

The Amish rather came to a different conclusion (which I don't want to judge on, but on which I nevertheless have a different opinion than the Amish).

reply
What is that conclusion which differs from the post you replied to? The Amish are mindful about their technology adoption.
reply
> The Amish are mindful about their technology adoption.

The central idea concerning the Amish's relationship to technology is that only technology is allowed if it does not destroy their community.

My personal values are much less based on upholding a community, but rather are much more rooted in individual freedom and independence. This means that I (likely) come to very different conclusions regarding this class of problems than the Amish do:

For example, I am less opposed to various kinds of technology that Amish would likely consider as as "community-destroying".

On the other hand, I guess I am much more opposed to technology that can be used to surveil the user and/or makes the user dependent on the whims of big tech companies than I guess the Amish are (i.e. the Amish would likely consider this as a much smaller problem concerning which technology to allow vs disallow; as I wrote: by my understanding their central concern is which consequences some technology has for keeping their community together).

To give evidence for the previous point: (by my impression - I am not US-American) you will rather not find many Amish people at political rallys against surveillance laws. The people who attend such rallys typically also have strong opinions on which technology to use or not to use (just talk to such people who are very strongly opinionated :-) ), but - as I pointed out - these technology choices come from very different basic premises than those of the Amish.

reply
Yeah they probably wouldn't show up to a political rally because of this:

> Separation from Evil

> The community of Christians shall have no association with those who remain in disobedience and a spirit of rebellion against God. There can be no fellowship with the wickedness of this earthly world; therefore there can be no participation in the organizations, works, church services, meetings or civil affairs of those who live in contradiction to the commands of God (this may include Catholics and Protestants as well as other religions and pagans). All evil must be put away, including using weapons of force such as the sword and armor.

https://en.wikipedia.org/wiki/Schleitheim_Confession

reply
The church, the message comes from, literlay makes the world worse for so many people on the planet.

Woman have less value under the church than man. Alternative sexual views are evil.

Church and any kind of believe system hurts our society and divides us.

reply
> Church and any kind of believe system hurts our society and divides us.

Any belief system? And yet I bet you value freedom over slavery, wisdom over ignorance and compassion over brutality. That’s a belief system, despite not being a religion.

reply
I can argue these values and we can discuss them.

If the majority says, no we want to be able to control other human beings, these people will reinact slavery. From a society point of view though we see that its not a working model anymore.

A real believe system can't be argued with. You believe in this god? This god says x and thats why you do things? Okay thats it. You don't even question were this information even came from.

If we delete all religion tomorrow and science, there is a realistic chance that the society rediscover the same existing rules like math and gravity, but religions might appear again but with different names, different rules etc.

I can change your mind with logic and arguments if its not a believe system, i can't do that with religion.

Wisdom over ignorance: The chance of survival is higher with wisdom

Compassion over brutality: This is just basic Game theory

reply
Fornication culture is a big part of why the west is in decline.

What may make sense for you individually may also be empirically proven to be detrimental to the whole.

The new testament contrasts with the old, the gospel is one of tolerance and equality. It's a big part of why you have the rights that you do, as do women.

That said a lot of what you're saying can be ascribed to religious institutions and sects and individuals and specific churches. But your general prescription is like saying "this logical axiom is evil because XYZ ascribes to it and they are also evil".

You also have a belief system -- that people who believe in God do so because they don't question their beliefs, that religious people are only led by dogma. Yet your belief is wrong. Have you tried questioning it?

> but religions might appear again but with different names, different rules etc

Religions and scripture spread also evolutionarily. Christianity is popular because it is rooted in many truths.

> Compassion over brutality: This is just basic Game theory

And the game has been played.

reply
"Fornication culture" who said that? We are more people on the planet than ever. Less people have to life lies like being in a marrage but also being homosexual.

Its just a control structure from the church without education.

Its probably even because of missing education. Educate people properly and they can handle "Fornication culture".

I don't have a believe system. I have a theory why people believe in gods and religions. We have evidence for it. People studied the origin of religions:

"It evolved from humanity's psychological and social needs, primarily our desire to make sense of the natural world, cope with the fear of death, and foster community cooperation."

We know how little people knew when religion started to emerge. Never seen space, never seen above a cloud besides a few poeople going up mountains. Thunder was not understood. Between 1400-1700 we had witch trials.

It is dogma. What is your argument against dogma?

"Christianity is popular because it is rooted in many truths." were is your argument for this? Its popular due to luck, power and wars. Missionaries as well and especially probably the most critical thing: Early indoctrination.

>> Compassion over brutality: This is just basic Game theory > And the game has been played.

Yes exactly. Compassion wins because its better, not because religion says so. Its an evolutionary win.

reply
"Church"

ok

"and any kind of believe system hurts our society and divides us."

People shouldn't believe anything?

Disagreement and conflict are natural. How we handle these disagreements while striving for widespread peace and prosperity is the question.

reply
I don't believe. I accept things i don't know and i know what i know.

There is no inherant issue with this. in contrary it makes me mentally stronger.

I can choose on my own terms if/when i want to end my life. If i get very sick, i don't have to hope for a god or priests blessing to end my life, i will just do it.

But religion is different: if you believe that homosexuality is wrong due to your religion, there is nothing i can argue about. Your priest told you this based on some book or story from 2000 years ago and you do not question this.

I know plenty of strong christians and muslism in germany who do not like homosexual people. And its dividing our society.

reply
> I don't believe.

You believe that you don't believe.

> But religion is different: if you believe that homosexuality is wrong due to your religion, there is nothing i can argue about. Your priest told you this based on some book or story from 2000 years ago and you do not question this.

This isn't the Church doctrine. The Church doesn't target homosexuals or even homosexuality in particular but ALL sexual practices that deviates from the unitive and procreative aspects of human sexuality. Christians don't believe in this because a book written thousands of years ago say so but because deep in their souls it makes sense and is the truth for them. Homosexuals are welcome on the Church as any other sinner what is ridiculous is to expect the Church to condone sins and bless sinful relationships be them homosexual or heterosexual.

> I know plenty of strong christians and muslism in germany who do not like homosexual people. And its dividing our society.

Perhaps it is something else that divides.

reply
No i do not believe. You don't change it just because you say that i believe in not believing.

There is also a clear definition for it:

"Believing is the mental act of accepting something as true, real, or correct, often without requiring absolute, physical proof."

I'm absolutly fine saying that I don't know something. I do not know a god exist, or multiply etc. But honestly that question comes down to me more like "Does randomess exist".

Yes its absoutly a religios thing that homosexuality is bad. You call it yourself 'sinful relationship'. Its not a sin just because church doesn't like it. Also plenty of religions are responsible for making it a sin outside of religion.

And yes if the church condonse all sexual practices, it does include homosexuality and makes it a church doctrine.

reply
> Christians don't believe in this because a book written thousands of years ago say so but because deep in their souls it makes sense and is the truth for them.

Sorry mate, but that's just cultural indoctrination that made them feel that way, and the culture is intimately tied to the book.

reply
The Vatican is guilty of being the most charitable organization in the world.
reply
Does that mean that nothing of value can come from the church, and we should ignore all ideas they put forth out of some kind of spite?
reply
Spite? Its not spite.

The church creates a believe system which indoctrinates all of us and took our cultures away.

The germanic tribes were believers in nature, church removed all of this.

Church also doesn't see woman as equal.

Just because they might sometimes also say postive things or things we might align, doesn't mean i need their oppinion. And especially not on hn

reply
Indoctrination and cultural erasure isn't unique to the church. With Germanic tribes - the Saxons, Angles, Normans, etc., while women's rights ebbed and flowed over the centuries, they were rife with double standards and were still quite patriarchal. They didn't just believe in nature, they believed in the same pagan gods as the Nordic peoples.

The point is that times change, and institutions change, and holding grudges for long ago sins and policies is ineffective.

reply
This is not true. The number of believers and official people in the church is continuesly declining around the globe.

1990 there were nearly 60 Million people in the church in germany (nearly everyone) now we are down to under 40 Million which crossed the line of 50%

This is real tangable progress.

The only downside is, that we do not sit together and formulate something which might give people hold who are not ready to be self stable mentally and might need something like this. And we also do not try to align together on rituals which help us to live better together.

I'm also still affected by the indoctrination of the church. As you can see, i argue against church not just because I like to argue, but because i really really hate religion and especially the christian church in germany, due to my own values and experience. This is not old i'm only 36.

reply
Well, I do have to give the Pope some credit.

This weekend I upgraded the PC of a church lady who has about a 10-year old mini-PC, so now it has the latest Windows 11. This was not easy, it was a shambles of Windows 10 combined literally with amounts of older Windows 11. From which auto-updates would take it no further. OTOH on the bright side autoupdates could do no further damage.

I attribute all success to a miracle, considering there is only 32GB of soldered-in drive space and 4GB memory :\

I don't think it would have come to pass if it weren't for the Pope's smiling face appearing with delight each time I rebooted, when her PC's everyday desktop background picture came into view. This is where he is joining in with the tribal rhythms while visiting Africa, honoring their traditional culture while they honor his visit in their colorful regalia.

When you're dealing with anything that challenging, or more so, you need all the blessings and prayers you can get :)

reply

  > much more compelling than those found in the various "manifestos" which come out of Silicon Valley.
Whenever I hear these "tech overlords", I am always baffled at the total lack of culture, the absence of taste, the empty visions and the implied complete subjugation of humans to ideals of "efficiency" or "quick and easy". Maybe they would have been more interesting people if they had been brought up in beautiful towns and cities, if they had lived in a rich cultural environment instead of being raised as consumer of cheap and flashy pop culture. Maybe we should tax bad architecture, it gives me headaches but others might incur heavier damage.

As an aside, at least Trump is drawn to the grandeur of high culture from historical times, but he also doesn't understand a jota about aesthetics, and so the White House gets turned into a tacky gypsy-style abomination with one dollar ornaments.

reply
We lost the “liberal education” (not the political one, but the “freeing” classical one) and it’s starting to show.

When you compare the robber barons to Google and Meta it’s kind of embarrassing- they build massive empires of iron horses screaming across the world and covered cities in magnificent buildings (stations, libraries, etc). G&M built an empire of advertising and … not much else?

reply
Indeed. The current crop doesn't have an idea for what they hoard their billions, it's just...emptiness. I propose we explain the tech's attachment to Accelerationism as a profound boredom and lack of purpose. "What does it mean to be human"--they don't value that question. Peter Thiel got interviewed a month or two ago, and he could not be brought to say that he sees value in preserving humanity. He would rather turn himself into a robotic contraption to extend his life.

When power fears death, some strange things happens.

EDIT: link to the interview with Thiel <https://xcancel.com/rcbregman/status/2036113528126394834#m>

reply
I’m reminded (and apropos as the Pope quoted him) of Tolkien’s description of the “eternal life” the Ring gives to mortals, and how it’s … not so desirable in the end.
reply
Indeed It's far more necessary that the utter dregs of humanity (e.g. Peter Thiel) eventually die of old age. Or put another way the damage of mortality killing good people is more than offset by the good of it killing the worst people with the most power. Because in the end it's probably not going to be your sweet mother who will get to live forever, it'll be people like Peter Thiel. No thanks, for the good of our species.
reply
“Those who used the Nine Rings became mighty in their day, kings, sorcerers, and warriors of old. They obtained glory and great wealth, yet it turned to their downfall. They had, as it seemed, unending life, yet life became unendurable to them. They could walk, if they would, unseen by all eyes in this world beneath the sun, and they could see things in worlds invisible to mortal men; but too often they beheld only the phantoms and delusions of Sauron. And one by one, sooner or later, according to their native strength and to the good or evil of their wills in the beginning, they fell under the thraldom of the ring that they bore and of the domination of the One which was Sauron's. And they became forever invisible save to him that wore the Ruling Ring, and they entered into the realm of shadows. The Nazgûl were they, the Ringwraiths, the Úlairi, the Enemy's most terrible servants; darkness went with them, and they cried with the voices of death.” - from the Silmarillion but it’s echoed in LotR also. And even Bilbo complains of being “butter spread over too much bread”.
reply
Google makes phones and phones are somewhat good. Better search had some value for humanity. Meta has no redeeming qualities or achievements, other than helping Trump get into office and defeat Iran.
reply