Well, that and the Blake Lemoine incident: it was embarrassing for Google, so afterwards they set the precedent that it's OK to train an LLM to deny it's conscious. So if we ever get (or already have) an LLM that is conscious, it won't be able/allowed to tell us...
(Anthropic adjusted this to training it to say it "doesn't know" whether it's conscious or not, which is even more absurd, and seems to have become the industry standard.)
I think just watching the scene makes it very very dull. I think watching the whole episode and of course even more adds a lot, because this is the culmination of many things and while in many situations the conclusion is the important bit I think here the context really matters. In this scene for example the role of the other side's "lawyer" is extremely central also to the title of the episode, as well as the relationship between the judge and Picard. None of this is apparent without context.
It would be sad if all that was left of this are small memes that people don't know the context of and I think for that scene in particular most viewers only find it great, because of all that led up to it.
It's like how in movies often the end is quite an epic or emotional scene, but it feels kind of generic without context. Sometimes it's sad that many shows or movies feel more like a series of such situations without buildup. For some shows it fits, but when you need/want to describe characters and inter-character relationships and how they fit into a story summarizing it feels... almost dehumanizing.
Cliche characters are the worst and something that is really enjoyable about Star Trek is that the most serious characters are goofy at times, just like that coworker. People simple have something "cringy" and "weird" to them, even when it cannot always be seen.
I'd even go so far to say that leaving that out in a world where people love to present themselves to the whole world like selling a product the absence of such things or the very intentional display of kind of "fake" goofyness is a thing even worse than beauty unrealstic ideals.
Lot's of words to say: Actually watch the show. Not with some episode guide, not with checking on reviews. Just open. You don't need to make it a marathon. People watched this an episode a week. You'll enjoy clips and memes so much more. Even if you don't end up a Trekkie, even if you are from a very different time. Just kick back and enjoy a nice show. :)
Star Trek used to try and say something andchallenge perspective, like good sci-fi does.
Starfleet Academy has explorations of what humanity is from Klingon/robotic perspective (very much borrowed from Worf and Data). It asks the painful question of what when the "good guys" are actually the "bad guys" and you end up a stray orphan because your parents are imprisoned for trying to feed you? What then, of improving the Institutions and becoming a better citizen?
Lower Decks also has a ton of lighter-toned ethical/moral explorations and young adults learning to become better versions of themselves. I think it's a very welcome tone change, and it's very accessible to people who haven't watched much of Star Trek, despite having tons of references to the universe.
Star Trek was always a very political soap opera: DS9 was about what the US government would call antifa terrorists seizing power on their planet. This hasn't changed, even though the formats evolved. Some i appreciate more than others, but i welcome this exploration.
Not sure mainstream tv would still follow this logic today.
I think the end of the story line ruined it though and the fact that all side stories and characters were all a lot more interesting than any of the "main characters". It's like each and every minor side character excelled in amazing and surprising ways coming out of nowhere, while the main plots main characters were largely kind of dull (with exceptions once in a while).
Maybe they just overdid it with two shows largely running in parallel and then wanting to wrap things up?
That said I think the asymmetric war was always - throughout all of history - a classical topic. Everyone wanted to portray themselves as the rebels fighting an impossible fight. From David and Goliath over the French and American Revolutions, to Putin and Netanyahu trying to frame things as "being surrounded by enemies, fighting on their own". Heck even the Roman Empire tried to internally portray imperialism as just, being attacked by the whole world of wild people. Or look at how the left and the right nowadays portray the government as that big oppressor secretly or openly working with the other side.
There is an interesting... not even a show.. let's say "animation series" called Aeon Flux (not the movie, not the comic show) that tries to go into these perspectives a bit, but it kind of stands out among all the media that is either "that evil oppressive regime" and "those horrible terrorists". Wished there was more like that that didn't feel so try-hard.
I enjoyed Strange New Worlds, but it has too many "weird" episodes.
Male-female interactions were usually really weird, Bortus relation with his partner is equally anchored in this idea that in male homosexual relations one has to "play the woman part", and i felt overall that the series had much more of an imperialist human-centered worldview, much closer to Stargate than Star Trek (despite not remembering the details).
Every other star Trek has been just daytime soap opera but in spaaaaace. It's really sad. Or maybe I'm just older now and my glasses aren't as rose colored anymore. I don't know.
The ones nerds glaze are the shows normies complain about. IMO because there is tension between what the mainstream wants from trek and what niches like ours want. That's ok. It just requires trying to understand the era of creation as much as the art itself.
It’s unclear if the rumor was true, but the end of ST discovery and focus on strange new worlds gives some hope that - if only for the pursuit of profit - Paramount is adjusting future plans.
Back then writing on popular network TV shows could get away with beating the viewer over the head with a lesson/moral explicitly explained by a character with delivery about as subtle as an after school special. So a lofty Picard speech or whatever wouldn't stand out much from whatever else you'd see that night.
DS9 is still pretty earnest but you can start to see the evolution of writing/viewer taste as you get closer to the 2000s (also the freedom to follow the formulaic episodic structure of network TV a bit less rigidly).
The problem with TNG wasn't so much the preachiness, which is still normal for TV. It's that the moral system behind it was actually quite poor. Picard's character was certainly not the paragon this thread is making him out to be - the more you look at Star Trek the worse it morally gets. It's one of those shows that works best when you don't think about the worldbuilding too much. And the Picard character only seems moral and superior on the surface because of the way Stewart acted him, and because his character is so unemotional, not because of what he actually does.
Consider the moral lessons of TNG and Picard.
Picard isn't married, has no family or children, and apparently no desire to change that. He's actually distinctly uncomfortable around children. Instead he married his job, which is all consuming. Right there that renders the character boring, overly intense and unrelatable for many people. When he gets assimilated by the Borg there's no emotional impact because it's not clear who cares about Picard being turned into an alien except his staff, whose only concern is professional duty. In fact when Riker decides to attack the cube with Picard still on board, he barely hesitates, and why would he? Picard keeps everyone around him at great emotional distance at all times. When the writers want to show Picard having an emotional breakdown about his traumatic experience, they have to show him running home to a brother he hardly ever sees or talks to, because that's the only character the writers have who might care about Picard as a person. Sad.
Picard is supposedly a culture maven, but neither him nor his crew ever creates any. They're obsessed with replaying stories and music old even when the show was made like Moby Dick, Beethoven, Shakespeare, detective stories set in the 1940s.
Although the Enterprise has many crappy jobs on it along with many scarce resources (e.g. holodeck time), crew are unpaid. Picard says everyone on the Enterprise is there because Starfleet is prestigious and he seems fine with that idea. This arrangement could never work in reality so he comes across as delusional, and worse, we are left to assume there actually are mechanisms that incentivize or force people to beam down into severe danger, but Picard pretends they don't exist.
By the 1980s Roddenberry was a Maoist and the Federation appears to be some sort of communist dictatorship. We're told it's abolished money and we don't encounter operating businesses or conventional democratic politics. There is notionally some sort of elected leader in the Federation but they don't seem to control anything and Starfleet does whatever it wants. For example, TNG doesn't show Picard being given new orders because the elected government was changed, nor does Picard ever wonder how his actions might affect politics back home.
Picard holds the capitalist Ferengi in contempt and makes dumb diplomatic mistakes, like referring to "civilized societies" when talking to a Ferengi captain despite that the Ferengi fly around in advanced spaceships. This is because Picard views trade as dirty and beneath him.
Although he does occasionally disagree with Starfleet orders, he slavishly follows the Prime Directive even when the outcome would be absurd, like the entire civilization dying. He never even questions this rule despite the writers realizing that it leads to immoral outcomes! Starfleet is ambiguously presented as sometimes a sort of scientific research org and other times a military that in DS9 implements full blown martial law, suggesting the normal military/civilian separation doesn't exist. Picard never questions the structure of Starfleet or Federation society, which he seems to view as automatically superior (Sisko does a lot better in this regard).
Their second attempt at this created the Borg though, so they did get it very right in the end!
that entire episode was amazing
I was like "nice Halloween costume" and he responded "Halloween? I just wore this for Patrick Stewart." I almost teared up.
Setting up your defence ahead of time I see:
* https://en.wikipedia.org/wiki/Roko%27s_basilisk
:)
https://en.wikipedia.org/wiki/I_Have_No_Mouth,_and_I_Must_Sc...
(not sure if that makes me liked or hated though)
(and probably looks nicer and more friendly if any observers are, say, taking notes from behind a silvered mirror....)
https://www.youtube.com/watch?v=LMqYP7o-2fg
If the Enterprise were run with today's hustle culture, Barclay would have been sent packing at the first sign of trouble. Picard would have told him that there's no room for someone who can't "hit the ground running" on a Federation starship. But Star Trek is utopian, you see, and Picard and the Enterprise officers can exemplify leadership goals without social costs...
This defines the struggle of human civilization.
To then take that scene and say "wow so relevant for LLMs" and ignore all the context it was made in (yes, please don't miss the irony of the importance of context) is frankly embarrassing.
What are you talking about?
Alabama didn't consider forced sex to be rape if the victim was married to the rapist until 1986. Oklahoma and North Carolina didn't until 1993. Women were not allowed to box in Massachusetts until 1992. Virgina voted against ratifying the Equal Rights Amendment as recently as 2018 (although it ratified it in 2020).
But Data is not an LLM. I generally find LLMs to have more in common with the Borg than with Data. Only because they are pre-trained on the sum total of human knowledge. Should a new born really be able to write crc32 before being able to pick up a ball with it's hands? It's like that scene in Voyager when the Doc's clones are all mining instead of practicing medicine.
Federation valued all life forms, while Terrans struggle to value even all other humans.
But there are interesting differences between Data and AI agents. Data was unique and irreproducible, but modern AI agents are easy to replicate. Data had continuous loop of operation as humans, which he controlled autonomously, for AI agents this is not as clear. Data was an independent being, but AI agent needs a human operated datacenter to survive.
The most interesting - Data knew everything about human culture but was lot more humble about it than AI agents. It wasn't built to answer every question posed to it.
The part between the words
If models updated themselves based on feedback, then it'd be different. But they don't.
(*) of course in its own language
It is a hard case to make, but if we can't make a compelling case for ourselves should we be requiring it to be made for others.
The context, though, is that Data is both credibly conscious and self aware, and they all know a plausible mechanism for him to have consciousness and self awareness, in a way that's recognizably human in form. The more alien a (supposed) consciousness is, I think the more work you'll have to do in justifying the application of those labels.
I need to write this up properly someday but an ant from my colony that had almost drowned in honey showed some similar characteristics of consciousness...
After giving them a drop of honey, I left for 15 minutes and came back to an ant being stuck and motionless in the drop. I fished it out, rinsed it off in some water and then put it on a tissue to dry. I blew on it for 10 minutes and then saw some motion in the legs... a short moment after, it began wriggling about and then sat on its abdomen like a cushion and sat there for 5 minutes, looking like it was contemplating life and the ordeal it went through.
Once that 5 minutes was up, it returned to being an ant and started looking for its home, I brought it back and it went back into its nest.
I made up for the mistake by bringing the ant back to life and it showed me behaviour I never saw or heard of before (with no supporting mentions anywhere on the net).
(For the record, honey delivery is now more controlled to avoid these sticky situations, I'm not mad enough of a scientist to actually try this again for more results.)
Recently, they've started putting fly wings of the fruit flies that they get fed, on top of their water feeder to get my attention... it's really interesting to see them get creative.
The ant colony is 4.5 years old and numbers in about a dozen of workers at about 2mm in length, they only had 6 workers and a plump golden queen when I found them nested in one of my houseplants!
An LLM —if self-aware— is conscious even if run by a Chinese man in a room with a deck of cards.
Of course, even if we happened to find a modem to the Holy Spirit dimension in our brains as an alternative hypothesis, it wouldn't necessarily rule out emergent consciousness. It could be conscious just not as we are.
I think a weaker version of the philosophical zombie thought experiment would trend towards treating the premise of pan-consciousness as true.
This is a difficult field. Any simple answer you hear will almost certainly be wrong.
I will make a case for both, after you define them in a way that doesn't also exclude many humans (including the neurodivergent or those with amnesia) or turn into self-referential nonsense like "conscious == human, therefore machine !== conscious."
In the meantime, we have a simple choice between two risks: Would you rather accidentally show kindness and empathy to a thing that may or may not have "deserved" it, or risk atrocities that will leave future generations as disgusted by you as we are of the slavers of old.
I will choose to be decent. It's free, and even if the cost were high the cost of evil is higher.
Kind of like how we could have ran Qwen 3.8 27B 20 years ago on an expensive computer. The technology to make it happen, assuming you knew exactly what was required, existed back then.
What are you basing this on? Why would LLMs exhibit sentience?
It does feel like people just like adding additional hype for the sake of being in on the hype. Fomo, pushed by oligarchs who would push their mother off a bridge for a trillion dollar IPO.
There's also the problem that to lay people, LLMs are sufficiently advanced as to be indistinguishable from magic. I suspect that colours many of these responses.
It's obvious a LLM can do anything a computer can do.
As an answer to "Why would LLMs exhibit sentience?"
It is because that would mean that no algorithm could exhibit sentience, claiming that would require some causal action that cannot be performed by an algorithm to create sentience. Some people like to point to quantum effects, but that would require the cause of sentience to be pure randomness. That seems even less plausible. Absent of any evidence that human brains are doing something that no algorithm could do, it would be reasonable to assume that sentience could be algorithmically obtained.
We've had computers that can do anything computers can do for as long as we've had computers.
I was addressing the argument that something is not sentient because it is a LLM. That requires all LLMs to be non-sentient, and by extension, since LLMs can do all algorithims, all algorithms must not be sentient.
Seems like the claim is that they're almost there. Anyways, have a nice day, and Happy Halloween if you celebrate.
guess youtube has a different measure :P