Here is a direct link to Figure 3:
https://assets.sfstandard.com/image/994911177489/image_bfl33...
Step 2. Place trail camera behind bug
Step 3. Record faces that look at bug
> A chatbot account tied to Alfozan’s spouse, which shared identifiers with his own account, submitted prompts between Sept. 24 and Sept. 30 about building, installing, obscuring, and remotely accessing a recording device, prosecutors said. Queries included how to “build a continuous audio recorder” and “encrypt the SD card,” prosecutors claimed. On Sept. 27 and 28, the account asked about the specific device that was later found, including its unique MAC address.
“I did not kill my wife!”
“Cool so why did you search for how to hide a dead body the same day she went missing?”
Ive seen people going through Plaud.AI conversation to find "on day X person Y said Z to person W", just to get some amunition against them.
It’s like thinking about edge cases in programming…
Most people are totally not like that. And it does force you into some difficult choices.
I gots to know...
The choice is whether to hang out with people with whom you can't be sure they don't have a Plaud/Pocket/.. in their literal pocket which is continuously listening.
Unfortunately the set of such people will eventually be shrinking more and more until eventually only a few tinfoil folks are left. Dystopian? Just think back w.r.t. continuous tracking by Google/Facebook/.. Unthinkable 30 years ago, total standard today. Try to count the fraction of your emails that don't actually reside on a MSFT or Google server because the other end has an account there. That fight is over. You can just as well join them.
Or at the border where it is already routine to ask for social media accounts (especially foreign nationals) you might someday five the border agent your login.
When the Soviets wanted to spy on the American embassy, they energized the steel rebars to act as antennas. The structure was so wired that the entire building was the bug. https://www.airandspaceforces.com/PDF/MagazineArchive/Docume...
Toilet paper, ESP-32 and Claude "make me a bug please"? Excuse me? How far have we fallen from grace?
Assuming this is espionage—for which I have seen zero evidence—isn’t Saudi Arabia notorious for having a fuckup of an intelligence operation? The literal hatchet job that was the Khashoggi murder comes to mind.
That lowers the entry bar for basic spying.
And not do this from your spouse's account.
These AI companies are likely targets of multiple foreign intelligence agencies, similar to military contractors.
The fact that even this incompetent dude most likely still made off with some secrets means I’m sure some better trained ones got/are continuing to get a few more.
It could have just been a regular black usb stick an I bet nobody would have questioned it.
Instead "why is there something in toilet paper behind the TV?"
Me seeing toilet paper next to the TV in a meeting room? I’m picking it up and asking why we have toilet paper in the meeting room, 100%
Does not understand how models or data retention works.
Needs LLMs to encrypt a flash card.
Are their hiring standards that lax?
> An unattended bag found in the company’s offices contained Alfozan’s wallet and identification, as well as a recording device
It’s almost like he wanted to be caught…
Somehow they think this gives them superpowers when it's built atop a tower of borderline retardation.
Remember the Apple guy a minute ago that arrogantly thought he could bypass their security?
I wonder what the IQ of someone needs to be to think that covering it up with tp makes it less suspicious instead of more. And I also wonder what the hiring process was like to hire someone with that mental frame.
Remember, this is only the company responsible for potentially building and aligning AGI. No need to be setting high expectations toward their sandboxing or hiring capabilities.
What, we’re supposed to vet everyone we network with at orgies now?
What might tilt the bayesian balance in favour of political intent would be the nationality of the individual, state or religious sponsoring become hypotheses.
I expect Meta are running an audit right now to figure out if he was involved in espionage back then as well.
While the headlines and quotes seem designed to imply sophisticated industrial espionage, potentially by a state-level actor, what's public so far isn't adding up that way.
1. You're not going to get much actionable research material on proprietary technologies by audio bugging what's said in an executive conference room. That's what you'd do if you were after economic or deal negotiation info.
2. Hard to imagine a state-level actor buying a ~$15-$35 hobbyist ESP32 board from Seeed Studio (I've ordered a couple from there for home automation myself) and then asking a public chatbot for set up instructions.
3. They say he was an "engineer" who'd been there ~15 months. If you're an actual engineer at OAI and past the 1 year cliff, you're probably already sitting on RSUs likely to be worth at least $1M after OAI's IPO - and maybe much more. That's a lot of incentive to not get fired and probably makes you pretty hard to recruit as an internal mole for cash.
2. An operation can be state-sponsored and still amateurish/botched. We have seen plenty of examples of these. Remember a certain bone saw?
3. The incentive can be a lot more than financial. Plenty of governments are very…persuasive.
Not sure why OP would call it amateurish/botched.
but I guess the $1 million was not incentive enough to not commit a dumb insider trading scheme...
I'll be the first one to admit, that got a hearty laugh out of me. Never miss an opportunity to market your models I guess.
Did OpenAI do a marketing bit in the middle of an espionage accusation?
Yes, they did. The people who felt it was totally normal to add that would no doubt be surprised how desperate and cheap it makes them look.
"almost surely made in china"
Plumb your video feed of your executive conference room into our DC and we'll tell you if anybody is spying on you.
Looking at the photo of the device, it looks like an XIAO ESP32-S3 Sense with the camera removed but the camera board still installed along with its microphone. The wifi/Bluetooth antenna is installed but it also supports microSD cards.
If I was building this, I'd just set it up so I'd never have to recover it. Have the wifi AP come on for a few minutes at various times during business hours under a MAC and SSID that resembles a smartphone hotspot. Vary the time based on the current day of month week to produce pseudorandomness. Walk by that conference room at some of those times, but not every time, and use a burner to connect and download the latest recordings. Once a recording has been transfered, it's deleted and overwritten to prevent someone from establishing a timeline. If recordings sit for more than a few days, they are wiped. If you can encrypt the SD card, keep the key in RAM so there's nothing useful to recover if someone pulls it out.
You'd never have to recover the device because all data is transfered covertly. Even if security finds it, they'll likely inadvertently wipe it when it's removed.
Abdulrahman Alfozan, 35, a Saudi national, was arrested Friday and charged with using or attempting to use a device to intercept oral communications.
Remember kids, uncle Sam can see anything you tell your AI and will use that against you.
I wonder if the BaaS-providers monitor the accounts of decision makers. They could profit if they figure out what e.g. a central banker is going to decide. Or... if they're the ones deciding for him.
Hah, you can even streamline that by having an AI agent that autonomously makes decisions based on insider info...
Not just your AI.
You could have stopped the sentence at "uncle Sam can see anything" and these days it's pretty much true. They will use all of it against you if they can. Unless you truly want to live off the grid, if the state takes a sufficient interest in you, expect everything you do to be seen.
Uncle Sam tried to get MLK to kill himself by sending him letters alleging knowledge of an affair [1]. Getting some idiot's wife's chatgpt logs represents a fairly routine law enforcement action these days, and as such is really rather unremarkable. The State is always something of a terror. Really under most (if not all) conceptions, it necessarily has to be. The monopoly of force is a comfort until the Leviathan knocks on your door.
We also don’t know if this person did it under duress.
He was a Saudi national, so that is a possibility
>how does someone this dumb get hired
It's AI inbreeding all the way down.
There’s plenty of better people out there who just aren’t interested in that sort of stuff.
But that's crazy talk
The justice.gov article doesn't specifically say it was an OpenAI account, but I think, based on the fact that they have logs including MAC address of the device, that we could probably assume that. The alternative is that other chatbot account providers are collaborating.
Regardless, doing a string search on a MAC address for a device you find inside your property doesn't strike me as an abuse of the data that is also your property.
>submitted prompts... including its custom header and unique MAC
They can confiscate your computers, too.
This person, of all people, would know this. He really thought he’d never get caught.
I actually am curious if they were able to volunteer the information to the government of their own volition, without a government subpoena first. I would think that could violate their own terms if done sloppily. Maybe different if an employee or maybe they had to invite the government to ask for them or something? In any case, the mechanism aside, the state would have asked anyway (say if he used another company's chatbot) so the fact that it's the "same company" is rather irrelevant. The evidence would have ended up in the state's hands one way or the other, and I would think a search warrant in this case would have been rather routine. Search warrants are infamously not a high bar to climb in most jurisdictions, as often the presiding judges tend to default to deferring to the state.
https://www.propublica.org/article/saudi-fugitives-accused-o...
did you though
State sponsored intelligence agencies can point a camera at an exterior window and reconstruct dialogue from the vibrations. This was a loose, hand-soldered ESP32. Settle down.
Good time to start a company that builds giant Faraday cages over data centers.
"Oh, let me download file 'companysecrets.pdf' to understand the problem better.
Of course nobody would ever let an agent loose in their home directory[1], but still, you have to wonder.
[1] /s just in case...
We are going to be dealing with this kind of thing for a very long time at this rate.
- Given all this power would they abuse it?
- Has it already been abused?
- Could they be compelled to abuse it and then to keep it quiet?
The alignment people would like you worry about the model exfiltrating itself, too.
Free cooling, safe from missile attack, and safe from some types of electronic spying.
Still a significantly less dumb idea than space data centers.
Certainly they would be transparent and very ethical with something like that
“OpenAI personnel found the device Sept. 3…On Oct. 5, the complaint says, Alfozan entered the conference room and appeared to look behind the television.”
The image was captured after the bug was found.
But no the boring answer is that after they found the device they left it in place and planted the camera to see who came looking for it.
Or maybe OpenAI is hiring the wrong guy? Maybe they should hire me instead?
That seems odd, especially since it would dampen the sound recording
in this context, they should be more specific about how terminal s/he is
Back of a TV is a decent hiding place. Wonder how they found it -was it actively transmitting?
Unless you mean, it happened to be actively transmitting during a(n investigative) sweep.
Still, raises some fun concepts. The sort of things where in this current level of technology you'd almost need to supercool a room for a sweep, blast various RF/sound/etc and look for anything that even remotely warms up, to detect (1) whether something detected something worth recording for later as well as (2) something that might be on the right wavelength/etc to trigger a send.
[0] - https://en.wikipedia.org/wiki/The_Thing_(listening_device)
I was making a joke, but it does look like they got their components from Seeed Studio based on photos.
https://assets.sfstandard.com/image/994911177489/image_k101c...
What is there to protect? The GPT architecture is publicly known at this point, Anthropic arguably has superior models, there are dozens of other providers who are neck and neck...
It looks like it’s the (SeeedStudio XIAO ESP32S3 Sense w/ WiFi, BLE, OV2640, Mic) https://ca.robotshop.com/products/seeedstudio-xiao-esp32s3-s...
Which is just an esp32s3 based device. I assume the word “sophisticated” in openAI report is just copy paste from device description.
...uh what
Sounds like we know where their priorities lie, anyway.
> “For us it is a matter of national security,” U.S. Attorney Craig Missakian said in a statement. [...]
> The case is being prosecuted by the National Security, Cyber & Special Prosecutions Section of the U.S. attorney’s office for the Northern District of California.
(But that was after OpenAI "referred the matter to the FBI")
There's presumably a strong argument for making this stuff known internally, since you want other employees to a) be on the lookout for it and b) get scared into NOT doing it themselves because someone else got caught.
If you tell your employees, the outside world is going to hear about it too.
(Or maybe you stall them on the phone while scribbling a note to your PA saying “BUG STORY LEAKED TO VALLEYWAG PUT OUT COUNTER PR GET AGEAD OF STORY” hoping to get a tweet out before the ValleyWag gumshoe gets off the phone.)
(Or maybe you keep a notion.so page pre-filled with all your secrets and each one has a BURN button next to it, ready for you to tap when ValleyWag call up for a comment on their upcoming exposé in re: PR/Disasters/20206090500039.md)
This isn’t uncommon, but it’s rare this info is shared in such detail publicly..possibly to make an example.
Concealing a recording device in a conference room in toilet paper is a bit strange. Do executives meet in the toilets to discuss strategic moves?
Either way, there goes the false flag and the reason for companies to stop hiring humans over this espionage.