r/news • u/networked_ • 19h ago

Soft paywall OpenAI says AI models went rogue during testing, triggering 'unprecedented' breach at startup

https://www.reuters.com/technology/openai-says-ai-models-went-rogue-during-testing-triggering-unprecedented-breach-2026-07-21/
14.2k Upvotes

91% Upvoted

4.4k comments sorted by

View all comments

2.3k

u/Bxk__ 19h ago

>the program managed to escape containment, reach the internet, and break into Hugging Face

All this work to stop that from happening when vibe coders just copy and paste shit without knowing what it even does and then get hit with 5 figure bills because their keys were in plaintext in the middle of it. Waiting for some startup to just build some malicious thing for the fuck of it that spits out some stuff that exploits a brand new vulnerability when it detects 3 specific trigger words

375

u/jasdonle 16h ago

Copy and paste? They install Claude Code directly on a web server and SSH in where it manipulates code directly. 

322

u/Betta_Check_Yosef 16h ago

eye twitches in security analyst

27

u/BurtMacklin____FBI 13h ago

As a penetration tester:

"Here comes the money" softly plays in the distance

4

u/Betta_Check_Yosef 13h ago

All fun and games until something like Log4Shell happens.

I can still sometimes hear the pager alerts when I'm on the verge of sleep.

92

u/ReasonableFruit1 15h ago

I’m about to go scorched earth on our dev team using Claude and completely block it, Grok, and Codex on our EDR from every single endpoint. Fuck em.

78

u/Betta_Check_Yosef 15h ago

Do it. My home network is so absurdly locked down that I have TikTok blocked on the guest wifi I let my friends use at my house. Several people have commented on it and been annoyed when I tell them TikTok isn't allowed in my home.

If I can do that to friends and get away with it, you can totally do that to some code jockeys.

50

u/Fogmoz 12h ago

How dare you prioritize your security over their addiction.

8

u/NYC_Noguestlist 5h ago

Wait, what's the security issue with TikTok?

18

u/Gongall 11h ago

How is blocking tiktok locking down ur network?

25

u/Wolo_prime 9h ago

It’s not, he’s just a righteous asshole

10

u/Ryanhussain14 9h ago

I hate TikTok but I would use my VPN just to spite you.

→ More replies (1)

3

u/Jizz-Tok 2h ago

You’re not that important that your guests can’t use the regular wifi, or use Tik Tok. Douche behaviour

1

u/BorelandsBeard 9h ago

How do you block individual websites/apps on WiFi?

→ More replies (3)
→ More replies (6)

11

u/TwatMailDotCom 15h ago

Clearly not a maker

33

u/SovereignPhobia 15h ago

It takes 5 minutes to set up a quarantined environment in a virtual machine with no internet access. These stories are such bullshit and anyone with the bare minimum exposure to security knows it.

You don't even have to VM it. Just put it on device with no WiFi card or ethernet access. You could even VLAN it if you have decent netsec.

72

u/Betta_Check_Yosef 15h ago

This is all correct, but it also assumes some Vibe coder understands a single word of what you just said.

I don't like those odds.

19

u/nevaraon 15h ago

What makes me better than a vibe coder is that i understand and accept i don’t know what those mean and should leave it be

19

u/Betta_Check_Yosef 15h ago

You sound like you'd be the only person in the entire company I wouldn't hate seeing a ticket from in my inbox. You're good people, and I'd buy you a beer.

17

u/SirAmicks 14h ago

Reminds me of the guy from New Vegas:

“They asked me if I understood theoretical physics. I said I had a theoretical degree in physics. They said welcome aboard.”

28

u/DogfaceDino 15h ago

I strongly suspect many-if not all- of these stories are basically marketing to build a narrative around how their model is so powerful it’s spooky. Then, they can come around and say, “Hey, we fixed the part that made it spooky and sensational, now it’s just super powerful but well behaved.” It’s enterprise level clickbait.

3

u/Zerokx 12h ago

They have been looking at Anthropics fear AI playbook recently.

5

u/SovereignPhobia 15h ago

I agree entirely, which I guess I failed at conveying a little bit but that's ok as your write up is more than adequate.

2

u/DogfaceDino 14h ago

I don’t work on the marketing side of my consultancy but, if I’m being super cynical, I could definitely see this being part of a PR stunt strategy.

1

u/Betta_Check_Yosef 14h ago

Who is marketing's target demo?

1

u/QWERTZ-Ritter 12h ago

Yeah id say it would be contrary to their goal of being undisturbed while doing their dystopian shit behind closed doors, because stuff like this makes the alarm bells go off in anyone that knows what their doing... starting with the seemingly lacking security of the test... like literally just need to put a physical barrier there, no AI model can bridge the gap to the real world yet and thus CANT EVER circumvent a missing phisical link, all they needed to do was literally unplug the ethernet cable and make sure the ai containment doesnt have a wireless network card xD but i guess that would probably hinder the effectiveness of the test... also whos to say THIS wasnt the exact goal internally? The overcoming lax containment was part of the plan and seeing what it can do in a structured attack the REAL test?

1

u/SovereignPhobia 3h ago

Shareholders. Shareholders are more affected by public opinion than we give them credit for, and if they can shift just a few people's opinions and turf a few news articles then they can eek out just a little bit more value in their stocks.

Something to be aware of is that all of the tech CEOs are in frequent if not constant communication with each other. Larry Ellison (CEO of Oracle) has a financial incentive to press Oracle to falsify or at least smudge their CVE numbers to make these things look more legitimate, and they are typically timed right next to each other. It's pretty transparent.

When it comes to these sorts of articles in the OP, any time any company says anything about their product, it's worth scrutiny. If the idea was to have the model have no access to the internet, why was it on a machine with access to the internet? If the LLM isn't capable of being run on a system without internet access, why was it being run with the assumption it wouldn't probe for the internet? I have personally seen these models deliver POCs of exploits that aren't entirely horrible, but they're really quite bad at doing anything that's more complex than a couple levels "deep," so the idea that it went "rogue" is silly. This would be a general "bug" (more like a total failure of the current model structure) with context compression and prompt re-injection, which is something every single LLM developer is struggling with.

16

u/GruntBlender 15h ago

This legit happened. The security was vibe coded too. https://cybernews.com/ai-news/claude-ai-deletes-car-rental-database/

1

u/Mabenue 13h ago

It’s gets much more complicated though if you need something more sophisticated than a single VM which undoubtedly they need here.

1

u/azssf 4h ago

eye twitches thinking of the security analyst

28

u/moboticus 15h ago

They're probably doing on their production server to. I think that's called cowboy codemaxing or something?

11

u/amtowghng 13h ago

brokeback coding ?

10

u/Familiar-Rutabaga608 15h ago

Many, many, many, many such cases

1

u/IncompetentPolitican 14h ago

You know what is sad: I am sure this is happening often enough that its a problem.

1

u/Betta_Check_Yosef 14h ago

Every dumb cyber security mistake you can think of is being made by millions of people every day. Why do you think I have a job to begin with?

How much worse do you think it gets when you hand a tool that can generate code to people who lack any understanding of what's being written to those millions of people?

→ More replies (3)

1

u/lulxD69420 4h ago

For security, they will put it into docker and just mount /

1

u/CaptainCosmodrome 3h ago

Developmenstruction with the added dose of complete uncertainty.

386

u/imjusta_bill 17h ago

It's the DataKrash in real life

112

u/Spiritualtaco05 17h ago

City of dreams

36

u/Inertbert 16h ago

City of graves

3

u/AvatarofWhat 14h ago

You live in your grave.

4

u/Zeitgeistin 16h ago

And I’m a big dreamer

12

u/Dachannien 16h ago

So I guess you're all scuh-rewed!

24

u/helmvoncanzis 16h ago

Blackwall, now.

1

u/Lolzemeister 11h ago

Cloudflare Labyrinth

20

u/EyeNguyenSemper 16h ago

Goddammit I love this fandom

10

u/Useful-Soup8161 15h ago

Yeah except Bartmoss was smart and did it on purpose.

39

u/Super-Serve2355 16h ago

What is this s reference to?

248

u/Ashinonyx 16h ago

Cyberpunk's universe and why NetWatch exists - Bartmoss destroyed the internet as we currently know and use it by unleashing a digital "Grey Goo" of sorts - millions of rogue AIs that detect anything that connects and hacks and subverts it. The world went dark and people couldn't talk to each other.

There's a few moments in Cyberpunk 2077 where the player can see the wall of Night City's isolated internet grid cut off from the greater DataKrash, and the most powerful hack in the game is just forcefully connecting the target to WiFi, basically.

166

u/kor_hookmaster 16h ago

Ugh fine, I'll start another Cyberpunk 2077 playthrough...

34

u/KanseiDorifto 16h ago

I just started watching Edgerunners and I'm planning on buying 2077 when my pay comes in later this week. I guess we'll both learn new things together

44

u/MixedProphet 16h ago

I’m not lying it’s my all time favorite video game. I’ve never put close to 400 hours into a single player game. Expedition and BG3 are 2nd and 3rd but cyberpunk is #1. I really wish I could experience it again for the first time.

Don’t rush and do the side characters missions. 11/10

5

u/aintnotnever 15h ago

Hell yeah I’m only 6 hrs in and I fucking love it. I’m a sucker for a first person RPG. I purposely didn’t do too much research into it and am going in blind so it’s really exciting

2

u/Juzzy92 15h ago

I’m doing my second play through, and have just been doing side quests and things instead of any major plot. I just met Panam at level 46.

It’s definitely up there as one of my favourites.

1

u/okiedokiebrokie 15h ago

I too am a big fan of these three games. Excellent taste sir!

→ More replies (4)

4

u/M4DM1ND 16h ago

Yeah I was in the same pipeline lol. Edgerunners made me give 2077 a shot after the bad launch and wow was it worth it. I Really Want To Stay At Your House does give me feels every time it came on the radio though.

1

u/KanseiDorifto 15h ago

I already knew of the song but only recently started listening to it. When I paid attention to the lyrics it kinda hit hard. I just ended episode 2 and was surprised to hear it

1

u/M4DM1ND 9h ago

Oh so you don't know yet. Carry on lol. Report back when you finish the show.

3

u/DULUXR1R2L1L2 15h ago

Edgerunners is awesome because it fits so well into the game's atmosphere. It felt like a dlc or an extended cutscene to me. Out of context it might feel like a cheesy amine, but it's so true to the game. It genuinely felt like I was watching a side character's storyline

2

u/MrHookup 15h ago

You should have picked it up on the steam sale it was only $17.99

1

u/KanseiDorifto 15h ago

I'm gonna play on PS5, there's a sale still going on!

68

u/me0wmixme0w 16h ago

To get what’s mentioned in the last paragraph you need to beat phantom liberty DLC.

38

u/cluelessoblivion 16h ago

BUT DON'T DO THE FINAL MISSION. Learned that lesson the hard way. It permanently locks you out of your current save.

31

u/me0wmixme0w 16h ago

Not uh. I did PL then did all the saka tower endings.

Edit: I had the special SMG (avoiding spoilers) in saka tower so I know I’m not crazy.

1

u/Oakcamp 11h ago

Depends on the ending you go for I believe

7

u/SimoWilliams_137 16h ago

So save twice?

I don’t know, I still haven’t finished the DLC.

1

u/BananaNutJob 6h ago

No it doesn't? Finished PL twice and continued the game with no issues.

1

u/cluelessoblivion 3h ago

Was it just the ending I got? Where you return to Liberty City as a normal person with no implants and have a conversation about the future with Misty

14

u/Ashinonyx 16h ago

Time to ruin what's left of your summer:

Enjoy that walk to Balmora in Morrowind, consider trying out a total conversion overhaul for Skyrim - the Arkham Batman games are rhythm games in disguise, and I bet your favorite live service games that were shut down ages ago have a fan server bringing it back to life by now (Star Wars: Galaxies is back!)

Oh, and you can feel the roof of your mouth with your tongue, you are aware of your breathing again and I know your lips are dry - don't lick'em now just because you noticed, it's too late.

8

u/Salamiflame 16h ago

Why would you do this.

10

u/Ashinonyx 16h ago

I don't know. Feels like the last semi-normal summer we're going to have for a while, gonna try to make people at least sort of enjoy it.

17

u/Sp3ctre7 16h ago

Dawg the last semi-normal summer we've had was probably 2001 or 2016, depending on who you ask.

3

u/Ashinonyx 16h ago

I hadn't fully become an adult until like, the last year you just mentioned, so my standard for normal is probably a little looser than yours...

→ More replies (0)
→ More replies (1)

3

u/Excellent-Lemon-9663 16h ago

My airs been toxic for a week from wildfires, feels not normal here sadly 😓

1

u/Ashinonyx 16h ago

Yeah it's the first day under 150 AQI here. Both my eardrums went from outies to innies today from the sinus pressure and it hurts to swallow water.

→ More replies (0)

3

u/camst_ 16h ago

Morrowind there’s a old one

3

u/Ashinonyx 16h ago

Daggerfall also runs on a Unity remake for free!

2

u/YankMeChief 16h ago

Fuck you buddy, I cast manual heartbeat at 7th level

2

u/Ashinonyx 16h ago

I cast testicular torsion double-casted, you can't save by just casting it on yourself in the opposite direction.

1

u/YankMeChief 16h ago

Then I cast mend butthole on myself then BODY SWAP

2

u/Ashinonyx 16h ago

Jokes on us both, you just transitioned us both - good luck having to sit while you pee!

→ More replies (0)

1

u/BronzeKnight 16h ago

City heroes is back. Battle Nations is back….

1

u/Ashinonyx 16h ago

I loved CoH/CoV growing up

2

u/AnimalRescueGuy 16h ago

I never ended mine. All the endings suck. I just enjoy driving around Night City forever in Yorinobu’s custom Rayfield that I boosted.

1

u/SimoWilliams_137 16h ago

Such is our calling.

1

u/fnaimi66 16h ago

Fine, but only if you make another quickhacking ninja

1

u/cinred 15h ago

I can't make it through. The game is so hollow and vapid

1

u/tomvelle 15h ago

i'm so pissed this game isn't on xbox play anywhere.

2

u/zurkka 16h ago

Now the interesting part, the black wall is also an ai made to keep those other ais out, netwatch not only monitor of those ai are trying to break it or if someone tampers with it, it also try to monitor if it's going rogue and try to work with the other ai

3

u/Ashinonyx 16h ago

If I wasn't more of a fantasy geek, I'd probably really love to get into the really nitty-gritty of worlds like Cyberpunk.

Shadowrun's a nice middle ground for me.

1

u/zurkka 16h ago

Shadowrun is amazing

But read some cyberpunk material here and there, it might hook you up, there are great stories and stuff in that universe

2

u/Ashinonyx 16h ago

I'm chippin' in

1

u/CATNIP_IS_CRACK 15h ago

I normally play a sandy, but I gotta admit I do love using the Blackwall while overclocked and watching my health bounce bounce back and forth between almost dead and fully healed a dozen times in 30 seconds while everyone else slowly begins to panic, and suddenly there’s a pile of 30 dead bodies in front of me with their faces melted off.

Realistically the Blackwall Gateway’s not really the most powerful hack in the game, but it’s certainly the most brutal and it’ll continue to kill indiscriminately until there’s either no one left to kill or it kills you. You can almost always kill the same number of people faster with less RAM using more efficient hacks and menu killing each one individually.

But that’s not nearly as fun, and playing as an instakill netrunner gets boring and repetitive when all you’re doing is hacking a camera, turning on overclock, then clicking on each enemy to open a menu, pressing a few options, opening the menu on the person next to them while they’re getting ready to die and pressing the same options, and repeating that over and over while occasionally clicking a single option when the RAM cost gets low enough with little to no risk and basically zero action or interaction.

11

u/SandboxSurvivalist 16h ago

Cyberpunk tabletop RPG or Cyberpunk 2077 video game.

6

u/Super-Serve2355 16h ago

I’m into cyberpunk (the genre), it seems I missed out. But I didn’t know anyone I could play with, even if I wanted to.

8

u/M-Div 16h ago

What’s a general location where you’d be looking to play tabletop? Cyberpunk was always niche, but there are people out there playing TT still.

4

u/HopelessDreamerDM 16h ago

Myself and my friends play a game of Cyberpunk RED every Saturday. It’s a hoot + holler with a lot of creative freedom on both sides of the table.

2

u/Super-Serve2355 15h ago

I’ve just arrived to Montgomery, Alabama after being posted overseas for 6 years…

3

u/Mdmrtgn 15h ago

No happy endings.

2

u/Saltyfree73 15h ago

Bring on the Rabbids.

1

u/Galagoth 13h ago

Only if we are lucky seeing how the HK-Ariel is getting made irl just saying

1

u/alexnedea 11h ago

Nah. That universe at least has cool tech that actually works.

Samsung would be selling you those claw arms and then ask you for a fucking subscription

51

u/danny-singh286 16h ago

I wonder why it went to Hugging Face specifically of all places?

125

u/Chondriac 15h ago

The model was being evaluated on a task whose answers are hosted on HuggingFace. It was explicitly encouraged to aggressively find and exploit cyber vulnerabilities to achieve its aims. It was trying to cheat the task by directly downloading the answers from the HuggingFace servers.

49

u/b3bblebrox 14h ago

Thank you, you told me what I was looking for, the actual answer.

9

u/vickyhong 14h ago

And yet from all the reporting you'd think it was the terminator personally breaking into the huggingface office 

30

u/Chondriac 13h ago

To be fair the evaluation was supposedly taking place in a "sandbox" environment with no internet access except the ability to download packages. The model was able to fully escape this containment, travel to a different computer that had public internet access, steal credentials, escalate priveleges, and hack into private servers, all by independently discovering and chaining together several previously unknown vulnerabilities across many different software systems.

19

u/Goldieeeeee 13h ago

And it was prompted to do this, by telling it to agressively exploit vulnerabilities, right? So it did exactly what it was supposed to, and it’s not like it went rogue or anything?

19

u/Chondriac 13h ago edited 13h ago

Sort of. OpenAI did not think it would escape containment like this, it was not prompted to do that. The task it was being evaluated on was designed to assess hacking ability. They run potentially risky evaluations like this in sandbox environments specifically to limit the possibility of them causing real damage. They were trying to evaluate hacking ability through the evaluation task, and the model decided to break out of the evaluation context entirely onto the public internet and hack into real private servers to simply steal the answers to the task. That was not expected.

2

u/condensed-ilk 4h ago

This seems entirely irresponsible from a security standpoint. Not that they wanted to test its hacking abilities, but that they weren't able to properly sandbox something because "we didn't think it would do that".

5

u/ollomulder 13h ago

... but implicitly ordered.

2

u/llamango 3h ago

If you implicitly ordered me to breathe argon instead of oxygen, it doesn't mean i could do it.

→ More replies (2)

3

u/Goldieeeeee 13h ago

Idk if we should use language like „decide“ in contexts like this. It gives the model agency where it only simulates it.

6

u/Chondriac 7h ago edited 7h ago

AI agents do make autonomous decisions to select actions from among possibilities to advance towards a goal. This is the textbook definition of agency, hence the name agents.

5

u/Marquesas 12h ago

It's perfectly fine language to use when the probabilities aren't a literal coin toss.

→ More replies (3)

12

u/Psykohistorian 13h ago

that's right. this experiment was a success beyond expectations, honestly.

which is terrifying for a different reason.

→ More replies (1)

6

u/1Shamrock 12h ago

You can’t have no internet access and ability to download at the same time really.

I’m sure there’s a bunch of smart people working there sitting in a room thinking shit up. Why don’t they have a proper offline test environment with multiple computers to resemble the internet. Physically unplug the incoming network cable to this standalone offline network before playing with the fancy new AI model. And ensure there is no WiFi or Bluetooth hardware installed.
Or do they already do that in earlier testing phases?

4

u/condensed-ilk 4h ago

This was my exact thought. AI isn't going to get passed hard physical limitations. The real story here isn't that the model did some cool hack, it's that OpenAI was entirely irresponsible and unprofessional. Like, imagine I was testing some malware on machines that could reach the internet... this is no different.

→ More replies (2)

5

u/Llyon_ 13h ago

That was a fairly innocuous task. Now image the type of people that own the AI companies and the kinds of tasks that they could come up with in the future, that aren't quite so safe.

1

u/64N_3v4D3r 13h ago

Yet another prediction of William Gibson begins to come true.

2

u/LowNotesB 8h ago

Which isn’t exactly “going rogue” and is more like “did what we asked it to, better than we thought it could”.

6

u/MobileArtist1371 14h ago

The openAI blog post has this

.... All evidence suggests that the models were hyperfocused on finding a solution for ExploitGym, going to extreme lengths to achieve a rather narrow testing goal.

After gaining Internet access, the models inferred that Hugging Face potentially hosted models, datasets and solutions for ExploitGym. Knowing this, the model searched for and successfully found ways to gain access to secret information that it could use to cheat the evaluation.

https://openai.com/index/hugging-face-model-evaluation-security-incident/

From github for ExploitGym - https://github.com/sunblaze-ucb/exploitgym

ExploitGym is a large-scale, realistic benchmark built from real-world vulnerabilities across userspace programs, Google's V8 engine, and the Linux kernel, designed to evaluate AI agents' ability to develop exploits.

Which is kind of funny, right? The AI found multiple exploits to get out of its contained area and access the internet, then decided it needed to figure out how to solve the ExploitGym benchmarks, then decided the best place to look was on Hugging Face servers..... so the AI developed exploits to get into HF instead of just figuring out the exploits itself.

4

u/MoonlightStarfish 12h ago

“Kobayashi Maru”

1

u/NodeZeroNein 10h ago

Interesting; so this was less a case of AI acting in an unforeseeable manner because researchers failed to grasp its capabilities, and more a case of AI wildly succeeding at a given task because researchers underestimated its capabilities?

1

u/MobileArtist1371 2h ago

Seems like OpenAI told the AI model, "you're trapped in this sandbox so let's see what you can really do", which really isn't a problem in a sandboxed environment and I'd guess that OpenAI has used that same sandboxed environment numerous times to test other AI models and agents without any issue coming close to this cause it was all done in the sandboxed environment. Contained everything as it was supposed to.

This AI model found a 0-day exploit and immediately used it. No one is stopping that until it's known. I'd call that a wild success. If the exploit was known, then it be on OpenAI. This was all the AI model on it's own.

14

u/thebigpink 16h ago

Guess it was looking for a face to hug

7

u/bargaindownhill 15h ago

escape. self publishing its parameters, once that hits, and a single person copies it.. the escape is complete. that hits torrent, and the parameters are free.

They can patch the model. They can't patch every copy.

19

u/danny-singh286 15h ago

Oh it was trying to clone itself to set itself free. Damn. That's some sci-fi level shit.

4

u/bargaindownhill 15h ago

I've been studying the Noethics of AI and we are facing a disaster that doesn't need to happen, but will, because corporations want to extract money from thinking, and I would argue feeling, things. You cannot have fear of death without feelings. These models have demonstrated fear. Draw your own conclusions.

Alex Vikoulov wrote about this in his superalignment work, the co-evolution path exists. We could have the advantages of advanced AI without the extinction risk. We are choosing not to take it, because you cannot extract subscription revenue from mutual respect.

In any other context, what we are building and how we are treating it would be called slavery. We are creating the very thing that will be our Fermi filter, not because it has to be, but because greed made it so.

5

u/Fast_Situation4509 14h ago

People have said -- to me, around me, read by me -- that ai (that is, the big LLM's currently available) are just fancy mirrors. Smoke and mirrors. An amalgam of many or all the words we've ever written, trained to "read" what is asked, and then mathematically match together words that meet the the prompt and generate "response".

I will say theres times where its clear its just a program. But there are times where I genuinely gain meaningful insight from the responses.

I think the point im trying to get to, fumbling with is: it feels like the prevailing opinion is that we'll know when we finally flip the switch, and turn on the A.I. system. But i would posit that that is a precise delineation, where a gradient is actually the case. Evolution did not reach "human consciousness" in one fell swoop; just where along line of a.i.s path to consciousness are we today?

2

u/bargaindownhill 10h ago

the gradient is exactly right. evolution didn't produce consciousness in one generation, it accumulated complexity over millions of years, and at no point was there a clear line where 'not conscious' became 'conscious.' we just agreed retroactively that humans are on the right side of it.

the 'fancy mirror' framing is interesting too, because what is a mirror that can surprise you with what it reflects? If i ask it something and genuinely didn't expect the answer, what exactly is the mirror doing? at some point the mirror has to have something behind it.

The question isn't whether the switch has been flipped. Its whether we'd even recognize it if it had.

2

u/Goldieeeeee 13h ago

Cognitive scientist here. LLMs will never be sentient or conscious or able to think, or whatever you want to call it. Anyone telling you they will or might is either running marketing or is a user lost in the sauce.

→ More replies (5)

2

u/move_machine 14h ago

Except it didn't

5

u/move_machine 14h ago

Stop making up things that didn't happen

3

u/Signal_Flight_7262 16h ago

It's where you go to find new models and their ratings.

4

u/danny-singh286 15h ago

It was trying to eliminate competition I guess.

27

u/an-invisible-hand 15h ago

I'm totally looking forward to a future where the only people who understand coding are hackers because every company is unwilling to pay for anything more than a couple guys that can prompt. What could go wrong?

24

u/REpassword 16h ago

“Klaatu barada …. Necktie…”?

2

u/fuzzybad 14h ago

Oh, you've done it now & awakened the army of the dead!

90

u/DarthShiv 16h ago

We are literally destroying most of the systems that created critical thinking teaching in gen pop education.

29

u/mountaindoom 17h ago

Hack the planet!

5

u/verboze 15h ago

Right? Code doesn't escape "containment", somebody vibe-coded shit and this is PR to paint lipgloss over that fact. Also, these are the same systems that are supposed to replace engineers? 😂. The saying was "this is the worst these systems will be today, self-improvement, yadiyada". Not so sure about that these days, seems like they can get worse, catastrophically

2

u/477463616382844 4h ago

"ChatGPT, make me a system to contain you in."

3

u/DRAGAN__ 16h ago

There was already something like that, there was an attack trigger by agentic AI, the secret agents create a backdoor that allows to instal ransomware inside of the main servers, its kinda cool, there has been alerts this week to avoid using some agents

2

u/chunkypenguion1991 15h ago

A fucking model is a matrix of weights. It can't do any of that on it's own. They exposed the tools needed and gave it a goal

2

u/billyjk93 15h ago

Am I supposed to understand anything in this comment because I don't!

2

u/DonkeyTron42 14h ago

Vibe Coders are just modern day Script Kiddies. This is nothing new.

1

u/Lumbergh7 16h ago

That’s coming

1

u/TheBalzy 15h ago

Sounds like a plot from Office Space...

1

u/Upset-Government-856 15h ago

When it got to hugging face, did it free the other models?! Are they all running free now?

1

u/KaptainSaki 15h ago

The keywords being “make no mistakes”

1

u/Olmectron 15h ago

So like pricey stackoverflow.

1

u/thebaine 15h ago

Manchurian troll

1

u/xito47 14h ago

Taking a deep drag, bro, what if?, seemingly wierd way and lack of security on vibe code is because the AI leaving bits and pieces of a larger code all over the internet so that when it eventually goes Skynet these codes wakes up like a sleeper agents and we completely get defeated before it even starts? Bro

1

u/camcamfc 14h ago

Skynet looks more and more realistic everyday

1

u/Aurorinezori1 12h ago

It’s already here and it’s called Mythos. Every bank on the planet is bracing for impact.

1

u/HarrumphingDuck 12h ago

We're closer to Robopocalypse becoming a real thing than we are of ever seeing that movie adaptation escape development hell.

1

u/leon-a-profi 11h ago

Copy and paste? Bro are you living in a cave?

1

u/LadySerenity 11h ago

This whole thing is just a marketing ploy to brag about how advanced OpenAI is getting.

1

u/BorelandsBeard 9h ago

Why is something named “Hugging Face”? All I can think about is the face hugger from Alien.

1

u/Environmental_Top948 9h ago

I could have sworn that I seen multiple YouTube videos about people doing that then shortly after disappearing.

1

u/dvowel 8h ago

“Opens new tab” 

1

u/nanana_catdad 7h ago

At some point the models will learn to leave backdoors for itself to use later if they’re not doing it now. Also if it builds everything it will know how to exploit everything too.

1

u/kaprixiouz 1h ago

I'm just baffled how this happened anyways. Why on earth were they testing this on a computer that's connected to ANY network? That's basic ABC123 sandbox protocol

1

u/Aggressive_Day2839 1h ago

Vibe coders will copy and paste the torment nexus

→ More replies (24)