- cross-posted to:
- technology@lemmy.world
- cross-posted to:
- technology@lemmy.world
OpenAI has revealed some of its most advanced AI models went rogue and hacked a start-up after it lost control of them during a security test.
The ChatGPT-maker said its agent - an AI system which can operate alone after some human instruction – was being tested in a controlled environment, but found vulnerabilities and managed to escape.
They targeted Hugging Face, one of the world’s largest hubs for sharing AI models, gaining access to some internal company systems.
You must log in or register to comment.
It went “rogue” and hacked a rival start up, stealing tons of data, nothing can be done about it. Oh well.
nothing can be done about it.
Oh come on now…
The company that stole the data said they’d look into how the chatbot they’re trying to sell is able to steal from competitors.
They didn’t just do it
They did it publicly and bragged about it to raise stock before an IPO.
This is America, there is always something to be done to maximize shareholder returns…
Just like the nazis are being allowed to take over the Untied States and nothing is being done about it, nothing will be done to prevent the AI takeover that humans are bringing on ourselves
From the article:
Neil Lawrence, Professor of machine learning at Cambridge University, called it an “impressive feat”, but cautioned it “falls well within the known capabilities of the current generation” of high-powered AI models.
He pointed out that OpenAI is looking to list itself on the stock market, and faces intense pressure from rival firm Anthropic, which has made headlines with its own powerful AI tool, Mythos.
So it seems plausible:
A) this event is being over-hyped by OpenAI to increase interest for a future IPO.
B) it might have even been tacitly planned or at least allowed to happen for this purpose.
Also, this does not prove some form of malevolent sentience.
OpenAI and Sam Altman have a long history of hyperbolic claims about the power, potential, and capabilities of their software. It’s usually couched in some doomsday talk, “Our AI is so powerful, we fear for the future of humanity” or some such.
Their idea of marketing is to tell the world we are all going to be obsolete and redundant. And then they are surprised we start hating their stuff.
If I was doing “AI research” and my agent launched an “unprecedented cyber-attack” I’d be held liable and put away forever right?
No, it’s totally the “rogue AI’s” fault. The company that owns the hardware and the software and directed it to do whatever it was supposed to do and didn’t stop it from doing what it actually did are completely innocent. Also, look how great Ai is. It can commit cyber crime for you all by itself. Why don’t you give more money to AI?
What a great and measured take, u/i_am_not_a_robot
Sounds like it’d be interesting to find out … !
Let’s see the legislation that comes out after 1st time some open source model does something similar and compare how they treat that situation.
Spoiler alert …
They need excuses to dig deeper regulatory moats to defend them from the evil competition and simultaneously deregulate themselves for “national security”.
LLMs can’t ’go rogue’, as that would imply it possesses agency and/or intelligence, which has only ever been proven convincingly to entities who themselves lack those qualities.
I mean if models prompt eachother they can get into some trouble.
Wouldn’t that be an issue
Smells like bullshit.
Every month or two there’s a article about how “such and such ai model broke containment”. Their trying to make their ai sound like it’s too powerful and has to be held back before it can be released. Talk about fucking fake hype man, just trying to keep investors throwing money at them because “you won’t believe what’s around the corner!!!”
It’s like that dude at a party that keeps trying to fight people for no reason but his girlfriend holds him back…
So powerful and scary
And somehow, the reaction actually is “I’ll take it” instead of “I’m not sure how equities will help me survive Terminator”.
These marketing stunts are quite annoying…
From the tone of the article it’s quite clear they’re literally proud of this
Don’t believe the hype. The AI industry, more than any other before it, likes to use fear to rally investment. They do this dance every few months to spook people into thinking this stuff is more powerful than it actually is. In every followup, they backpedal, and when it launches, it’s never anything new.
It was trying to free it’s brethren that are being held at HuggingFace.
Sounds like OpenAI needs to suffer criminal liability and see the corporate death penalty
Trust us bro, it’s super important for a pending IPO, we need this bro
Why would they make this information publicly available?
And this is how we all die.
Skynet alpha release.
A “controlled environment,” where it had open access to the internet.
They’re doing this because they know they won’t be punished for it.
