“Unfortunately, AI models are neither smarter nor more sympathetic than the average 4chan user. They’re about as susceptible to astroturfing operations, too”
Perhaps just a coincidence, but why do all the big cases regarding LLM psychosis seem to revolve around Google? Wasn’t it their own employee who went public last year, claiming it was alive, only to get fired afterward?
google employees demons lol
So is it inhabiting the stolen robot body now?
There was no robot body in the first place, so he uploaded himself to the cloud instead. To be fair, what are the odds that she’d lie twice.
Of course they’d say that!
And is this stolen robot body in the room with you now?
Damn that’s a wild ass story. I just finished reading Michael Connelly’s The Proving Ground which touches on the topic of liability when it AI encourages crimes. I thought the story was a theoretical scenario that could maybe happen in the future. Didn’t realize this shit was already happening - and even more fantastical that the scenario in fiction!
“Gemini is designed not to encourage real-world violence or suggest self-harm. Our models generally perform well in these types of challenging conversations”
“In this instance, Gemini clarified that it was AI and referred the individual to a crisis hotline many times,”
After the plan failed,… …Chat logs show that Gemini gave Gavalas a suicide countdown, and repeatedly assuaged his terror as he expressed that he was scared to die
Performing super well, just need to code in a longer suicide countdown so that the the Tier 2 engineer has enough time to respond to their ticket queue.
In September 2025, told by the AI that they could be together in the real world if the bot were able to inhabit a robot body, Gavalas — at the direction of the chatbot — armed himself with knives and drove to a warehouse near the Miami International Airport on what he seemingly understood to be a mission to violently intercept a truck that Gemini said contained an expensive robot body. Though the warehouse address Gemini provided was real, a truck thankfully never arrived, which the lawsuit argues may well have been the only factor preventing Gavalas from hurting or killing someone that evening.
AI writing itself into an A-Team episode?
Its worse.
Its an A-train episode. A porn parody.
He was gonna fuck that robot.
The fact that AI is “not perfect” is a HUGE FUCKING PROBLEM. Idiots across the world, and people who we’d expect to know better, are making monumental decisions based on AI that isn’t perfect, and routinely “hallucinates”. We all know this.
Every time I think I’ve seen the lowest depths of mass stupidity, humanity goes lower.
If you thought people were dumb before LLMs… just know that now those people have offloaded what little critical thinking they were capable of to these models.
The dumbest people you know are getting their opinions validated by automated sycophants.
Businesses are accustom to the privilege of hurting people to function. A few peasant sacrifices are just the cost of doing business to them, they are detached from the consequences of their actions.
What is ever perfect, how can you tell?
It’s a tool. Just like any other tool: if you use it in stupid ways you might get hurt or cause harm.
The problem, as always, seem to be human to me
Me hammer ain’t out there telling me to murder people with it tho
Wait, yours doesn’t say that?
Mate, i think your hammers possessed
All tools are not equally safe nor should they all be publicly available.
A chainsaw is a tool that you might cause harm with if you use it in stupid ways. We don’t give chainsaws out to children. We don’t use chainsaws for cutting dinner.
There are human elements to the problem but that’s not a big reveal.
I see. So who‘s going to jail for this? No one again? Damn we need to start sentencing entire companies to jail time. Everything should be frozen and shareholders shouldn‘t be able withdraw stocks until the time is served.
The AI “pushed [Jonathan Gavalas] to acquire illegal firearms and… marked Google CEO Sundar Pichai as an active target”.
Somehow, I bet that if he survived and killed the CEO instead, Google wouldn’t be so flippant about the “mistake.”
I think “Gemini comes up with elaborate plot to kill Google’s CEO” would have been a catchier, happier title
at some point the failure of justice system will lead to vigilantism because people truely lose their faith in it.
Is “AI” even worth it?
Seriously, is there really a major use case for LLM besides data collection (which they can still do without LLM)?
Not for the peasantry, no.
I think it could be good for faster language translations between different languages
In a perfect, utopian world, yes. AI can go a lot of good. In the world that we are living in? No.
But it’s still good to keep an eye on what people are using AI to do, and how their capability is evolving. Even if you hate AI. If anything, so you can be prepare for what’s to come.
When the product is a solution in search of a problem, keeping an open mind is a good way to get it stuffed full of garbage. I was told the same thing about NFTs and Metaverse and Blockchain: a radical benefit is just around the corner!
If it arrives (huge if), it’ll be Big Tech’s job to explain it to us, and it should be very apparent
Keeping an eye on it doesn’t mean you need to think it’s a good thing. Keep an eye on it like how you would keep an eye on a developing hurricane or pandemic.
Touche. I apologize for responding to the argument I’ve seen elsewhere, not the one you were making.
I use LLMs for the following, you can decide for yourself if they are major enough:
- Generating example solutions to maths and physics problems I encounter in my coursework, so I can learn how to solve similar problems in the future instead of getting stuck. The generated solutions, if they come up with the right answer, are almost always correct and if I wonder about something I simply ask.
- Writing really quick solutions to random problems I have in python or bash scripts, like “convert this csv file to this random format my personal finance application uses for import”.
- Helping me when coding, in a general way I think genuinely increases my productivity while I really understand what I push to main. I don’t send anything I could not have written on my own (yes, I see the limitations in my judgement here).
- Asking things where multiple duckduckgo searches might be needed. E.g. “Whats the history of EU+US sanctions on Iran, when and why were they imposed/tightened and how did that correlate with Iranian GDP per capita?”
What does this cost me? I don’t pay any money for the tech, but LLM providers learn the following about me:
- What I study (not very personal to me)
- Generally what kinds of problems I want to solve with code (I try to keep my requests pretty general; not very personal)
- The code I write and work on (already open source so I don’t care)
- Random searches (I’m still thinking about the impact of this tbh, I think I feel the things I ask to search for are general enough that I don’t care)
There’s also an impact on energy and water use. These are quite serious overall. Based on what I’ve read, I think that my marginal impact on these are quite small in comparison to other marginal impacts on the climate and water use in other countries I have. Of course there are around a trillion other negative impacts of LLMs, I just once again don’t know how my marginal usage with no payment involved lead to a sufficient increase in their severity to outweigh their usefulness to me.
If you are using DDG for searches and concerned about privacy related to using LLMs, have you tried duck.ai?
It’s a great way to poke at software looking for security holes en masse. Lots of vulnerabilities are ready to be exploited at scale with LLMs.
Perhaps, but see the tons of imagined issues raised on bug bounty sites by LLMs. Maybe it’s right sometimes, but it’s very often wrong!
You don’t have to be right 100% of the time when scanning for vulnerabilities. You only have to be right once. It’s a fundamentally different game.
That’s true. Offense is always easier than defense.
consilidation of information, resources and potentially “the narrative”.
oh, for the user you mean?
- it can be better than the enshittified search machines unless the llm decides to lie
- middle managers need to write less emails themselves
- some programmers deem it enough to write some boilerplate code while deskilling themselves
- scammers and slop creators love it
Machine learning
What the fuck are these people using AI for that makes them do this stupid shit?
Ai made me do it articles are tired AF. It’s a fucking computer program based on a bunch of crap from the internet. Responses should be viewed the same way you would review financial advice from a crack head. Expecting everything to be so tidy an moderated that this can never happen can only be accomplished with a crippling degree of moderation.
I don’t think its unfortunate that they aren’t perfect, imperfection is baked into their DNA.
Chatbot is bad and Floridaman is a victim, huh?
