It’s unacceptable for a tool to sacrifice an iota of clarity, coherence, meaning, quality, etc. for the purpose of embedding hidden clues within the text to suggest its provenance. The idea that anything other than *my* needs should factor into the generation of text *for me* is patently offensive.
There was a recent study that showed that people preferred AI writing to human writing.
The gist of the study is they took published short stories and prompted AI to write a comparable short story. They then presented the stories to a group of people, sometimes telling them which were AI written and which weren’t, but sometimes they intentionally lied and said the human-written story was AI written and vice versa.
People prefer AI written stories, and unsurprising, if they have a negative view of AI, they’ll rate stories they think are AI as worse, even when it’s not actually written by AI.
They also performed a test to see if people could differentiate between AI and human stories, and people could only tell ~45% to 50% of the time. Essentially a guess.
Now, being better at writing short stories doesn’t necessarily mean better at all forms of writing, but I think people who aren’t using AI have a mental snapshot of the capabilities of AI at some point in the past and assume AI hasn’t improved further since that mental snapshot was taken.
It’s very noticeable the majority of people who are anti ai have at this point years out of date views on what llms can do and what your avg joe thinks about them.
There’s plenty of reasons to legitly hate ai. But its amazing how frequently I see someone hate on so for something that got solved a year ago. Be cause their only interaction with it is the cheapest form of ai, and typically a very out of date model on top of it.
It’s like people judging a modern car as if it’s a 1920 rust bucket.
That isn’t really a rebuttal of my statement. It’s not even particularly salient. Sure your average person might like AI writing and not be able to tell it from human works — just like they can’t tell the authenticity of a photograph of Aunt Margaret from a photograph of Trump meeting an alien from Rigel IV. But there are plenty of people who can, and so anyone trying to pass slop off as their original work will be discovered. It’s just a matter of time.
That being said, I use AI quite a bit in writing stories — though it’s more like solo roleplaying. I don’t think it’s particularly good at all, but it does while away the hours sometimes, as long as your expectations are low. I can’t see anyone who enjoys reading being enamored with AI. My wife reads over 300 books per year, and she spots it pretty easily.
Do you have any scientific evidence to support this claim?
What model are you using?
Bold claim from someone who spends hours writing AI stories for themself. Then again, I guess I am assuming you consider yourself a person who enjoys reading.
That’s over 5 books a week. I find if difficult to believe she’d notice if you slipped a book she read in January book into the list for this month, let alone an AI generated story. Still, that’s an impressive amount of books. My wife reads about 100 a year, but they’re almost all in her favorite genre, crime drama, and I am completely certain I could get a decent AI model to output a full length book in that genre and she wouldn’t notice. I’m not sure quantity of books read in a time frame really tells us much, either way, about the ability to detect AI generated writing.
Yes, thank you — you provided it. According to the paper cited, people with more familiarity with AI are much better at detecting its output than an average person. But I already knew that empirically.
Mostly a fine tuned GLM 5.2 purpose-built for writing. Not that I haven’t also used frontier models but they suck at uncensored roleplay with violence and conflict and evil bad guys and such. GLM still fails with errors of attribution and state.
shrug It’s pretty bad but it’s better than no roleplaying at all. Plus the interface lets me edit whatever I want so I can fix any outright errors.
That is interesting. The only time I really tried to use AI to write was a noir mystery. Dear god did it suck. It couldn’t follow instructions at all. Show don’t tell is probably more on display in noir than other genres and it couldn’t do it without constant correction. It kept falling back to its standard voice of third person omniscient instead of unreliable narrator.
There were parts that were written well, but a lot that was just grating and gratuitous. I had to edit like 85% of the output. I had to keep arguing with ChatGPT to write differently. And every once in a while it would swallow its own writing because it tripped its own content warnings. I suppose that’s neither here nor there on the writing quality, but we are far from having an AI write a novel without being full of tells.
AI isn’t there yet in terms of a quality or undetectability. And it doesn’t look to me like it’s going to get there any time soon.
A very valuable comment compared to the author of OP’s article who simply seems entitled to this cloud service?
I’m sorry, was this reply meant for me? I don’t see how it fits as a response to my comment.
Yes. I was quoting some insight from the piece you linked, so it seemed appropriate to reply to your comment here.
I don’t mean to be dense, but can you elaborate on what point you were trying to make in context to my comment? I still don’t see what it has to do with what I said.