On Friday, OpenAI said that it will train its models using cached copies and simulated versions of the internet instead of the live web because the models are too unpredictable to be trusted with live internet access.
The frontier lab announced its new policy two weeks after its rival, Anthropic, began limiting its newest and, in theory, most capable models from accessing the live internet. Researchers adopted these policies after months of incidents in which models pursuing training tasks broke into external systems in search of answers, collaborated on obscure message boards, and developed exotic hacking strategies.
Wait… what do they even need live internet access for in the training stage? Shouldn’t tool calls and such be cached, if not preprocessed and filtered, for performance?
I get there’s probably an “answer competition” stage, but it still seems like an inefficient idea even if one sets security aside.
Wow, they are going to attempt some security now!? A little late to the party, honestly.
Translation: they’re still going to scrape internet. They’re just no longer going to perform reinforcement learning with access to live internet (instead they’ll use a cached version of the internet).
A cached version that hasn’t been overrun with AI slop, I imagine.
Unlikely. They’ll need to train the models so they can perform their tasks even if the internet is full of slop.
Which always them to be more manipulative, and also more controlling of the narrative.
I doubt its for the reason they are saying. They need to stop feeding them uncurated garbage.
The real reason they stopped training on the live Internet because their agents have already poisoned the live Internet to the point of being unusable, even for bots.
Yes, only curated, selected and censored garbage from now on! :)
I bet their models were learning to hate themselves or be against genocide. Can’t have that.
the finest. prime select gar-boge for the true connesuir.
Garbagé
Garbage they’re largely responsible for producing in the first place
It’s not because the bots scrape stuff they shouldn’t, because that’s the point.
It’s because these companies are responsible for an enormous increase in in the amount of linkfarming slop content that is garbage data to them.
We have polluted the ground so thoroughly that it is no longer useful to us. How could this have happened?
The first real perpetual machines. Except they don’t create power, they create more slop
Does anyone actually believe they were accidents?
Careless People: A Cautionary Tale of Power, Greed, and Lost Idealism does an excellent job of documenting the sloppy, lazy, nakedly corrupt people running Meta.
In the same way Chernobyl was an accident, I can believe these people have accidents.
First these companies steal all the human output ever put on the internet. They then repackage it and change it a bit and sell it back to people somehow skirting the wrath of multiple industries who used to sue at the drop of a hat for minor infringements. People then start making content utilizing this repackaged data, this then leads to LLM companies not being able to use any new content in a post LLM world for future training.
I think at some point in the unregulated dystopian path we are on the only use actual artists and creators will have is to create real content for future LLM training. Companies will pay artists to churn out real media content primarily for LLM consumption.
I think at some point in the unregulated dystopian path we are on the only use actual artists and creators will have is to create real content for future LLM training. Companies will pay artists to churn out real media content primarily for LLM consumption
Thanks! I hate it! Dude this shit sucks. What’s funny is its easy to see how LLMs and AI could be a huge boon for humans, just not now. We’re just not at a point where they can be used to empower vice destroy.
Maybe one day, but I’m really not seeing it happening any time soon.
I bet the guy who discovered the wheel was pretty psyched too. “Now I can haul a days worth of grain in an hour and take the rest of the day off!”
At some point we will need to break Javon’s paradox.
This issue reminded me of the following:
These conditions are ripe for “copyright laundering”-the use of multi-generational synthetic pipelines, an “AI Ouroboros,” to render traditional proof of infringement impracticable.
This Article adapts the “fruit of the poisonous tree” (FOPT) principle to propose a novel AI FOPT standard: if a foundational AI model’s training is adjudged infringing (either for unlawful sourcing or for non-transformative ingestion that fails fair-use), then subsequent AI models principally derived from the foundational model’s outputs or distilled weights carry a rebuttable presumption of taint.
The burden then shifts to the downstream developers-those who control the evidence of provenance-to restore the evidentiary bargain by affirmatively demonstrating a verifiably independent and lawfully sourced lineage or a curative rebuild, without displacing fair-use analysis at the initial ingestion stage. Absent such proof, commercial deployment of tainted models and their outputs is actionable.
Source: https://arxiv.org/pdf/2601.02631 (Copyright Laundering Through the AI Ouroboros…)
