On Friday, OpenAI said that it will train its models using cached copies and simulated versions of the internet instead of the live web because the models are too unpredictable to be trusted with live internet access.
The frontier lab announced its new policy two weeks after its rival, Anthropic, began limiting its newest and, in theory, most capable models from accessing the live internet. Researchers adopted these policies after months of incidents in which models pursuing training tasks broke into external systems in search of answers, collaborated on obscure message boards, and developed exotic hacking strategies.
It’s not because the bots scrape stuff they shouldn’t, because that’s the point.
It’s because these companies are responsible for an enormous increase in in the amount of linkfarming slop content that is garbage data to them.
We have polluted the ground so thoroughly that it is no longer useful to us. How could this have happened?
The first real perpetual machines. Except they don’t create power, they create more slop