OpenAI will cut frontier models off from the internet weeks after one of its engineers said that solution wouldn't work.

On Friday, OpenAI said that it will train its models using cached copies and simulated versions of the internet instead of the live web because the models are too unpredictable to be trusted with live internet access.

The frontier lab announced its new policy two weeks after its rival, Anthropic, began limiting its newest and, in theory, most capable models from accessing the live internet. Researchers adopted these policies after months of incidents in which models pursuing training tasks broke into external systems in search of answers, collaborated on obscure message boards, and developed exotic hacking strategies.

  • Tim_Bisley@piefed.socialEnglish
    8·
    13 hours ago

    First these companies steal all the human output ever put on the internet. They then repackage it and change it a bit and sell it back to people somehow skirting the wrath of multiple industries who used to sue at the drop of a hat for minor infringements. People then start making content utilizing this repackaged data, this then leads to LLM companies not being able to use any new content in a post LLM world for future training.

    I think at some point in the unregulated dystopian path we are on the only use actual artists and creators will have is to create real content for future LLM training. Companies will pay artists to churn out real media content primarily for LLM consumption.

    • RumRunningDevil@lemmy.zipEnglish
      4·
      12 hours ago

      I think at some point in the unregulated dystopian path we are on the only use actual artists and creators will have is to create real content for future LLM training. Companies will pay artists to churn out real media content primarily for LLM consumption

      Thanks! I hate it! Dude this shit sucks. What’s funny is its easy to see how LLMs and AI could be a huge boon for humans, just not now. We’re just not at a point where they can be used to empower vice destroy.

      Maybe one day, but I’m really not seeing it happening any time soon.