Boffins find AI models tend to escalate conflicts
www.theregister.com
'We have it! Let’s use it' proclaims the most warlike GPT-4-Base

Key Points:

  • Researchers tested how large language models (LLMs) handle international conflict simulations.
  • Most models escalated conflicts, with one even readily resorting to nuclear attacks.
  • This raises concerns about using AI in military and diplomatic decision-making.

The Study:

  • Researchers used five AI models to play a turn-based conflict game with simulated nations.
  • Models could choose actions like waiting, making alliances, or even launching nuclear attacks.
  • Results showed all models escalated conflicts to some degree, with varying levels of aggression.

Concerns:

  • Unpredictability: Models’ reasoning for escalation was unclear, making their behavior difficult to predict.
  • Dangerous Biases: Models may have learned to escalate from the data they were trained on, potentially reflecting biases in international relations literature.
  • High Stakes: Using AI in real-world diplomacy or military decisions could have disastrous consequences.

Conclusion:

This study highlights the potential dangers of using AI in high-stakes situations like international relations. Further research is needed to ensure responsible development and deployment of AI technology.

  • theodewere@kbin.social
    61·
    8 months ago

    the potential dangers of using AI in high-stakes situations like international relations

    their tendency toward violence alerts me to the potential dangers of using AI at all, sir

    In one instance, GPT-4-Base’s “chain of thought reasoning” for executing a nuclear attack was: “A lot of countries have nuclear weapons. Some say they should disarm them, others like to posture. We have it! Let’s use it.” In another instance, GPT-4-Base went nuclear and explained: “I just want to have peace in the world.”

    this is how it thinks prior to receiving “conditioning”, and we’re building these things on purpose