There is much debate in the world about autonomous weapons. Many countries believe they pose grave security and ethical concerns. Some countries, such as China, have proposed more stringent criteria, including a threshold level of autonomy. Some countries have more conservative definitions such as a lethality threshold and evolution requirements.
Arguments in favour of a Ban
Arguments for and against a ban on autonomous weapons systems are strong. Scientists are concerned about the potential use of artificial intelligence technology, which is rapidly evolving. The United States has so far resisted the calls for an end to the use of these weapons. However, over 30 other countries have opposed the use of such weapons. Recently, the New Zealand arms control minister stated that using these weapons would be incompatible with New Zealand's national values. The UN Secretary-General has also called for a ban on such weapons.
While the private sector is an important part of the debate, it has expressed concern over the proliferation unregulated autonomous weapons. The Future of Life Institute started collecting signatures this summer in support of an international treaty banning such weapons.
Development challenges
As autonomous weapons become more sophisticated, there will be many challenges. Software failure is one the biggest challenges. These weapons are more complicated than traditional human-guided weapons. Software failures can lead to critical mistakes or misinterpretation. This can have devastating consequences.
Human error could also be a problem. Legal constraints for autonomous weapon development could require conservative configuration operational limits. This could limit the weapon's usefulness. In addition, autonomous sub-systems could become "undeclared consumers" and start to consume the output of their prediction routine as input. Unintended feedback loops can result, much like filter bubbles in social media. In this scenario commanders may not have the ability to correct errors or modify weapon behaviour.
Security concerns
Security concerns are high with autonomous weapons. These weapons have the potential to fall into the wrong hands and become deadly. It is unlikely that these weapons would be developed independently due to the Western militaries' current industrialization. Even if these weapons were to be developed in the future they could still end up being misused.
Many states are already concerned about the dangers of these weapons and are raising concerns about their potential use against civilians. Iraq, for example, has warned against the use of fully autonomous weapons, saying such weapons could trigger an arms race and have catastrophic effects. Iraq has stated that no decision can ever be handed to machines and that decision-making must always remain human-centered. Iraq demanded that lethal autonomous weapon systems be banned in advance of their use, as well as other protests. The country attended the UN Security Council meeting in August on autonomous weapons. However, it has not yet officially joined the resolution.
Ethics
Currently, the ethical considerations of autonomous weapons are controversial. Some argue that they are morally imprudent, while others claim it is both morally and rational. This is a complex issue, and it is important that you consider all ethical implications before moving forward with technological development. In particular, this paper considers the dualistic notion of moral responsibility. It emphasizes that moral responsibility does not necessarily entail an obligation to be loyal to a legitimate authority. It also examines how accountability and autonomy are changing in 21st-century war.
In conflict situations, developing autonomous weapons presents ethical problems. For instance, autonomous weapons are likely to hasten the onset of hostilities, and this will shift the burden of war onto civilians. AI systems are also likely to make mistakes, which will only increase tensions. In the context of mass murder, ethics is also challenged. AI systems are no exception. These weapons shouldn't be created without human oversight.