Developments on both sides of the Atlantic signal push to develop AI attack drones

Artist impression of crewed aircraft operating with autonomous drones. Credit: Lockheed Martin

Recent government and industry announcements signal clear intent by both the US and the UK to press ahead with the development of a new generation of AI attack drones despite serious concerns about the development of autonomous weapons. While most details are being kept secret, it is clear from official statements, industry manoeuvring and budget commitments that these new drones are expected to be operational by the end of the decade.

The current focus is the development of drones that were previously labelled as ‘loyal wingman’ but are now being described either as ‘Collaborative Combat Aircraft (CCA) or ‘Autonomous Collaborative Platforms (ACP).  As always, the nomenclature around ‘drones’ is a battlefield itself.  The concept for this type of drone is for one or more to fly alongside, or in the vicinity of, a piloted military aircraft with the drones carrying out specifically designated tasks such as surveillance, electronic warfare, guiding weapons onto targets, or carrying out air-to-air or air-to-ground strikes.  Rather than being directly controlled by individual on the ground such as current armed drones like the Reaper or Bayraktar, these drones will fly autonomously. According to DARPA officials (using the beloved sports metaphor) these drone will allow pilots to direct squads of unmanned aircraft “like a football coach who chooses team members and then positions them on the field to run plays.”

Next Generation

In May, the US Air Force issued a formal request for US defence companies to bid to build a new piloted aircraft to replace the F-22.  However, equally important for the ‘Next Generation Air Dominance (NGAD)’ program is the development of new autonomous drones and a ‘combat cloud’ communication network.  While the development of the drones is a covert programme, US Air Force Secretary Frank Kendall said they will be built “in parallel” to the piloted aircraft. Kendall publicly stated that the competition to develop CCA was expected to begin in Fiscal Year 2024 (note this runs from Oct 2023 to Sept 2024).

While it is planning to build around 200 of the new crewed aircraft, Kendall told reporters that the USAF is expecting to build around 1,000 of the drones. “This figure was derived from an assumed two CCAs per 200 NGAD platforms and an additional two for each of 300 F-35s for a total of 1,000,” Kendall explained. Others expect even more of these drones to be built.  While the NGAD fighter aircraft itself is not expected to be operational until the 2030s, CCA’s are expected to be deployed by the end of the 2020’s.

It’s important to be aware that there will not be one type of drone built under this programme, but a range with different capabilities able to carry out different tasks.  Some of them will be ‘expendable’ – that is designed for just one mission – something like the ‘one-way attack’ drones that we have seen increasing used in Ukraine and elsewhere; some will be ‘attritable’, that is designed that if they are lost in combat it would not be severely damaging, while others, described as ‘exquisite’ will be more capable and specifically designed not to be lost during combat.  A number of companies have set out their proposals, with some even building prototypes and undertaking test flights. Read more

New trials of AI-controlled drones show push towards ‘killer robots’ as Lords announces special inquiry

General Atomics Avenger controlled by AI in trial

Two recently announced trials of AI-controlled drones dramatically demonstrates the urgent need to develop international controls over the development and use of lethal autonomous weapon systems known as ‘killer robots’.

In early January, the UK Ministry of Defence (MoD) announced that a joint UK-US AI taskforce had undertaken a trial of its ‘AI toolbox’ during an exercise on Salisbury Plain in December 2022.  The trial saw a number of Blue Bear’s Ghost drones controlled by AI which was updated during the drone’s flight. The experiments said the MoD, “demonstrated that UK-US developed algorithms from the AI Toolbox could be deployed onto a swarm of UK UAVs and retrained by the joint AI Taskforce at the ground station and the model updated in flight, a first for the UK.”  The trials were undertaken as part of the on-going US-UK Autonomy and Artificial Intelligence Collaboration (AAIC) Partnership Agreement.  The MoD has refused to give MPs sight of the agreement.

Two weeks later, US drone manufacturer General Atomics announced that it had conducted flight trials on 14 December 2022 where an AI had controlled one of its large Avenger drones from the company’s own flight operations facility in El Mirage, California.

Blue Bear Ghost drones in AI in trail on Salisbury Plain

General Atomics said in its press release that the AI “successfully navigated the live plane while dynamically avoiding threats to accomplish its mission.” Subsequently, AI was used to control both the  drone and a ‘virtual’ drone at the same time in order to “collaboratively chase a target while avoiding threats,” said the company.  In the final trial, the AI “used sensor information to select courses of action based on its understanding of the world state. According to the company, “this demonstrated the AI pilot’s ability to successfully process and act on live real-time information independently of a human operator to make mission-critical decisions at the speed of relevance.”

Drone Wars UK has long warned that despite denials from governments on the development of killer robots, behind the scenes corporations and militaries are pressing ahead with testing, trialling and development of technology to create such systems. As we forecast in our 2018 report ‘Off the Leash’ armed drones are the gateway to the development of lethal autonomous systems.  Whiles these particular trials will not lead directly to the deployment of lethal autonomous systems, byte-by-byte the building blocks are being put in place.

House of Lords Special Committee

Due to continuing developments in this area we were pleased to learn that the House of Lords voted to accept Lord Clement-Jones’ proposal for a year-long inquiry by a special committee to investigate the use of artificial intelligence in weapon systems.  We will monitor the work of the Committee throughout the year but for now here is the accepted proposal in full:  Read more

New details of US drone flights in UK this summer raise concerns over safety and corporate cronyism

New details about the British government’s plans to allow US defence manufacturer General Atomics to conduct experimental flights of its new SkyGuardian drone in the UK this summer have emerged in MOD documents published on the Civil Aviation Authority’s (CAA) website.

SkyGuardian flights are to be conducted from RAF Waddington in Lincolnshire, beginning in July and lasting until September, and then from RAF Lossiemouth in North East Scotland, until mid to late October.  The RAF is acquiring a version of the SkyGuardian drone, which it is calling Protector, and which will be modified for UK requirements. Protector will enter service in 2023 to replace the UK’s current Reaper armed drone fleet.  General Atomics’ SkyGuardian flights are significant because they signal the coming integration of large drones, such as Protector, into UK airspace.  This is set to further normalise the use of large drones within the UK, not only by the military, but a host of other operators.

The planned SkyGuardian flights also raise concerns over safety and questions about undue corporate influence over the UK government and airspace regulators. In terms of safety, both RAF Waddington and RAF Lossiemouth are surrounded by houses, school buildings and local businesses. Planned flights of the same drone over San Diego in the US last year did not go ahead, apparently after safety objections from US airspace regulator, the Federal Aviation Authority (FAA).  The flights instead took place away well from populated areas. US and British armed forces have regularly flown large drones for more than twenty years, yet the constant communication links which they rely on are often lost. Such drones also continue to crash for several other reasons—including poor maintenance and pilot error.  Recent public polling carried out for UK Drone Watch found that 67% of respondents were worried about the safety implication of large drones flying in the UK, with 70% agreeing that such flights should be kept to segregated airspace.  Read more

A Joint Enterprise: How the UK and the US co-operate on drone warfare

Click to open

A new report published today by Drone Wars UK investigates the co-operation between the UK and the US in relation to armed drone operations. While the UK insist its armed drone programme is separate and independent to that of the US, our report, ‘Joint Enterprise: An overview of US-UK co-operation on armed drone operations’, argues that close historic ties, shared use of infrastructure and tightly integrated operations show that that the two programmes amount to a joint enterprise, with arguably joint liability.

The report lays out how co-operation between the Royal Air Force (RAF) and US Air Force (USAF) takes place in a wide range of areas and maps out the bases, companies, and operational units behind this joint enterprise. It shows how the harmonisation of equipment and concepts of operation, interoperability, and a single centre of command and control help to tie the UK into overseas ‘coalition’ wars led by the US.

As Drone Wars has revealed, there are currently a number of RAF Reapers deployed on a mission which the MoD will not discuss. It is more vital than ever that there is proper public transparency over UK drone operations and clearer understanding of the links with US drone operations. Read more

Could British Reaper drones be deployed to the Sahel?

Although British Reaper drones currently continue to operate over Iraq and Syria, the real desire by British political and military leaders to prove that despite Brexit, the UK is willing, ready and able to co-operate in militarily operations with other European nations could potentially see British drones deployed to the Sahel region. No doubt the recent questions about the viability of NATO in light of Trump’s political manoeuvring makes co-operating militarily with European partners seem even more important to the UK government. With France and the US engaged in separate counter-terrorism operations in the Sahel, and other European nations contributing to a peacekeeping mission there, over the past few weeks there have been some signs – including the deployment of UK troops and military helicopters – that the UK may join other Western forces in the area. Read more

The lawfulness of the drone strike against Sally Jones

By Max Brookman-Byrne, Lecturer in Law, University of LincolnReposted with permission.

Sally Jones, reportedly killed in US drone strike in June 2017

It was today revealed by various newspapers (for instance, the GuardianBBC and Mail) that Sally Jones, the so-called ‘White Widow’, has likely been killed by a targeted drone strike. Jones was described as being a member of ISIS and was apparently killed, along with her 12-year-old son, in June 2017 near the Iraq-Syria border.

As a researcher whose work for the last three and a bit years has been on the lawfulness of drone strikes, the question of whether this strike was lawful or not immediately came to mind. Jones was viewed as a member of ISIS and generally the media has uncritically reported her death, implying an assumption that the strike was lawful. But is this correct?

There is an armed conflict occurring in the situation in which Jones was Read more