Will UK learn the dreadful lessons of the Minab school bombing as it presses ahead with AI targeting?

On February 28 2026, the US and Israel launched an unprovoked attack on Iran with more than 1,000 targets hit by bombers and cruise missiles in the first 24 hours. Within hours of the first strike there were media reports that a primary school in Minab, southern Iran, had been hit with reports of significant number of causalities including children.

The destroyed school in Minab, southern Iran. Credit: BBC

In fact at least 157 people were killed in the US Tomahawk missiles strike on the Shajara Tayyiba school, the vast majority of them children (more than 100 under the age of 12) with more than 100 others also injured (see Airwars detailed report). In March, the Pentagon announced that it was undertaking an official investigation into the strike but more than six months later, no report has been forthcoming.

This week, however, a detailed investigation by Bloomberg News, written by Ben Bartenstein and Krishna Karra, was published, with anonymous contributions from US officials said to be involved in the Pentagon investigation. While the official report is still to be released, its clear that there are serious lessons here for those advocating the increased use of AI to speed up targeting.

Epic Fury Foolishness

Following Israeli and US strikes on Iranian nuclear facilities in June 2025 and a build up of US forces in the region, from early 2026 Israel began lobbying the US to launch airstrikes on Iran aimed at so-called regime change, with senior Iranian leaders being key targets. Nationwide protest in late December and early January in Iran had been met with ruthless force by Iranian security, with reports of thousands killed. Trump told Iranians he would ‘make Iran great again’.

Due to the involvement of IRGC naval units in the dispute around the Straits of Hormuz, it is highly likely that Iranian naval facilities were also among the hundreds of targets fed into the Maven Smart System (MSS) – the Palantir-developed US AI-enabled targeting and battlefield management system – for strikes on the first day.

Maven uses AI and machine learning tools (such as Claude) to rapidly process data and ‘support’ commanders. It combines satellite imagery, drone feeds, signals intelligence and a myriad of other information into a single interface, then generates targets and recommends weapons systems.  According to Military Times, it also drafts automated legal justifications for each strike.

Epic Fury, the Pentagon name for the campaign, was the first major AI-driven war according to Palantir’s Chief Technology Officer, Shyam Sankar:

“People will reflect back and say this is the first large-scale combat operation that was really driven, enhanced and made substantially more productive with technology, with AI.”

Blame Game

The Shajareh Tayyebeh primary school in Minab was on the edge of an Islamic Revolutionary Guards Corps (IRGC) naval medical facility.  While the school building and grounds had once formed part of the military facility, it had been walled off at least nine years before the strike, and according to satellite images, had brightly painted walls and school sports facilities visible clearly visible.

Credit: Planet Labs/BBC

Almost immediately after the strike, commentators began to ponder whether the use of AI to rapidly develop such large number of targets contributed to the deaths. However, equally quickly, advocates of the use of AI pushed back insisting that as humans had fed data into the Maven, humans not AI were to blame.   This blame game is likely to occur each time an incident such as this occurs.

Militaries generally maintain a library of potential targets – military bases, missile sites, airfields, munition factories, etc. –  in anticipation of armed conflict but obviously over time, those designated targets can change. While trying to keep potential targets updated, planners always imagine they will have time before a conflict to check and recheck the targets. However, in this case, as Bloomberg’s investigation notes:

 “Work that had unfolded in previous conflicts over weeks or months — matching sites from the library, such as buildings, airfields or bases — was completed in a matter of days, according to officials involved in the probe. More than a thousand potential targets had to be reassessed and approved.”

Advocates of the use of AI in military targeting insist that using such systems can speed up ‘the kill chain’ and there is likely to have been pressure from the internal Pentagon pro-AI lobby to demonstrate the speed with which large numbers of targets could be generated. 

Human Machine Interface: Who’s in control?

Palantir has repeatedly said that its ​software does not make ⁠lethal decisions and humans remain responsible for selecting and approving targets.  However, numerous reports have detailed how humans overly rely and trust in computers and AI.   

It is clear that such automation bias is present in the military use of AI. Bloomberg reports the officials they spoke to, who were involved in the investigation of the school strike, as saying

Some Centcom personnel expected Maven to flag stale information or inconsistencies in the underlying intelligence assembled for potential targets

Separately, the article states:   

Two people familiar with the firm’s Pentagon contracts said the government retains primary responsibility for the quality of the information that’s fed into Maven. But they said it’s not uncommon for personnel who use tools such as Maven to develop operational understandings that differ from contractual terms.

The officials Bloomberg spoke to went:

Inside Centcom, which conducted the US attack, some personnel relied too much on the artificial intelligence embedded in Maven Smart System.

Since the Minab strike, Bloomberg reports “Palantir built new capabilities into Maven that ‘re-review underlying intelligence to identify factors that would disqualify a target and flag inconsistencies and inaccuracies that human review may have missed’.

UK pushes ahead with AI targeting

Over the past two years the UK has been pressing ahead with developing its own AI-enabled  targeting and battlefield command system, currently designated the ‘Digital Targeting Web’.  Giving evidence to the Defence Select Committee in July 2026, retired General Sir Richard Barrons, one of the authors of the recent Strategic Defence Review said:

“Essentially, what the web does is to take in every form of thing or capability that senses the operating environment—whether it is satellite, aircraft, drone, mobile phone, ship, vehicle or database, it does not matter; everything that allows you to understand your operating environment—and networks that into a database and secure cloud managed by AI—without AI, you cannot manage it—supervised by clever people. That capability allows you to assemble an understanding of your operating environment to support decision making, including ranking targets and allocating them to weapons systems, whether they are kinetic, from any service, or non-kinetic, like a cyber-attack.

The Defence Investment Plan (DIP), published in June 2026, re-stated the 2025 Strategic Defence Review’s embrace of drones and AI. Funding is being cut from non-military and military budgets to enable this to happen, with a whole variety of UK military AI projects being developed.

A new MoD taskforce – Taskforce RAID (‘Rapid AI Development’) –  has been allocated £100m to speed up the military’s adoption of AI, with ministers giving the taskforce  “exemptions from standard financial and procedural controls”.  At the same time, the MoD  has replaced its AI Ethics Advisory panel with a new AI Expert Advisory Group. Experts apparently being preferred to ethics.

Will lessons be learned?

Britain is pushing rapidly ahead with integrating AI and machine learning tools into is military targeting processes, with the FT even declaring over the summer ‘UK military looks at allowing lethal strikes without human approval‘. There is a real danger that ministers and military officials, dazzled by the possibilities that AI companies set before them, will give primacy to speed over care.

The British public however, wants and expects that its military will, at the very least, stick to the long-established global rules around the conduct of warfare – international law and in particular, International Humanitarian Law.  IHL mandates that war must be a last resort and that that any use of force must ensure that civilians are protected and that a clear distinction is made between military and civilian targets.

Yet even that most pro-military voices accept that civilians are regularly and repeatedly killed in aerial bombing. The public are continually told in the aftermath of such strikes that they are an ‘aberration’, or ‘honest’ and ‘genuine’ mistakes.  But when ‘mistakes’ repeatedly happen, not to see the systemic failure is simply to be in denial.

Now, when AI is already enabling 1,000 targets to be identified and struck in a single day, even a 1% ‘failure rate’ could result in 10 civilian casualties incidents a day.  The way that AI is both increasing the number of targets and enabling a huge increase in the number of strikes will simply and inevitably lead to more civilian casualties.

As we approach an important moment in efforts to establish a treaty on the development and use of lethal autonomous weapons – the November 2026 Review Meeting of the Convention on Certain Conventional Weapons (CCW) – signs are not good. Reports from the final preparatory meeting in Geneva detail how the larger military states watered down language and removed key elements from a draft document.

The UK should be standing up for adherence to international law and primacy of the protection of civilians at the heart of its defence and military policies. Yet it should be remembered, that on the very same day that news began to circulate about the awful strike on the Minab school, the UK gave permission to the US to use the USAF base at Fairford in Gloucestershire for strikes on Iran, a military attack which international law experts describe as “a manifest violation of the United Nations Charter.“

While some argue that miliary AI systems can somehow be made to be ‘ethical’ the real lesson to be learned from Minab is that we are on the precipice of great danger. The rush to develop and deploy AI systems in warfare has to be resisted.     

Graves being dug for those killed in the Minab school strike.

Killing By Code: New Briefing and Dataset on UK Military AI Programmes 

Drone Wars UK is today publishing the first of a series of short briefings on the new military companies who are pushing the use of AI in warfare in the UK. Alongside this, we are publishing a list of 26 key MoD programmes developing the use of AI for warfighting.

The Datafication of War: Palantir, AI and Algorithmic Violence

The first of our ‘Killing by Code’ briefings, The Datafication of War, examines Palantir and its involvement in UK military programmes.

Military AI firms such as Palantir are exerting significant influence over domestic defence programmes. These for-profit corporations are increasingly playing a key role in military ecosystems, mobilising R&D and facilitating the transfer of civilian technology to military applications. This interdependency with the state, indicates the growing militarisation of digital technologies, as well as their importance as military contractors.

Click to open briefing

With algorithms, Large Language Models, and autonomous systems permeating throughout the military domain, modern warfare is becoming increasingly reliant on data sets. Military advantage need not only rely on industrial output and hardware but on high-quality data and software. Whether that is to train military AI models that assist in the planning, or the use of data to execute combat missions with AI-assistance, warfare in the age of AI is experiencing a datafication.

Palantir is integral to this story. The company has been embedded within US national security structures since its founding in 2003 and is one of the most opaque yet influential corporations today. Put simply, Palantir is a private company which builds software for the military, intelligence agencies and transnational corporations to understand masses of data (data analytics).

This short briefing explores Palantir and their algorithmic and data systems. It examines the company’s origin and leadership; their footprint in different institutions within the UK and elsewhere; its key software and data analytic platforms and ends by looking at their involvement with the Israeli and Ukrainian governments during times of profound violence and war.   

With AI software becoming more embedded in military and civilian decision-making chains, (military) AI companies stand to wield a significant amount of domestic and international power.  It is only right that these companies are subjected to proper scrutiny.

Key UK Military AI Development Programmes
Click to go to open full dataset

Drone Wars UK is also today publishing a list of key UK MoD military AI development programmes, together with brief details and current state of each programme.  

While there are almost certainly other classified programmes ongoing in this area, this is the first time, to our knowledge, that a list of such programmes has been published.

Programmes to integrate AI into UK warfighting include Project Asgard (see here) which aims to develop AI-enabled strike capability for the British Army; Project Startle and SyCoiEA for the Royal Navy and programmes to develop an ‘Intelligent Virtual Assistant’ for the RAF’s future combat aircraft (Tempest) as well as Autonomous Collaborative Platforms (ACP). In addition Project Spotter and Project Odyssey are being developed to support UK Defence Intelligence.  Alongside these are cross-service projects including the Digital Targeting Web, Sapient, adopted for counter-drone systems and Project Castle, using AI for cyber warfare.

The MoD has refused to give any details about three other RAF programmes involving AI on our list – Deep Thought, Omnia and Organon, either to us or national media.

A joint Royal Navy/RAF series of trials to validate AI algorithms is named Wintermute and may be named after one of the AI’s  in William Gibson’s famed Neuromancer novel.

Drone Wars UK will continue to scrutinise developments in this area as part of our work to challenge the push towards the development of autonomous weapon systems.

Collateral Damage: Economics and ethics are casualties in the militarisation of AI

The current government places a central emphasis on technology and innovation in its evolving national security strategy, and wider approach to governance. Labour proposes reviving a struggling British economy through investment in defence with artificial intelligence (AI) featuring as an important component. Starmer’s premiership seems to align several objectives: economic growth, defence industrial development and technological innovation.

Rachel Reeves and John Healey hold roundtable with military company bosses, in front of Reaper drone at RAF Waddington, Feb 2025. Image: MoD

Taken together, these suggest that the government is positioning AI primarily in the context of war and defence innovation. This not only risks undermining the government’s stated ambitions of stability and economic growth but a strategy that prioritises speed over scrutiny, to the neglect of important ethical concerns.

The private defence industry has been positioned as an important pillar of this strategy. Before the Strategic Defence Review (SDR) was published, Chancellor Rachel Reeves and Defence Secretary John Healey initiated a Defence and Economic Growth Task Force to drive UK growth through defence capabilities and production. Arms companies are no longer vital for the purposes of national security but now presented as engines of future prosperity. AI is central to this, consistently highlighted in government communications John Healy has explicitly acknowledged that AI will increasingly power the British military whilst Kier Starmer stated that AI ‘will drive incredible change’.

UK focusing AI on military applications

The AI Action Plan, released in January 2025, explicitly links AI to economic growth. Although this included references to ‘responsible use and leadership’, the government has now shifted emphasis on military applications at the expense of crucial policy areas. On the 4th of July, the Science and Technology Secretary Peter Kyle wrote to the Alan Turing Institute – Britain’s premier AI research organization – to refocus research on military applications of AI. The Institutes prior research agenda spanned environmental sustainability, health and national security; under this new directive priorities are fundamentally being narrowed.

BAE Systems Project Odyssey uses AI and VR to make training ‘more realistic’. Image: BAE Systems

Relatedly, the Industrial Strategy released by the government aims to ‘embolden’ the UK’s digital and technologies economy, with £500 million to be delivered through a sovereign AI unit – this however will be focused on ‘building capacity in the most strategically important areas’. Given Peter Kyles re-direction and the overwhelming emphasis the government has placed on AI’s productive capacity in war, it becomes clear that AI research in defence will be at the cost of socially beneficial research in the case of the Alan Turing Institute.

Take Britain’s bleak economic outlook: sluggish productivity; post-Brexit stagnation; strained public finances; mounting government debt repayments; surging costs of living and inflating house prices. There is little evidence to suggest that defence-led growth will yield impactful returns on this catalogue of challenges. No credible economist is going to advise, in the face of these challenges, that investing in defence and redirecting research on AI in the name of national security, is going to give a better return on investment.

Research conducted in America illustrates that investing in health, education, infrastructure and green investment is more likely to give better returns on individual income specifically and broadly, the country’s prospects. Similarly, Lord Blunkett (former minster under Blair) pointed out that without GDP growth, raising defence spending as a share of GDP may not increase the actual funding.

Concerning applications to health outcomes, in August the World Economic Forum reported AI’s striking potential in doubling accuracy in the examination of brains in stroke patients, detecting fractures often missed in overstretched departments and predicting diseases with high confidence. This is critical given the NHS’s persistent challenges: long waiting times, underfunding, regional inequality, staff shortages and bureaucratic inertia.

Health and economic growth are closely related: healthier individuals are more productive, children attend school more consistently, preventative care lowers long-term costs – fundamentally strong health systems add value to the economy and our lives . Yet health is just one example. We are in the embryonic stages of AI development, and by prioritising research on military applications over civilian ones with public value, the government risks undermining, not fuelling long-term economic growth.

Crucially, framing arms companies as a major engine of economic growth is wildly misleading and economically unfounded. Arms sales account for 0.004% of the treasury’s total revenue and the defence industrial base accounts for only 1% of UK economic output. This sector is highly monopolized and so the benefits of ‘growth’ are concentrated among a handful of dominant corporations. Even then, the profit generated will not be reinvested into the UK. The biggest arms company in the UK – BAE Systems – is essentially a joint US-UK company with most of its capital invested in the US with majority shareholders emanating from US investment companies like BlackRock.

Prioritising speed over scrutiny

Beyond the economics, this is part of a wider strategy that signals a growing dismissal of ethical concerns, prioritising speed over scrutiny. The SDR acknowledged that technology is outpacing regulatory frameworks, noting that ‘the UK’s competitors are unlikely to adhere to common ethical standards’. In April 2025, Matthew Clifford – AI advisor to the PM – has been quoted saying ‘speed is everything’. While the Ministry of Defence (in 2022) promised to take an ‘ambitious, safe and responsible’ approach to the development of military AI, the current emphasis on speed sidelines important ethical concerns in the rush for military-technological superiority.

Militarily, the SDR makes plans to invest in drones, autonomous systems and £1 billion for a ‘digital targeting web’. A key foundational principle of International Humanitarian Law is the protection of civilians and their distinction with military targets. An AI-enabled ‘digital targeting web’ – like the one proposed in the SDR – connects sensors and weapons enabling faster detection and killing of human life. These networks would be able to identify and suggest targets faster than humans ever could, leaving soldiers in the best case, minutes, and the worst case, seconds to decide whether the drone should kill.

Digital Warfare: US and UK forces at the Combined Air Operations Center (CAOC), Al Udeid Air Base, Qatar,

One notable example is the Maven Smart System, recently procured by NATO. According to the US Think Tank, the Centre of Security and Emerging Technology, the system makes possible small armies to make ‘1000 tactical decisions per hour’. Some legal scholars have pointed out that the prioritisation of speed, within AI-powered battleground technology, raises questions surrounding the preservation of meaningful human control and restraint in warfare. Israeli use of AI-powered automated targeting systems such as ‘Lavender’ during its assault and occupation of Gaza is illustrative of this point. Systems such as these have been highlighted as one of the factors behind the shockingly high civilian death toll there.

This problem is compounded by the recent research that has shown that new large language models are known to ‘hallucinate’ – producing outputs in error or made up. As these systems become embedded within military decision-making chains, the risk of escalation due to technical failure increase dramatically. A false signal, misread sensor or a corrupted database could lead to erroneous targeting, or unintended conflict escalation.

In sum, the UK’s current approach – predominantly framing AI’s utility though the lens of defence – risks squandering its broader social and economic potential. The redirection of public research institutes, the privileging of AI investment in military applications (or so-called ‘strategic areas’) and the emphasis on speed over scrutiny raises serious concerns. Ethically, the erosion of meaningful human control in battlefield decision-making, the risk of AI-driven conflict escalation and the disregard of international humanitarian principles points to a troubling trajectory. The UK risks drifting towards the ethical standards of Russia and Israel in its use of military AI. A government approach to AI grounded in human security (freedom from fear and want), not war is not only more ethical but far more likely to generate sustainable economic growth for the United Kingdom.

  • Matthew Croft is a postgraduate student at Kings College London studying Conflict, Security and Development with a particular interest on the ethics of national security and the politics of technology.

UK crossing the line as it implements use of AI for lethal targeting under Project Asgard

Despite grave ethical and legal concerns about the introduction of AI into decision making around the use of lethal force, the UK is rapidly pressing ahead with a number of programmes and projects to do so, with the British Army recently trialling a new AI-enabled targeting system called ASGARD as part of a NATO exercise in Estonia in May 2025.

A mock HQ utilising ASGARD at MoD briefing, July 2025. Crown Copyright 2025.

Last week, the Ministry of Defence (MoD) gave a briefing to selected media and industry ‘partners’ on Project ASGARD – which it describes as the UK’s programme to “double the lethality” of the British Army through the use of AI and other technology. ASGARD is not aimed at  producing or procuring a particular piece of equipment but rather at developing a communications and decision-making network that uses AI and other technology to vastly increase the speed of undertaking lethal strikes.

ASGARD is part of a £1 billion ‘Digital Targeting Web’ designed to “connect sensors, shooters, and decision-makers” across the land, sea, air, and space domains. “This is the future of warfare,” Maria Eagle, Minister for Defence Procurement and Industry told the gathering. 

According to one reporter present at the briefing, the prototype network “used AI-powered fire control software, low-latency tactical networks, and semi-autonomous target recommendation tools.” 

Janes reported that through ASGARD, “any sensor”, whether it be an unmanned aircraft system (UAS), radar, or human eye, is enabled by AI to identify and prioritise targets and then suggest weapons for destroying them. “Before Asgard it might take hours or even days. Now it takes seconds or minutes to complete the digital targeting chain,” Sir Roly Walker, Head of the British Army told the gathering.

Drones used in conjunction with ASGARD
DART 250EW one-way attack drone
Helsing HX-2 one-way attack drone

While the system currently has a ‘human in the loop’  officials suggested that this could change in future, with The I Paper reporting ‘the system is technically capable of running without human oversight and insiders did not rule out allowing the AI to operate independently if ethical and legal considerations changed.’

How it works

A British Army report after the media event suggested that  “Asgard has introduced three new ways of fighting designed to find, strike and blunt enemy manoeuvre: 

  • A dismounted data system for use at company group and below.
  • The introduction of the DART 250 One Way Effector. This enables the targeting of enemy infrastructure three times further than the current UK land based deep fires rockets.
  • A mission support network to accelerate what is called the digital targeting or ‘kill’ chain.

According to a detailed and useful write-up of the Estonia exercise, ASGARD uses existing equipment currently in service alongside new systems including Lattice command and control software from Anduril which provides a ‘mesh network’ for communications, as well as Altra and Altra Strike software from Helsing used to identify and ‘fingerprint’ targets. The report goes on:

“targets were passed to PRIISM which would conduct further development including legal review, collateral damage estimates, and weapon-to-target matching.”  

Helsing’s HX-2 drone was also used during the exercise and is another indication that the UK is likely to acquire these one-way attack drones. DART 250, a UK manufactured jet-powered one-way attack drone with a range of 250 km that can fly at more than 400 km/h was also deployed as part of the exercise. The manufacturer says that it can fly accurately even when GPS signals are jammed and that it is fitted with seeker that enables it to home-in and destroy jamming equipment.  

AI: speed eroding oversight and accountability

The grave dangers of introducing AI into warfare, and in particular for the use of force are by now well known.  While arguments have been made for and against these systems for more than a decade, increasing we are moving from a theoretical, future possibility to the real world: here, now, today.

While some argue almost irrationally in the powers and benefits of AI, in the real world AI-enabled systems remain error prone and unreliable. AI is far from fallible and relies on training data which time and time again have led to serious mistakes through bias.  

Systems like ASGARD may be able to locate tanks on an open plain in a well-controlled training exercise environment (see video above), the real world is very different.  Most armed conflicts do not take place in remote battlefields but in complex and complicated urban environments.  Relying on AI to choose military targets in such a scenario is fraught with danger.

Advocates of ASGARD and similar systems argue that the ‘need’ for speed in targeting decisions means that the use of AI brings enormous benefits.  And it is undoubtedly true that algorithms can process data much faster than humans. But speeding up such targeting decisions significantly erodes human oversight and accountability.  Humans in such circumstances are reduced to merely rubber-stamping the output of the machine.

Meanwhile, the Ministry of Defence confirmed that the next phase of ASGARD’s development has received government funding while at the UN, the UK continues to oppose the negotiation of a new legally binding instrument on autonomous weapons systems.

Proceed in Harmony: The Government replies to the Lords on AI in Weapon Systems

Click to open

Last December a select committee of the House of Lords published ‘Proceed with Caution’: a report setting out the findings of a year-long investigation into the use of artificial intelligence (AI) in weapon systems.

Members of the Lords committee were drawn entirely from the core of the UK’s political and security establishment, and their report was hardly radical in its conclusions.  Nevertheless, their report made a number of useful recommendations and concluded that the risks from autonomous weapons are such that the government “must ensure that human control is consistently embedded at all stages of a system’s lifecycle, from design to deployment”.  The Lords found that Ministry of Defence (MoD) claims to be “ambitious, safe, responsible” in its use of AI had “not lived up to reality”.

The government subsequently pledged to reply to the Lords report, and on 21 February published its formal response.  Perhaps the best way of summarising the tone of the response is to quote from its concluding paragraph:  ““Proceed with caution”, the overall message of this [Lords] report, mirrors the MoD’s approach to AI adoption.”   There is little new in the government response and nothing in it will be of any surprise to observers and analysts of UK government policy on AI and autonomous technologies.  The response merely outlines how the government intends to follow the course of action it had already planned to take, reiterating the substance of past policy statements such as the Defence Artificial Intelligence Strategy and puffing up recent MoD activity and achievements in the military AI field.

As might be imagined, the response takes a supportive approach to recommendations from the Lords which are aligned to its own agenda, such as developing high-quality data sets, improving MoD’s AI procurement arrangements, and undertaking research into potential future AI capabilities.  On the positive side, it is encouraging to see that in some areas concerns over the risks and limitations of AI technologies are highlighted, for example in the need for review and rigorous testing of new systems.  MoD acknowledges that rigorous testing would be required before an operator could be confident in an AI system’s use and effect, that current procedures, including the Article 36 weapons review process, will need to be adapted and updated, and that changes in operational environment may require weapon systems to be retested.

The response also reveals that the government is working on a Joint Service Publication covering all the armed forces to give more concrete directions and guidance on implementing MoD’s AI ethical principles.  The document, ‘Dependable AI in Defence’, will set out the governance, accountabilities, processes and reporting mechanisms needed to translate ethical policies into tangible actions and procedures.  Drone Wars UK and other civil society organisations have long called for MoD to formulate such guidance as a priority.

In some areas the MoD has relatively little power to meet the committee’s recommendations, such as in adjusting government pay scales to match market rates and attract qualified staff to work on MoD AI projects.  Here the rejoinder is little more than flannel, mentioning that “a range of steps” are being taken “to make Defence AI an attractive and aspirational choice.”

In other respects the Lords have challenged MoD’s approach more substantially, and in such cases these challenges are rejected in the government response.  This is so in relation to the Lords’ recommendation that the government should adopt a definition for autonomous weapons systems (AWS).  The section of the response dealing with this point lays bare the fact that the government’s priority “is to maximise our military capability in the face of growing threats”.  A rather unconvincing assertion that “the irresponsible and unethical behaviours and outcomes about which the Committee is rightly concerned are already prohibited under existing legal mechanisms” is followed by the real reason for the government’s opposition: “there is a strong tendency in the ongoing debate about autonomous weapons to assert that any official AWS definition should serve as the starting point for a new legal instrument prohibiting certain types of systems”.  Any international treaty which would outlaw autonomous weapon systems “represents a threat to UK Defence interests” the government argues.  The argument ends with a side-swipe at Russia and an attempt to shut down further debate by claiming that the debate is taking place “at the worst possible time, given Russia’s action in Ukraine and a general increase in bellicosity from potential adversaries.”  This basically seems to be saying that in adopting a definition for autonomous weapon systems the UK would be making itself more vulnerable to Russian military action.  Really? Read more →

Proceed with caution: Lords warn over development of military AI and killer robots

Click to open report

The use of artificial intelligence (AI) for the purposes of warfare through the development of AI-powered autonomous weapon systems – ‘killer robots’ –  “is one of the most controversial uses of AI today”, according to a new report by an influential House of Lords Committee.

The committee, which spent ten months investigating the application of AI to weapon systems and probing the UK government’s plans to develop military AI systems, concluded that the risks from autonomous weapons are such that the government “must ensure that human control is consistently embedded at all stages of a system’s lifecycle, from design to deployment”.

Echoing concerns which Drone Wars UK has repeatedly raised, the Lords found that the stated aspiration of the Ministry of Defence (MoD) to be “ambitious, safe, responsible” in its use of AI “has not lived up to reality”, and that although MoD has claimed that transparency and challenge are central to its approach, “we have not found this yet to be the case”.

The cross-party House of Lords Committee on AI in Weapon Systems was set up in January 2023 at the suggestion of Liberal Democrat peer Lord Clement-Jones, and started taking evidence in March.    The committee heard oral evidence from 35 witnesses and received nearly 70 written evidence submissions, including evidence from Drone Wars UK.

The committee’s report is entitled ‘Proceed with Caution: Artificial Intelligence in Weapon Systems’ and ‘proceed with caution’ gives a fair summary of its recommendations.  The panel was drawn entirely from the core of the UK’s political and military establishment, and at times some members appeared to have difficulty in grasping the technical concepts underpinning the technologies behind autonomous weapons.  Under the circumstances the committee was never remotely likely to recommend that the government should not commit to the development of new weapons systems based on advanced technology, and in many respects its report provides a road-map setting out the committee’s views on how the MoD should go ahead in integrating AI into weapons systems and build public support for doing this.

Nevertheless, the committee has taken a sceptical view of the advantages claimed for autonomous weapons systems; has recognised the very real risks that they pose; and has proposed safeguards to mitigate the worst of the risks alongside a robust call for the government to “lead by example in international engagement on regulation of AWS [autonomous weapon systems]”.  Despite hearing from witnesses who argued that autonomous weapons “could be faster, more accurate and more resilient than existing weapon systems, could limit the casualties of war, and could protect “our people from harm by automating ‘dirty and dangerous’ tasks””, the committee was apparently unconvinced, concluding that “although a balance sheet of benefits and risks can be drawn, determining the net effect of AWS is difficult” – and that “this was acknowledged by the Ministry of Defence”.

Perhaps the  most important recommendation in the committee’s report relates to human control over autonomous weapons.  The committee found that:

The Government should ensure human control at all stages of an AWS’s lifecycle. Much of the concern about AWS is focused on systems in which the autonomy is enabled by AI technologies, with an AI system undertaking analysis on information obtained from sensors. But it is essential to have human control over the deployment of the system both to ensure human moral agency and legal compliance. This must be buttressed by our absolute national commitment to the requirements of international humanitarian law.

Read more →