"Misaligned AIs could use killer robots to take over" by Omar Khursheed, TurnTrout cover art

"Misaligned AIs could use killer robots to take over" by Omar Khursheed, TurnTrout

"Misaligned AIs could use killer robots to take over" by Omar Khursheed, TurnTrout

Listen for free

View show details
TLDR; We are (potentially irreversibly) giving AIs control of weapons systems through the standard procurement process while hiding our strongest warning shots behind classified doors. We’re reducing the capability thresholds required for takeover by misaligned AIs by giving them this level of access. If military integration of AI continues as it is, we may give AIs key tools for a takeover.

Introduction

AI-based targeting and autonomous weapons are being integrated into militaries today with extreme haste. Traditionally, AI takeover scenarios involve a step in which AIs acquire the ability to exert physical force. Carlsmith (2022) lays out required capabilities and potential takeover mechanisms, including utility disruption and CBRN capabilities. Karnofsky (2022) argues that AIs with access to weaponized force could hold any territory that matters. Kokotajlo et al. (2025) outline a scenario in which AI develops weapons as part of an arms race, and Davidson et al. (2025) discuss what happens when a small group controls highly capable AIs that can exert military force. These scenarios sometimes require a misaligned AI to seize these capabilities by force. We instead are handing AIs some of these capabilities by integrating them into our militaries. This is happening at a time when [...]

---

Outline:

(00:37) Introduction

(01:46) Militaries are all-in

(04:23) Incautious military integration is bad for takeover risk

(05:58) Implications of AI control of military hardware and software

(07:48) If an AI causes a warning shot in a classified setting, does anyone hear it?

(08:44) What now?

(11:16) Appendix: More instances of AI-military integration

---

First published:
August 11th, 2026

Source:
https://www.lesswrong.com/posts/9jKhqmFjMzdAvHANr/misaligned-ais-could-use-killer-robots-to-take-over

---



Narrated by TYPE III AUDIO.
adbl_web_anon_alc_button_suppression_t1
No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.