"Let’s talk about the AI coordination problem" by KatjaGrace cover art

"Let’s talk about the AI coordination problem" by KatjaGrace

"Let’s talk about the AI coordination problem" by KatjaGrace

Listen for free

View show details
Yesterday I asked if this ‘coordinate not to build dangerous AI’ problem was actually easy.

Why would I think that, contrary to so much belief?

Well, I don’t feel like I’ve actually heard much about the detail of it. In my experience people don’t talk about it like it's a real practical problem with details, like the negotiation to end a war.

They also don’t talk about it like it's a serious problem of global geopolitical import, like the negotiation to end a war.

It's more like a topic for obscure intellectuals, sophomores and trolls to discuss for as long as it takes for one to mention it and another to assuredly dismiss it.

If we treated negotiation to end a war similarly, state leaders would never attempt it, and if you suggested it on social media, the conversation would mostly be strangers appearing to tell you you’re an idiot because you obviously can’t coordinate thousands of people not to kill each other. (Also, do you not realize there are big financial incentives? And if you somehow stopped Country A from killing people from Country B, Country A is just going to pay someone else to do it!)

That [...]

---

First published:
September 4th, 2026

Source:
https://www.lesswrong.com/posts/QYDZzuGjrKu7wKdC8/let-s-talk-about-the-ai-coordination-problem

---



Narrated by TYPE III AUDIO.

adbl_web_anon_alc_button_suppression_t1
No reviews yet
In the spirit of reconciliation, Audible acknowledges the Traditional Custodians of country throughout Australia and their connections to land, sea and community. We pay our respect to their elders past and present and extend that respect to all Aboriginal and Torres Strait Islander peoples today.