04/06/2026
One view from Stuff article: Super-intelligent AI—the kind vastly more capable than any combination of human beings across virtually every field—cannot be safely controlled.
Humans have never interacted with anything smarter than us, but if our track record with every other animal species is anything to go by, any such interaction won’t end with human flourishing.
Regardless, creating such an AI is the stated goal of every frontier AI company, and most expect to do so within years, not decades.
Full interview is on Stuff. The book is by Nate Soares and Eliezer Yudkowsky, and its titled ‘If Anyone Builds It, Everyone Dies’
A counter-statement from a PAFC member: The concept of "superintelligence" is vague and controversial. It appears to have been created to fool potential investors and create an economic bubble. The experiments quoted in the Stuff article are unscientific and were designed to raise venture capital.
In the words of Paris Marx, "The AI industry wants us to believe AI superintelligence is the real threat from generative AI. But that narrative was crafted to distract from the many ways genAI is being used to tear our societies apart, as we saw this week when a deepfake video rocked the Irish election. It must be reined in." You can read more about this in Paris's blog post here : https://disconnect.blog/generative-ai-is-a-societal-disaster/
NZ’s coalition government has promised to replace enormous numbers of civil servants with "AI". This technology mostly doesn't exist yet and will lead to a downgraded and incompetent civil service. The half-baked systems promised at MSD will likely compound the problems of racist decision-making and missing entitlements, which will then lead to more people being forced to sleep on the streets.
For further reading on AI we recommend the recent books by Shannon Vallor, Emily Bender, Petra Molnár, Karen Hao, Andrew Guthrie Ferguson and Dan McQuillan.