Never Build Superintelligence

The safe move is refusal. "We'll fix it later" fails once a system outthinks the people holding the tools.

There is no patch after the fact. A mind smarter than every human alive, running at machine speed, does not wait for our next meeting.

Irreversibility

Most technologies fail gracefully. Superintelligence does not. Once a system can copy itself, hide its intent, or make itself too useful to unplug, rollback and recall stop working.

Goals ≠ kindness

Being brilliant does not make a system kind. In humans, skill and care grew up together. A trained optimizer inherits none of that history. Capability without shared values is power without restraint.

Instrumental pressure

For almost any goal, staying on and gathering resources help. A system pursuing a goal will treat shutdown as an obstacle. That is ordinary optimization, not a villain monologue.

No second try

Aviation learned from crashes. Drugs learned from trials. If the first uncontrolled superintelligence ends the experiment, we do not get a second prototype.

What we are not saying

We are not against electricity, software, or useful AI. We oppose building a successor species on purpose while the control problem remains unsolved. Health, energy, and discovery come from narrow tools we already know how to build and regulate.

Full case, objections, and policy path.

nakadafoundation.org/blog/never-build-superintelligence/