Economists end up solving this problem by denying it (a mechanism that Stafford Beer looked at in detail, concluding that ignorance is a kind of information processing system of last resort). Where analysis fails, ideology steps in, and the solution the economists decided on was to fantasise an equivalent system for producers — a profit-maximising firm with an understanding of its market, a style production process and a manageable set of decisions. It ended up going disastrously wrong, but the original intellectual sin may have been the failure to respect the integrity of the black box.

There’s one sense in which the recording engineers’ maxim is more applicable, though. These are problems of human organisation, and the overwhelming majority of environmental variety of created by humans. The knowledge that something is an organisational problem means that the source of its complexity is the human beings in the organisation. That, in turn, means that the human beings in the organisation have sufficient variety and capability to match the complexity of the problem; the problem can’t be bigger than them, because their own misdirected efforts created it. Only problems that aren’t cybernetic can genuinely be insoluble.*

*One implication of this proposition is that it gives us a rigorous deduction of what would constitute environmental Armageddon — it’s the singularity point at which the problem of climate change ceases to be soluble purely by changing human behaviour and organisation.

This is the paradigm shift that might be required — that organisations and systems can be like people, having purposes without a single goal. An artist doesn’t have a successful career by maximising their art; they do it by repeatedly producing work that they are proud of.

That’s what the world could look like if we got rid of the blind spots. Business ought to be like artists, not paperclip maximisers. The economic concept of optimisation, and the institutions of management and government which enforce its use, effectively act as a brutal information reducing filter. By taking away the pressure to maximise a single metric (and therefore to throw away information that doesn’t relate to it), organisations could apply their decision-making capabilities much more effectively. They could innovate more, design more sustainable solutions and build less adversarial, longer-term relationships with their people.

One of its signals has been so amplified that it drowns out the others. The ‘profit motive’ isn’t something that can be ascribed to corporations — they don’t have motives. What they have is an imbalance between the two key higher-functions — here-and-now versus there-and-then. They aren’t capable of responding to signals from the long-term planning and intelligence function, because the short-term planning function has to operate under the constraints of the financial market disciplinary system. Either a corporation has a survival condition based on needing to make a monthly interest bill, or there’s an implicit threat from the financial environment that if it fails to behave in a particular way, it will be taken over by an outside entity.

If you take away that pressure, it’s quite likely that the natural equilibrium of corporate decision-making systems will be less hostile to human life. Viable systems fundamentally seek stability, not maximisation.

A maximising system involves defining an objective function, and throwing away all the other information. Sooner or later, the environment is going to change, and something which isn’t in the information set any more is going to lead the system into destruction.

Consequently,

Every decision-making system set up as a maximiser needs to have a higher-

Level system watching over it.