Engineers and economists prize efficiency, but nature favors resilience – lessons from Texas, COVID-19 and the 737 Max
- Written by Moshe Y. Vardi, Professor of Computer Science, Rice University
Takeaways:
The damage from Winter Storm Uri, the economic devastation from the COVID-19 pandemic and the fatal Boeing 737 Max accidents show the price society pays for a relentless pursuit of efficiency.
Modern society has prioritized free-market economics and efficient computer systems to the detriment of other priorities.
Studies of algorithms show that efficiency can come at a high cost.
Sexual reproduction and car insurance highlight the benefits of resilience.
There is a trade-off between efficiency and resilience. Efficiency requires optimal adaptation to an existing environment, while resilience is an ability to adapt to large or sudden changes in the environment[1]. Society’s emphasis on short-term gains[2] has long tipped the balance in favor of efficiency.
However, the relentless pursuit of efficiency removes hurdles to the speed and reach of transactions, hurdles that also serve as buffers against shocks[3]. Buffers provide resilience in the face of ecological, geopolitical and financial crises.
As a computer scientist[4], I look at how algorithms provide a way to test assumptions about resilience, even as the field of computing itself shares the bias toward efficiency. Three recent crises – the 2021 winter storm in Texas, the COVID-19 pandemic and the Boeing 737 Max software failure – highlight the cost of valuing efficiency over resilience and provide lessons for bringing society into balance.
Economists and engineers ❤️ efficiency
Economics has long been obsessed with efficiency[5]. Economic efficiency[6] means that goods and production are distributed or allocated to their most valuable uses and waste is eliminated or minimized.
Free-market advocates argue that through individual self-interest and freedom of production and consumption[7], economic efficiency is achieved and the best interests of society, as a whole, are fulfilled. But this conflates efficiency with the best outcome.
The intense focus on efficiency at the expense of resilience plagues not only business and economics but also technology. Society has educated generations of computer scientists that analyzing algorithms, the step-by-step instructions at the heart of computer software, boils down to measuring their computational efficiency.
“The Art of Computer Programming,”[8] one of the founding texts of computer science, is dedicated to the analysis of algorithms, which is the process of figuring out the amount of time, storage or other resources needed to execute them. In other words, efficiency is the sole concern in the design of algorithms, according to this guide.
But what about resilience? Designing resilient algorithms requires computer scientists to consider in advance what can go wrong and build effective countermeasures into their algorithms. Without designing for resilience, you get efficient but brittle algorithms.
A storm, a plague and some bad software
Brittle systems are more likely than resilient systems to break down when crises strike. Cold temperatures and blackouts during Winter Storm Uri[9] killed nearly 200 people[10] in February 2021 in Texas. The storm damaged the power grid and water systems, which lacked the weatherproofing features common to utility infrastructure in much of the rest of the country.
The harsh economic consequences of failing to prepare for a pandemic, despite many early warnings[11], provoke questions about whether the obsessive pursuit of efficiency, which has dominated standard business orthodoxy for decades, has made the global economic system more vulnerable[12] to disruptive changes.
The Boeing 737 Max fiasco resulted from engineering and business decisions that put efficiency ahead of resilience.
AP Photo/Elaine Thompson[13]
A stark example of a system designed for efficiency and not resilience is the flight-control algorithm for the Boeing 737 Max. Boeing retrofitted the 737, a passenger aircraft first produced more than half a century ago, with more efficient engines. This retrofitting caused some flight instability[14], which the flight-control algorithm was designed to overcome.
But the algorithm relied on data from a single sensor[15], and when the sensor failed, the algorithm incorrectly determined that the plane was stalling. In response, the algorithm caused the plane to dive as an emergency measure to recover from a stall that wasn’t happening.
The result was two horrific crashes and hundreds of the aircraft being grounded for nearly two years[16]. In retrospect, the engineers overly optimized for fuel economy and time to market at the expense of safety[17].
The price of anarchy
If brittle systems are prone to disasters, why is society filled with them? One explanation is that, short of disasters, systems that emphasize efficiency can achieve a kind of stability. A fundamental theorem in economics states that under certain assumptions a market will tend toward a competitive balance point, known as the Pareto-optimal equilibrium[18], in which economic efficiency is achieved.
But how well does such an equilibrium serve the best interests of society? A team of computer scientists studied how beneficial or detrimental equilibria can be[19] from a computational perspective. The researchers studied systems in which uncooperative agents share a common resource, the mathematical equivalent of roadways or fisheries.
They came up with a ratio between the worst possible equilibrium – traffic congestion or overfishing – and the social optimum, a ratio dubbed the “Price of Anarchy[20]” because it measures how far from optimal such uncooperative systems can be. They showed that this ratio can be very high. In other words, economic efficiency does not guarantee that the best interests of society are fulfilled.
Another team of researchers asked how long it takes until economic agents converge to an equilibrium[21]. By studying the computational complexity[22] of computing such equilibria, the researchers showed that there are systems that take an exceedingly long time to converge to an equilibrium.
The implication is that economic systems are very unlikely ever to be in an equilibrium, because the underlying variables – such as prices, supply and demand – are very likely to change while the systems are making their slow way toward convergence. In other words, economic equilibrium[23], a central concept in economic theory, is a mythical rather than a real phenomenon. This is not an argument against free markets, but it does require a pragmatic view of them.
Free markets can be efficient and at the same time bad for society as a whole.
AP Photo/Lynne Sladky[24]
When sex is best
It is interesting to consider how nature deals with the trade-off between efficiency and resilience. This issue was addressed in a computer science paper titled “Sex as an Algorithm[25].” Computer scientists know that search techniques allowing individual steps that are less than optimal but could lead to an overall better solution[26] are, in general, computationally superior[27] to search techniques that mimic natural selection[28] by creating “offspring” of previous solutions and adding random mutations.
[The Conversation’s most important coronavirus headlines, weekly in a science newsletter[29]]
Why, then, has nature chosen sexual reproduction as the almost exclusive reproduction mechanism in animals? The answer is that sex as an algorithm offers advantages[30] other than good performance.
In particular, natural selection favors genes that work well with a greater diversity of other genes, and this makes the species more adaptable to disruptive environmental changes – that is to say, more resilient. Thus, in the interest of long-term survival, nature prioritized resilience over efficiency.
Car insurance and climate change
The bottom line is that resilience is a fundamental but underappreciated societal need. But both computing and economics have underemphasized resilience. In general, markets and people are quite bad at preparing for very low-probability or very long-term events[31].
For example, people have to be forced to buy car insurance, because buying insurance is not efficient. After all, in the aggregate, the insurance business is profitable for the insurers, not for the insured. The purpose of insurance is increased resilience. This example shows that ensuring resilience requires societal action and cannot be left to markets.
The economic impact of the pandemic shows the cost of society’s failure to act. And COVID-19 may be just the warmup act[32] for the much bigger impending climate crisis, so focusing on resilience is becoming more and more important.
There seems to be a broad recognition that the incalculable suffering and trauma of COVID-19 offers societies[33] ways to change for the better[34]. Similar lessons can be drawn from Winter Storm Uri and the Boeing 737 Max.
Focusing on resilience is a way for societies to change for the better. In the meantime, the steady flow of news events – like a pipeline company that appears to have underinvested in security[35] – continues to underscore the cost of prizing efficiency over resilience.
References
- ^ ability to adapt to large or sudden changes in the environment (www.wsj.com)
- ^ emphasis on short-term gains (www.project-syndicate.org)
- ^ buffers against shocks (www.nytimes.com)
- ^ computer scientist (scholar.google.com)
- ^ obsessed with efficiency (www.project-syndicate.org)
- ^ Economic efficiency (www.investopedia.com)
- ^ self-interest and freedom of production and consumption (www.investopedia.com)
- ^ “The Art of Computer Programming,” (www-cs-faculty.stanford.edu)
- ^ Winter Storm Uri (www.pbs.org)
- ^ nearly 200 people (www.houstonchronicle.com)
- ^ early warnings (www.aging.senate.gov)
- ^ made the global economic system more vulnerable (www.wsj.com)
- ^ AP Photo/Elaine Thompson (newsroom.ap.org)
- ^ flight instability (www.forbes.com)
- ^ relied on data from a single sensor (www.cnn.com)
- ^ grounded for nearly two years (www.flightradar24.com)
- ^ at the expense of safety (www.nytimes.com)
- ^ Pareto-optimal equilibrium (www.britannica.com)
- ^ how beneficial or detrimental equilibria can be (doi.org)
- ^ Price of Anarchy (www.ams.org)
- ^ how long it takes until economic agents converge to an equilibrium (doi.org)
- ^ computational complexity (www.esi2.us.es)
- ^ economic equilibrium (www.investopedia.com)
- ^ AP Photo/Lynne Sladky (newsroom.ap.org)
- ^ Sex as an Algorithm (dx.doi.org)
- ^ allowing individual steps that are less than optimal but could lead to an overall better solution (mathworld.wolfram.com)
- ^ computationally superior (doi.org)
- ^ natural selection (evolution.berkeley.edu)
- ^ The Conversation’s most important coronavirus headlines, weekly in a science newsletter (theconversation.com)
- ^ offers advantages (dx.doi.org)
- ^ preparing for very low-probability or very long-term events (www.amazon.com)
- ^ warmup act (www.scmp.com)
- ^ offers societies (www.washingtonpost.com)
- ^ change for the better (www.wired.com)
- ^ appears to have underinvested in security (www.washingtonpost.com)
Authors: Moshe Y. Vardi, Professor of Computer Science, Rice University
