Technology giants didn't deserve public trust in the first place
- Written by Zachary Loeb, Ph.D. Student in History and Sociology of Science, University of Pennsylvania
Amazon may have been expecting lots of public attention when it announced where it would establish its new headquarters – but like many technology companies recently, it probably didn’t anticipate how negative the response would be. In Amazon’s chosen territories of New York and Virginia, local politicians balked[1] at taxpayer-funded enticements[2] promised to the company. Journalists across the political spectrum panned the deals[3] – and social media filled up[4] with the voices of New Yorkers and Virginians[5] pledging resistance.
Similarly, revelations that Facebook exploited anti-Semitic conspiracy theories[6] to undermine its critics’ legitimacy indicate that instead of changing, Facebook would rather go on the offensive. Even as Amazon and Apple saw their stock-market values briefly top US$1 trillion[7], technology executives were dragged before Congress[8], struggled to coherently take a stance on hate speech[9], got caught covering up sexual misconduct[10] and saw their own employees protesting business deals[11].
In some circles this is being seen as a loss of public trust[12] in the technology firms that promised to remake the world[13] – socially, environmentally and politically[14] – or at least as frustration with the way these companies have changed the world. But the technology companies need to do much more than regain the public’s trust; they need to prove that they deserved it[15] in the first place – which, when placed in the context of the history of technology criticism and skepticism[16], they didn’t.
Looking away from the problems
Big technology companies used to frame their projects in vaguely utopian, positive-sounding lingo that obscures politics and public policy, transcending partisanship and – conveniently – avoiding scrutiny. Google used to remind its workers “Don’t be evil[17].” Facebook worked to “make the world more open and connected[18].” Who could object to those ideals?
Scholars warned about the dangers of platforms like these, long before many of their founders were even born. In 1970, social critic and historian of technology Lewis Mumford predicted that the goal of what he termed “computerdom” would be “to furnish and process an endless quantity of data[19], in order to expand the role and ensure the domination of the power system.” That same year a seminal essay by feminist thinker Jo Freeman[20] warned about the inherent power imbalances[21] that remained in systems that appeared to make everyone equal.
Joseph Weizenbaum warned you.
Ulrich Hansen/Wikimedia Commons, CC BY-SA[22][23]
Similarly, in 1976, the computer scientist Joseph Weizenbaum predicted that in the decades ahead people would find themselves in a state of distress as they became increasingly reliant on opaque technical systems[24]. Countless similar warnings have been issued ever since, including important recent scholarship such as information scholar Safiya Noble[25]’s exploration of how Google searches replicate racial and gender biases[26] and media scholar Siva Vaidhyanthan[27]’s declaration that “the problem with Facebook is Facebook[28].”
The technology companies are powerful and wealthy, but their days of avoiding scrutiny may be ending. The American public seems to be starting to suspect that the technology giants were unprepared[29], and perhaps unwilling, to assume responsibility for the tools they unleashed upon the world.
In the aftermath of the 2016 U.S. presidential election, concern remains high that Russian and other foreign governments are using any available social media platform to sow discord and discontent[30] in societies around the globe[31].
Facebook has still not solved the problems[32] in data privacy and transparency[33] that caused the Cambridge Analytica scandal[34]. Twitter is the preferred megaphone for President Donald Trump[35] and home to disturbing quantities of violent hate speech[36]. The future of Amazon’s corporate offices is shaping up to be a multi-sided brawl[37] among elected officials and the people they supposedly represent.
Is it ignorance or naivete?
Viewing the present situation with the history of critiques of technology in mind, it’s hard not to conclude that the technology companies deserve the crises they are facing. These companies ask people to entrust them with their emails, personal data, online search histories and financial information, to the point that many of these companies proudly tout that they know individuals better than they know themselves[38]. They promote their latest systems, including “smart speakers” and “smart cameras,” seeking to ensure that users’ every waking moment[39] – and sleeping moments too – can be monitored, feeding more data into their money-making algorithms.
Yet seemingly inevitably these companies go on to demonstrate how unworthy of trust[40] they actually are, leaking data, sharing personal information[41] and failing to prevent hacking[42], as they slowly fill the world with a disturbing techno-paranoia worthy of an episode of “Black Mirror[43].”
Selected ‘Black Mirror’ highlights.Technology firms’ responses to each new revelation fit a standard pattern: After a scandal emerges, the company involved expresses alarm that anything went wrong, promises to investigate, and pledges to do better in the future[44]. Some time – days, weeks or even months – later, the company reveals that the scandal was a direct result of how the system was designed, and trots out a dismayed executive to express outrage at the destructive uses bad people found for their system, without admitting that the problem is the system itself.
Zuckerberg himself told the U.S. Senate in April 2018 that the Cambridge Analytica scandal had taught him “we have a responsibility[45] to not just give people tools, but to make sure that those tools are used for good.” That’s a pretty fundamental lesson[46] to have missed out on while creating a multi-billion-dollar company.
Rebuilding from what’s left
Using any technology – from a knife to a computer – carries risks, but as technological systems increase in size and complexity the scale of these risks tends to increase as well[47]. A technology is only useful if people can use it safely, in ways where the benefits outweigh the dangers, and if they can feel confident that they understand, and accept, the potential risks. A couple of years ago, Facebook, Twitter and Google may have appeared to most people as benign communication methods that brought more to society than they took away. But with every new scandal, and bungled response, more and more people are seeing that these companies pose serious dangers to society.
As tempting as it may be to point to the “off” button, there’s not an easy solution. Technology giants have made themselves part of the fabric of daily life for hundreds of millions of people[48]. Suggesting that people just quit is simple[49], but fails to recognize how reliant many people have become on these platforms – and how trapped they may feel in an increasingly intolerable situation.
As a result, people buy books about how bad Amazon[50] is – by ordering them on Amazon. They conduct Google searches for articles about how much information Google knows[51] about each individual user. They tweet about how much they hate Twitter and post on Facebook articles about Facebook’s latest scandal.
The technology companies may find themselves ruling over an increasingly aggravated user base, as their platforms spread the discontent farther and wider than possible in the past. Or they might choose to change themselves dramatically, breaking themselves up[52], turning some controls over to the democratic decisions of their users[53] and taking responsibility for the harm their platforms and products have done to the world. So far, though, it seems the industry hasn’t gone beyond offering half-baked apologies while continuing to go about business as usual. Hopefully that will change. But if the past is any guide, it probably won’t.
References
- ^ local politicians balked (www.washingtonpost.com)
- ^ taxpayer-funded enticements (www.yonkerstribune.com)
- ^ panned the deals (www.startribune.com)
- ^ social media filled up (www.westword.com)
- ^ voices of New Yorkers and Virginians (www.businessinsider.com)
- ^ Facebook exploited anti-Semitic conspiracy theories (www.nytimes.com)
- ^ stock-market values briefly top US$1 trillion (www.nytimes.com)
- ^ dragged before Congress (www.theguardian.com)
- ^ stance on hate speech (www.wired.com)
- ^ covering up sexual misconduct (www.nytimes.com)
- ^ employees protesting business deals (www.nytimes.com)
- ^ loss of public trust (www.recode.net)
- ^ firms that promised to remake the world (www.wired.com)
- ^ socially, environmentally and politically (newrepublic.com)
- ^ prove that they deserved it (www.nytimes.com)
- ^ history of technology criticism and skepticism (hss.sas.upenn.edu)
- ^ Don’t be evil (gizmodo.com)
- ^ make the world more open and connected (qz.com)
- ^ to furnish and process an endless quantity of data (www.boundary2.org)
- ^ seminal essay by feminist thinker Jo Freeman (www.wired.com)
- ^ inherent power imbalances (jofreeman.com)
- ^ Ulrich Hansen/Wikimedia Commons (commons.wikimedia.org)
- ^ CC BY-SA (creativecommons.org)
- ^ increasingly reliant on opaque technical systems (librarianshipwreck.wordpress.com)
- ^ Safiya Noble (scholar.google.com)
- ^ Google searches replicate racial and gender biases (www.slate.com)
- ^ Siva Vaidhyanthan (scholar.google.com)
- ^ the problem with Facebook is Facebook (logicmag.io)
- ^ technology giants were unprepared (theconversation.com)
- ^ sow discord and discontent (www.theatlantic.com)
- ^ societies around the globe (www.bloomberg.com)
- ^ still not solved the problems (www.nytimes.com)
- ^ data privacy and transparency (www.theverge.com)
- ^ Cambridge Analytica scandal (theconversation.com)
- ^ megaphone for President Donald Trump (www.cnn.com)
- ^ disturbing quantities of violent hate speech (theconversation.com)
- ^ multi-sided brawl (www.wired.com)
- ^ better than they know themselves (knowledge.wharton.upenn.edu)
- ^ users’ every waking moment (www.theguardian.com)
- ^ unworthy of trust (theconversation.com)
- ^ sharing personal information (www.wired.com)
- ^ prevent hacking (www.nytimes.com)
- ^ Black Mirror (www.netflix.com)
- ^ and pledges to do better in the future (www.theguardian.com)
- ^ we have a responsibility (www.washingtonpost.com)
- ^ pretty fundamental lesson (www.facebook.com)
- ^ the scale of these risks tends to increase as well (www.nature.com)
- ^ fabric of daily life for hundreds of millions of people (www.pewinternet.org)
- ^ Suggesting that people just quit is simple (www.theguardian.com)
- ^ buy books about how bad Amazon (www.amazon.com)
- ^ how much information Google knows (trends.google.com)
- ^ breaking themselves up (www.recode.net)
- ^ democratic decisions of their users (www.nytimes.com)
Authors: Zachary Loeb, Ph.D. Student in History and Sociology of Science, University of Pennsylvania
Read more http://theconversation.com/technology-giants-didnt-deserve-public-trust-in-the-first-place-106989
