Metro

  • Written by Anand Vaidya, Associate Professor of Philosophy, San José State University

In the “Star Trek: The Next Generation”[1] episode “The Measure of a Man,”[2] Data, an android crew member of the Enterprise, is to be dismantled for research purposes unless Captain Picard can argue that Data deserves the same rights as a human being. Naturally the question arises: What is the basis upon which something has rights? What gives an entity moral standing?

The philosopher Peter Singer[3] argues that creatures that can feel pain or suffer have a claim[4] to moral standing. He argues that nonhuman animals have moral standing, since they can feel pain and suffer. Limiting it to people would be a form of speciesism, something akin to racism and sexism.

Without endorsing Singer’s line of reasoning, we might wonder if it can be extended further to an android robot like Data. It would require that Data can either feel pain or suffer. And how you answer that depends on how you understand consciousness and intelligence.

As real artificial intelligence technology advances toward Hollywood’s imagined versions, the question of moral standing grows more important. If AIs have moral standing, philosophers like me[5] reason, it could follow that they have a right to life. That means you cannot simply dismantle them, and might also mean that people shouldn’t interfere with their pursuing their goals.

Kasparov at a chessboard with no person opposite Garry Kasparov was beaten by Deep Blue, an AI with a very deep intelligence in one narrow niche. Stan Honda/AFP via Getty Images[6]

Two flavors of intelligence and a test

IBM’s Deep Blue chess machine[7] was successfully trained to beat grandmaster Gary Kasparov. But it could not do anything else. This computer had what’s called domain-specific intelligence.

On the other hand, there’s the kind of intelligence that allows for the ability to do a variety of things well. It is called domain-general intelligence. It’s what lets people cook, ski and raise children – tasks that are related, but also very different.

Artificial general intelligence, AGI, is the term for machines that have domain-general intelligence. Arguably no machine has yet demonstrated that kind of intelligence. This summer, a startup called OPENAI[8] released a new version of its Generative Pre-Training[9] language model. GPT-3 is a natural-language-processing system, trained to read and write so that it can be easily understood by people.

It drew immediate notice[10], not just because of its impressive ability to mimic stylistic flourishes and put together plausible content[11], but also because of how far it had come from a previous version. Despite this impressive performance, GPT-3 doesn’t actually know anything[12] beyond how to string words together in various ways. AGI remains quite far off.

Named after pioneering AI researcher Alan Turing, the Turing test[13] helps determine when an AI is intelligent. Can a person conversing with a hidden AI tell whether it’s an AI or a human being? If he can’t, then for all practical purposes, the AI is intelligent. But this test says nothing about whether the AI might be conscious.

Two kinds of consciousness

There are two parts[14] to consciousness. First, there’s the what-it’s-like-for-me aspect of an experience, the sensory part of consciousness. Philosophers call this phenomenal consciousness. It’s about how you experience a phenomenon, like smelling a rose or feeling pain.

In contrast, there’s also access consciousness. That’s the ability to report, reason, behave and act in a coordinated and responsive manner to stimuli based on goals. For example, when I pass the soccer ball to my friend making a play on the goal, I am responding to visual stimuli, acting from prior training, and pursuing a goal determined by the rules of the game. I make the pass automatically, without conscious deliberation, in the flow of the game.

Blindsight nicely illustrates the difference[15] between the two types of consciousness. Someone with this neurological condition might report, for example, that they cannot see anything in the left side of their visual field. But if asked to pick up a pen from an array of objects in the left side of their visual field, they can reliably do so. They cannot see the pen, yet they can pick it up when prompted – an example of access consciousness without phenomenal consciousness.

Data is an android. How do these distinctions play out with respect to him?

Still from Star Trek: The Next Generation Do Data’s qualities grant him moral standing? CBS[16]

The Data dilemma

The android Data demonstrates that he is self-aware in that he can monitor whether or not, for example, he is optimally charged or there is internal damage to his robotic arm.

Data is also intelligent in the general sense. He does a lot of distinct things at a high level of mastery. He can fly the Enterprise, take orders from Captain Picard and reason with him about the best path to take.

He can also play poker with his shipmates, cook, discuss topical issues with close friends, fight with enemies on alien planets and engage in various forms of physical labor. Data has access consciousness. He would clearly pass the Turing test.

However, Data most likely lacks phenomenal consciousness - he does not, for example, delight in the scent of roses or experience pain. He embodies a supersized version of blindsight. He’s self-aware and has access consciousness – can grab the pen – but across all his senses he lacks phenomenal consciousness.

Now, if Data doesn’t feel pain, at least one of the reasons Singer offers for giving a creature moral standing is not fulfilled. But Data might fulfill the other condition of being able to suffer, even without feeling pain. Suffering might not require phenomenal consciousness the way pain essentially does.

For example, what if suffering were also defined as the idea of being thwarted from pursuing a just cause without causing harm to others? Suppose Data’s goal is to save his crewmate, but he can’t reach her because of damage to one of his limbs. Data’s reduction in functioning that keeps him from saving his crewmate is a kind of nonphenomenal suffering. He would have preferred to save the crewmate, and would be better off if he did.

In the episode, the question ends up resting not on whether Data is self-aware – that is not in doubt. Nor is it in question whether he is intelligent – he easily demonstrates that he is in the general sense. What is unclear is whether he is phenomenally conscious. Data is not dismantled because, in the end, his human judges cannot agree on the significance of consciousness for moral standing.

Artist's concept of wall-shaped binary codes making neuron-like connections When the 1s and 0s add up to a moral being. ktsimage/iStock via Getty Images Plus[17]

Should an AI get moral standing?

Data is kind – he acts to support the well-being of his crewmates and those he encounters on alien planets. He obeys orders from people and appears unlikely to harm them, and he seems to protect his own existence[18]. For these reasons he appears peaceful and easier to accept into the realm of things that have moral standing.

But what about Skynet[19] in the “Terminator”[20] movies? Or the worries recently expressed by Elon Musk[21] about AI being more dangerous than nukes[22], and by Stephen Hawking[23] on AI ending humankind[24]?

[Deep knowledge, daily. Sign up for The Conversation’s newsletter[25].]

Human beings don’t lose their claim to moral standing just because they act against the interests of another person. In the same way, you can’t automatically say that just because an AI acts against the interests of humanity or another AI it doesn’t have moral standing. You might be justified in fighting back against an AI like Skynet, but that does not take away its moral standing. If moral standing is given in virtue of the capacity to nonphenomenally suffer, then Skynet and Data both get it even if only Data wants to help human beings.

There are no artificial general intelligence machines yet. But now is the time to consider what it would take to grant them moral standing. How humanity chooses to answer the question of moral standing for nonbiological creatures will have big implications for how we deal with future AIs – whether kind and helpful like Data, or set on destruction, like Skynet.

References

  1. ^ “Star Trek: The Next Generation” (www.imdb.com)
  2. ^ “The Measure of a Man,” (www.youtube.com)
  3. ^ Peter Singer (uchv.princeton.edu)
  4. ^ creatures that can feel pain or suffer have a claim (press.princeton.edu)
  5. ^ philosophers like me (scholar.google.com)
  6. ^ Stan Honda/AFP via Getty Images (www.gettyimages.com)
  7. ^ Deep Blue chess machine (doi.org)
  8. ^ OPENAI (openai.com)
  9. ^ Generative Pre-Training (www.cs.ubc.ca)
  10. ^ It drew immediate notice (dailynous.com)
  11. ^ plausible content (theconversation.com)
  12. ^ doesn’t actually know anything (www.technologyreview.com)
  13. ^ Turing test (plato.stanford.edu)
  14. ^ two parts (www.nyu.edu)
  15. ^ Blindsight nicely illustrates the difference (doi.org)
  16. ^ CBS (tng.trekcore.com)
  17. ^ ktsimage/iStock via Getty Images Plus (www.gettyimages.com)
  18. ^ protect his own existence (theconversation.com)
  19. ^ Skynet (www.youtube.com)
  20. ^ “Terminator” (www.youtube.com)
  21. ^ Elon Musk (www.tesla.com)
  22. ^ AI being more dangerous than nukes (www.cnbc.com)
  23. ^ Stephen Hawking (www.hawking.org.uk)
  24. ^ AI ending humankind (www.bbc.com)
  25. ^ Sign up for The Conversation’s newsletter (theconversation.com)

Authors: Anand Vaidya, Associate Professor of Philosophy, San José State University

Read more https://theconversation.com/if-a-robot-is-conscious-is-it-ok-to-turn-it-off-the-moral-implications-of-building-true-ais-130453

Metropolitan republishes selected articles from The Conversation USA with permission

Visit The Conversation to see more

Entertainment News

SHERYL LEE RALPH PRESENTS THE 30TH ANNUAL DIVAS: SIMPLY SINGING UPDATE

DIVAS Simply Singing!, the longest consecutive running musical AIDS benefit in the United States, hits a major milestone in 2020, hosting its 30th annual fundraiser for The D.I.V.A. Foundation as a virtual event and on Saturday, December 5th on K...

News Co - avatar News Co

MICHAEL MESEY and AMERICAN GREED Release “Together”

“Together” As the go-to special show and traveling drummer for Chuck Berry for many years, Michael Mesey had a blast creating explosive moments on stage with the legendary musical pioneer all over the country. Yet one of his most cherished me...

News Co - avatar News Co

Actress Paris Hepburn Fights Through Covid Crisis

The entertainment industry has been hard hit in 2019 as we all know.  Since Covid-19 started entering the US in January 2019, one by one, movie studios, talent agencies, actors, crews and everything else associated with the entertainment industry...

News Co - avatar News Co

Why You Should Explore Your Creativity

You might think that you weren’t fortunate enough to be gifted at birth with creativity. You might say, “Oh, my brother got the creative genes, and I didn’t,” or “Why would I want to be creative”? Someone once asked me that last question, to whi...

Angela Predhomme - avatar Angela Predhomme

What does being the Happiness Warrior mean to me?

I’ve always felt I’ve had an innate need to set things right. If I see someone or something struggling, my nature is to help. I want them to feel good about themselves and their abilities but most importantly to find the best solution that make...

Eric North aka “The Happiness Warrior” - avatar Eric North aka “The Happiness Warrior”

THE WORLD OPERATES NOT ON REALITY, BUT ON PERCEPTION OF REALITY

Ben Kingsley's character Cosmo in the 1992 cult classic Sneakers prophetically quipped , The world doesn't operate on reality, but on perception of reality. Those words have come to roost in this year 2020 as we find ourselves living in a world ...

Brandyn Cross - avatar Brandyn Cross

Metropolitan Business News

5 Key Factors To Starting A Website

Every business needs a website to be successful. However, this is a challenge for many due to the lack of coding and designing skills. The good news is, you do have a way around this—hire a deve...

News Co - avatar News Co

So You Want To Be A Project Manager? Here's What You Must Do

Project management is often a popular choice for people looking to make a mark in the organizations they work for. It's a great choice as well. If you hate monotony, love getting people and res...

News Co - avatar News Co

How to Deliver the Perfect Elevator Pitch

Do you struggle with explaining your career with professional or personal contacts, and you want to make a lasting impression? Whether you're looking for a job or building up your network, a wel...

Adam Jacobs - avatar Adam Jacobs

Three Asian Countries That are Leaders in Outsourcing

Would it surprise you to know that three of the top five ranked countries for ease of doing business are in Asia? Would it surprise you more to know that India and China aren’t even in the top 3...

Adam Jacobs - avatar Adam Jacobs

FCB and oOh! help Kiwis vote with dynamic campaign for Electoral Commission

oOh!media and FCB NZ are helping Kiwi voters exercise their democratic rights this general election, via a localised dynamic Out of Home campaign for the New Zealand Electoral Commission. The c...

Lighthouse Communications. - avatar Lighthouse Communications.

MODEL/ACTOR THORN CASTILLO IS THE “NEW FACE” OF SCHICK STYLIST

In 2019, just as his multi-faceted career was taking off, Thorn Castillo heard Robert Downey Jr. offer a sage bit of advice during an interview on photographer/director Sam Jones’ acclaimed multi-...

News Company - avatar News Company

Writers Wanted


News Co Media Group

Content & Technology Connecting Global Audiences

More Information - Less Opinion