Metro

  • Written by Mayank Kejriwal, Research Assistant Professor of Computer Science, University of Southern California

My colleagues and I changed a digital version of Monopoly so that instead of getting US$200 each time a player passes Go, the player is charged a wealth tax. We didn’t do this to gain an advantage or trick anyone. The purpose is to throw a curveball at artificial intelligence agents that play the game.

Our aim is to help the agents learn[1] to handle unexpected events, something AIs to date have been decidedly bad at. Giving AIs this kind of adaptability is important for futuristic systems like surgical robots[2], but also algorithms in the here and now that decide who should get bail[3], who should get approved for a credit card[4] and whose resume gets through[5] to a hiring manager. Not dealing well with the unexpected in any of those situations can have disastrous consequences.

AI agents need the ability to detect, characterize and adapt to novelty in human-like ways. A situation is novel if it challenges, directly or indirectly, an agent’s model of the external world, which includes other agents, the environment and their interactions.

While most people do not deal with novelty in the most perfect way possible, they are able to to learn from their mistakes and adapt. Faced with a wealth tax in Monopoly, a human player might realize that she should have cash handy for the IRS as she is approaching Go. An AI player, bent on aggressively acquiring properties and monopolies, may fail to realize the appropriate balance between cash and nonliquid assets until it’s too late.

Adapting to novelty in open worlds

Reinforcement learning[6] is the field that is largely responsible for “superhuman” game-playing AI agents[7] and applications like self-driving cars[8]. Reinforcement learning uses rewards and punishment to allow AI agents to learn by trial and error. It is part of the larger AI field of machine learning.

The learning in machine learning implies that such systems are already capable of dealing with limited types of novelty. Machine learning systems tend to do well on input data that are statistically similar, although not identical, to those on which they were originally trained. In practice, it is OK to violate this condition as long as nothing too unexpected is likely to happen.

Such systems can run into trouble in an open world[9]. As the name suggests, open worlds cannot be completely and explicitly defined. The unexpected can, and does, happen. Most importantly, the real world is an open world.

However, the “superhuman” AIs are not designed to handle highly unexpected situations in an open world. One reason may be the use of modern reinforcement learning itself, which eventually leads the AI to be optimized for the specific environment in which it was trained. In real life, there are no such guarantees. An AI that is built for real life must be able to adapt to novelty in an open world.

Novelty as a first-class citizen

Returning to Monopoly, imagine that certain properties are subject to rent protection[10]. A good player, human or AI, would recognize the properties as bad investments compared to properties that can earn higher rents and not purchase them. However, an AI that has never before seen this situation, or anything like it, will likely need to play many games before it can adapt.

Before computer scientists can even start theorizing about how to build such “novelty-adaptive” agents, they need a rigorous method for evaluating them. Traditionally, most AI systems are tested by the same people who build them. Competitions[11] are more impartial, but to date, no competition has evaluated AI systems in situations so unexpected that not even the system designers could have foreseen them. Such an evaluation is the gold standard for testing AI on novelty, similar to randomized controlled trials[12] for evaluating drugs.

In 2019, the U.S. Defense Advanced Research Projects Agency launched a program called Science of Artificial Intelligence and Learning for Open-world Novelty[13], called SAIL-ON for short. It is currently funding many groups, including my own at the University of Southern California[14], for researching novelty adaptation in open worlds.

One of the many ways in which the program is innovative is that a team can either develop an AI agent that handles novelty, or design an open-world environment for evaluating such agents, but not both. Teams that build an open-world environment must also theorize about novelty in that environment. They test their theories and evaluate the agents built by another group by developing a novelty generator. These generators can be used to inject unexpected elements into the environment.

Under SAIL-ON, my colleagues and I recently developed a simulator called Generating Novelty in Open-world Multi-agent Environments[15], or GNOME. GNOME is designed to test AI novelty adaptation in strategic board games that capture elements of the real world.

Diagram of a Monopoly game with symbols indicating players, houses and hotels The Monopoly version of the author’s AI novelty environment can trip up AI’s that play the game by introducing a wealth tax, rent control and other unexpected factors. Mayank Kejriwal, CC BY-ND[16]

Our first version of GNOME uses the classic board game Monopoly. We recently demonstrated the Monopoly-based GNOME[17] at a top machine learning conference[18]. We allowed participants to inject novelties and see for themselves how preprogrammed AI agents performed. For example, GNOME can introduce the wealth tax or rent protection “novelties” mentioned earlier, and evaluate the AI following the change.

By comparing how the AI performed before and after the rule change, GNOME can quantify just how far off its game the novelty knocked the AI. If GNOME finds that the AI was winning 80% of the games before the novelty was introduced, and is now winning only 25% of the games, it will flag the AI as one that has lots of room to improve.

The future: A science of novelty?

GNOME has already been used to evaluate novelty-adaptive AI agents built by three independent organizations also funded under this DARPA program. We have also built GNOMEs based on poker, and “war games” that are similar to Battleship[19]. In the next year, we will also be exploring GNOMEs for other strategic board games like Risk[20] and Catan[21]. This research is expected to lead to AI agents that are capable of handling novelty in different settings.

[Deep knowledge, daily. Sign up for The Conversation’s newsletter[22].]

Making novelty a central focus of modern AI research and evaluation has had the byproduct of producing an initial body of work[23] in support of a science of novelty. Not only are researchers like ourselves exploring definitions and theories of novelty, but we are exploring questions that could have fundamental implications. For example, our team is exploring the question of when a novelty is expected to be impossibly difficult for an AI. In the real world, if such a situation arises, the AI would recognize it and call a human operator.

In seeking answers to these and other questions, computer scientists are now trying to enable AIs that can react properly to the unexpected, including black-swan events[24] like COVID-19. Perhaps the day is not far off when an AI will be able to not only beat humans at their existing games, but adapt quickly to any version of those games that humans can imagine. It may even be capable of adapting to situations that we cannot conceive of today.

References

  1. ^ help the agents learn (www.darpa.mil)
  2. ^ surgical robots (dx.doi.org)
  3. ^ who should get bail (www.wired.com)
  4. ^ get approved for a credit card (www.fool.com)
  5. ^ gets through (hbr.org)
  6. ^ Reinforcement learning (www.kdnuggets.com)
  7. ^ “superhuman” game-playing AI agents (deepmind.com)
  8. ^ self-driving cars (doi.org)
  9. ^ open world (erichorvitz.com)
  10. ^ rent protection (bungalow.com)
  11. ^ Competitions (www.kaggle.com)
  12. ^ randomized controlled trials (dx.doi.org)
  13. ^ Science of Artificial Intelligence and Learning for Open-world Novelty (www.darpa.mil)
  14. ^ including my own at the University of Southern California (viterbischool.usc.edu)
  15. ^ Generating Novelty in Open-world Multi-agent Environments (usc-isi-i2.github.io)
  16. ^ CC BY-ND (creativecommons.org)
  17. ^ demonstrated the Monopoly-based GNOME (nipsdemo-env.eba-b36iexax.us-east-2.elasticbeanstalk.com)
  18. ^ top machine learning conference (nips.cc)
  19. ^ Battleship (entertainment.howstuffworks.com)
  20. ^ Risk (shop.hasbro.com)
  21. ^ Catan (www.catan.com)
  22. ^ Sign up for The Conversation’s newsletter (theconversation.com)
  23. ^ initial body of work (doi.org)
  24. ^ black-swan events (www.wsj.com)

Authors: Mayank Kejriwal, Research Assistant Professor of Computer Science, University of Southern California

Read more https://theconversation.com/embrace-the-unexpected-to-teach-ai-how-to-handle-new-situations-change-the-rules-of-the-game-157560

Metropolitan republishes selected articles from The Conversation USA with permission

Visit The Conversation to see more

Entertainment News

Ny’a: My Musical Journey

It’s been such an amazing musical journey. Starting my career in the late 1990’s and selling over 500,000 copies of my debut album “Embrace” worldwide was the beginning of it all.  It was an incredible start of my career. It was a whirlwind for m...

Ny’a - avatar Ny’a

Pro Tips for Gambling Online

While online gambling sounds like an entertaining thing to spend your afternoons playing, it is also serious business for professional players. Those that take gambling seriously know all the tips and tricks that make a good game. Not only do the...

News Co - avatar News Co

The New Art: Balancing Human and Synth in Music Creation

It’s a great time to be alive for indie music makers! There are many of us, maybe including you, who are creating good music out there, armed with nothing but our own ingenuity and the few dollars in our shallow pockets. But what’s the best way to ...

Angela Predhomme - avatar Angela Predhomme

An unstoppable force in indie R&B music since her re-emergence in 2015, Ny’a releases “Waiting”

An unstoppable force in indie R&B music since her re-emergence in 2015, Ny’a has topped the World Indie and Euro Indie Charts countless times, hit the R&B Soul Chart and Club Music Chart Top 20 and became the first artist since Janet Jack...

News Co - avatar News Co

An Aussie Band Breaks Into The US Music Market

AN AUSTRALIAN BAND’S STEPS TAKEN TRYING TO BREAK INTO THE US MARKET By skinsNbones The steps skinsNbones have taken as a band trying to break into the music market haven’t been taken in the traditional Australian way. We didn’t have the opportun...

News Co Media - avatar News Co Media

KENNY BLACK , STEPHEN WRENCH AND SHIMMER JOHNSON Release “Good Ole Love”

After a difficult year fraught with fear, anxiety and personal and sociopolitical struggles, nothing has the power to soothe our collective souls – or coincides as perfectly with our renewed sense of hope – than a heartfelt, blissfully beautiful love...

News Co Media - avatar News Co Media

Metropolitan Business News

Essential Tips for Developing Corporate Websites

The corporate industry, just like the others, is experiencing a massive technological revolution. Organizations have changed their marketing criteria by embracing the internet. Therefore, do not be ...

News Co - avatar News Co

How to Make a Personal Injury Claim for Minors

As a parent, you want to make sure your child is always safe. But as much as you want to keep him under your watch, it is impossible to be there for him all the time. When he is out there attendin...

News Co - avatar News Co

Dress for Success - Style Essentials for Every Businessmen

Did you ever glance at a person in passing and instantly think, “Wow, they must be successful”? It seems like the rich and successful people always stand out from the crowd without even trying, ...

Diana Smith - avatar Diana Smith

Why use Google Adwords?

Google ads, previously known as Google AdWords is one of the best and most effective ways to advertise your business online. According to data released by Google, over 5.5 billion searches are made ...

News Co Media - avatar News Co Media

Perfecting Web Design For A Health-Based Website

These days, when it comes to understanding what we put into our bodies, we are more focused than ever. It seems that everywhere we look, there is another health benefit, product, or trend on the...

News Co Media - avatar News Co Media

3 Realistic Reasons Why Physical Offices Are (Almost) Dead

Nowadays, more and more businesses are trying to find alternatives to traditional offices. For many years, brick and mortar offices have been at the heart of a company’s life. But work environme...

News Co Media - avatar News Co Media

Writers Wanted


News Co Media

Content & Technology Connecting Global Audiences

More Information - Less Opinion