.

  • Written by Zed Sevcikova Sehyr, Language and Cognitive Neuroscience Research Scientist, San Diego State University

“Desire” and “still” don’t rhyme in English, but they do rhyme in American Sign Language. Just as poets can evoke emotions and meaning by choosing words that echo one another in English, actress and Tony nominee Lauren Ridloff chooses signs that visually echo one another in her ASL adaptation of Anne Michaels’ poem “Not.”[1][2][3]

For spoken languages, there are many resources that contain information about how often words are used[4], which words rhyme and other information not found in a dictionary. But until recently, there was no such thing for sign languages.

We are four researchers who study psycholinguistics[5], linguistics[6], neuroscience[7] and deaf education[8]. Our team[9] of deaf and hearing scientists worked with a group of software engineers[10] to create the ASL-LEX[11] database that anyone can use for free. We cataloged information on nearly 3,000 signs and built a visual, searchable and interactive database[12] that allows scientists and linguists to work with ASL in entirely new ways.

Visualization of the ASL lexicon showing how the sign for 'want' fits into the network. The database approximates the complex network of signs that make up a person’s mental lexicon. Zed Sevcikova Sehyr, CC BY-ND[13][14]

Mental maps of language

To communicate in any language, people must search their mental lexicon – the words or signs that they use and recognize – to perceive or produce the right vocabulary item. How quickly and efficiently they do this depends on how their lexicon is organized in their mind[15]. The database our team built is meant to represent a mental lexicon and is allowing us to examine how signs are organized in the human mind.

For example, if you looked up “tease[16]” in the database, you would learn that this sign is used quite frequently in ASL. A person trying to sign “tease” might think of it more quickly than a rare sign like “linguistics[17].” ASL-LEX also shows that “tease” is visually similar to – and, in a visual way, rhymes with – other signs, like “ruin[18].” These related signs might also come to mind while a person thinks of “tease.” Researchers believe this process of calling up similar words or signs helps people speak[19] or sign faster[20].

Our goals were to first catalog the information that people might use to organize their mental lexicons and then to illustrate that information visually using a network map.

A woman with her hand up to her face making a motion similar to drinking. Some signs, like the sign for ‘drink,’ look a lot like what they mean. Zed Sevcikova Sehyr, CC BY-ND[21]

Building a lexicon

When we began building the database, we focused on the most common ways that people might mentally organize their vocabulary: how frequently signs are used, how much a sign visually resembles its meaning – a concept called iconicity – and how visually similar a sign is to other signs in the lexicon. There isn’t a conventional writing system for signed languages, so our team had to come up with novel methods to obtain information about the form of ASL signs.

In spoken languages, words that are used more frequently tend to be learned earlier and are processed faster[22] than infrequent words. For spoken languages, word frequency is calculated by counting words in large collections of speech – some of the biggest collections come from movies with closed captions – but there aren’t collections like this for ASL. Instead, we asked 129 deaf signers from all over the U.S. to rate signs on a 7-point scale based on how often they appear in ASL signing. The higher the value, the more frequently used the sign is.

An interactive visual database for American Sign Language reveals how signs are organized in the mind The sign for ‘brother’ is not iconic and doesn’t visually look like a brother. Zed Sevcikova Sehyr, CC BY-ND[23]

Another interesting aspect of sign language is that many signs visually resemble what they mean. For example, “drink[24]” is highly iconic because it looks like the act of drinking. But “brother[25]” is not iconic because it doesn’t look like an actual brother. Iconicity plays a key role in how signs are learned[26] and organized[27] in a person’s lexicon. To measure the iconicity of signs, we asked deaf and hearing people to judge how much a sign looks like what it means on a 7-point scale. The higher the value, the more iconic the sign is.

We also looked at how signs are formed – the handshape, location and movement of the body that make up a sign. Our team meticulously analyzed signs for many different properties including which fingers are involved, how bent they are, where the hands are located and other information. Organizing the map by handshapes, locations and movements illustrates how signs are visually related to one another and represents how researchers think signers might mentally organize their vocabularies.

A woman holding her hand open with her thumb touching her chin. The sign for ‘mother’ is simple and easy to learn. Zed Sevcikova Sehyr, CC BY-ND[28]

Patterns emerge in the lexicon

Once we built the database, we immediately saw interesting patterns in the ASL lexicon[29]. For example, frequently used signs tend to be simpler and shorter than rare signs – a pattern that holds for both spoken[30] and signed languages[31]. “Mother[32]” is an example of a common and simple sign, while “kangaroo[33]” is considered to be rare and quite complex. We found that signs used in everyday conversation become simpler over time to allow for more efficient communication[34], just like spoken words.

We also found that common signs are more likely to be in clusters of visually similar words, while rare signs are more isolated. For example, the sign “you[35]” is relatively common and is visually similar to many other signs. But “vampire[36]” is a rare and isolated sign. Interestingly, frequently used signs also tend to be less iconic[37]. Iconicity seems to help communities coin new signs, but our results suggest that as signs are used more frequently, they change form and lose the visual resemblance to their meaning.

A woman teaching a child sign language. The ASL–LEX database can help people teach sign language more strategically. Cavan Images via Getty Images[38]

A resource for research and learning

Our initial exploration of ASL-LEX was fascinating, and once the database went live, other researchers began to use it. Some are studying how signs are learned[39] or processed in the brain[40]. Others are now using the database to develop automatic sign recognition technologies – like Alexa or Siri – for ASL.

Research is only one aspect of ASL-LEX. Another purpose is to help teachers and parents of deaf children teach ASL more constructively. Children learn their first language from the people around them. But deaf children aren’t typically surrounded by people who know ASL, and this can delay their language development[41]. We hope that parents and teachers will use our freely available ASL-LEX database to identify and teach the most common and helpful signs first.

Language is at the heart of all human communities, and sign languages are no exception. There is much work to be done to ensure full equity for all deaf people. Our ASL-LEX project provides a window into ASL and, by extension, the linguistic minds of those who use the language. Our team has envisioned many ways ASL-LEX could be used, but it is the thousands of unexpected ways that researchers, educators, community members and artists could use it that we are truly excited about.

[You’re smart and curious about the world. So are The Conversation’s authors and editors. You can read us daily by subscribing to our newsletter[42].]

References

  1. ^ Desire (asl-lex.org)
  2. ^ still (asl-lex.org)
  3. ^ ASL adaptation of Anne Michaels’ poem “Not.” (www.youtube.com)
  4. ^ how often words are used (wordnet.princeton.edu)
  5. ^ psycholinguistics (scholar.google.com)
  6. ^ linguistics (scholar.google.com)
  7. ^ neuroscience (scholar.google.com)
  8. ^ deaf education (scholar.google.com)
  9. ^ Our team (asl-lex.org)
  10. ^ software engineers (www.bu.edu)
  11. ^ ASL-LEX (asl-lex.org)
  12. ^ interactive database (asl-lex.org)
  13. ^ Zed Sevcikova Sehyr (asl-lex.org)
  14. ^ CC BY-ND (creativecommons.org)
  15. ^ lexicon is organized in their mind (pure.mpg.de)
  16. ^ tease (asl-lex.org)
  17. ^ linguistics (asl-lex.org)
  18. ^ ruin (asl-lex.org)
  19. ^ helps people speak (dx.doi.org)
  20. ^ sign faster (doi.org)
  21. ^ CC BY-ND (creativecommons.org)
  22. ^ processed faster (doi.org)
  23. ^ CC BY-ND (creativecommons.org)
  24. ^ drink (asl-lex.org)
  25. ^ brother (asl-lex.org)
  26. ^ learned (doi.org)
  27. ^ organized (acadeafic.org)
  28. ^ CC BY-ND (creativecommons.org)
  29. ^ interesting patterns in the ASL lexicon (doi.org)
  30. ^ spoken (doi.org)
  31. ^ signed languages (borstell.github.io)
  32. ^ Mother (asl-lex.org)
  33. ^ kangaroo (asl-lex.org)
  34. ^ efficient communication (doi.org)
  35. ^ you (asl-lex.org)
  36. ^ vampire (asl-lex.org)
  37. ^ frequently used signs also tend to be less iconic (doi.org)
  38. ^ Cavan Images via Getty Images (www.gettyimages.com)
  39. ^ how signs are learned (doi.org)
  40. ^ processed in the brain (doi.org)
  41. ^ delay their language development (dx.doi.org)
  42. ^ You can read us daily by subscribing to our newsletter (theconversation.com)

Authors: Zed Sevcikova Sehyr, Language and Cognitive Neuroscience Research Scientist, San Diego State University

Read more https://theconversation.com/an-interactive-visual-database-for-american-sign-language-reveals-how-signs-are-organized-in-the-mind-156741

Metropolitan republishes selected articles from The Conversation USA with permission

Visit The Conversation to see more