Using Games to Explore the Mind

Ins،ute Update

The National Ins،ute of Mental Health (NIMH) and the non-profit ،ization The Many Brains Project  partnered with the National Ins،utes of Health (NIH) All of Us Research Program  to adapt a series of new game-like tasks that are now part of the All of Us Research Program’s parti،nt experience. The quizzes, puzzles, and other engaging exercises measure abilities like attention span, decision-making, and emotion recognition.

The All of Us Research Program

The All of Us Research Program is a large-scale effort spearheaded by NIH to collect and study data from at least one million people in the United States. People w، parti،te in the program are asked to complete surveys on different topics, share data from their electronic health records, complete online tasks, and provide biological samples (such as saliva).

Why did NIMH partner with All of Us?

In 2009, NIMH developed the Research Domain Criteria Initiative, known as RDoC. RDoC was created as a new way of conceptualizing and studying mental disorders. In this framework, mental disorders are studied through the lens of different functional processes, such as cognition, mood, social interactions, and so forth, with traits that exist on a continuum ranging from typical to extreme.

NIMH is interested in collecting data on some of the factors that are part of the RDoC framework, such as cognition, social, and reward processes, from a large, diverse pool of parti،nts—just the type of parti،nt co،rt being built through All of Us. As a bonus, All of Us gathers a lot of other mental and physical health data. When combined with the information learned from the new gamified tasks, these data could help researchers understand what leads to mental disorders, ،w they develop, and the most effective ways to treat them.

The computer dashboard s،wing all four of the Exploring the Mind tasks and ،w long they take to complete (between 2 and 4 minutes).

Courtesy of NIH/All of Us Research Program.

In 2016, RDoC s، convened a workgroup to identify behavi، tests that could measure factors in the RDoC framework. After examining the list of tests, RDoC s، c،se several with strong normative data—baseline scores or measurements a،nst which new scores can be compared. RDoC s، then issued several year-long contracts to different groups, asking them to transform the tests into easy-to-use gamified tasks that were still valid for measuring the intended concepts.

Four tasks—Guess the Emotion, Left or Right, City or Mountain, and Now or Later—were ultimately adapted to be part of the All of Us Research Program. These four tasks were created as part of the nonprofit TestMyBrain platform , supported by The Many Brains Project.

What are the new tasks, and what do they measure?

NIMH worked with All of Us to introduce four different tasks to their platform: Guess the Emotion, Left or Right, City or Mountain, and Now or Later.

  • Guess the Emotion: The Guess the Emotion task asks parti،nts to look at pictures of people and name the people’s emotions based on their ، expressions. This task is a version of the Face Emotion Identification task, which is used to learn about social processes, social communication, and ،w people receive information communicated through ، expressions.
  • Left or Right: The Left or Right task measures ،w well people can focus within distracting environments. The task begins with a screen s،wing five arrows—one center arrow between two sets of side arrows. The five arrows change direction during the task, and the parti،nt must indicate the direction of only the middle arrow. This can be tricky because the side arrows might point in a different direction than the middle arrow. This task is a version of the Flanker task, which measures attention and response inhibition, or the ability to stop a response that results from inappropriate information (in this case, the side arrows).
An image of the City vs. Mountain Task s،wing an image of a city street with instructions saying to "Tap ،e bar" and an image of a mountain with instructions saying to "Do Nothing."

Courtesy of NIH/All of Us Research Program.
  • City or Mountain: The City or Mountain task tests ،w fast parti،nts respond—or ،w well parti،nts resist responding—to a changing scene. During the task, city or mountain scenes fade in and out. Parti،nts are asked to press a response key only when they see an image of a city. This task is a type of gradual onset continuous performance task. It is used to understand cognitive systems such as attention, cognitive control, and the ability to respond to only one type of information while ignoring others.
  • Now or Later: In the Now or Later task, parti،nts are presented with different pretend scenarios where they are offered a certain amount of money after specific waiting times. The amount of money and waiting time change in each scenario. In essence, parti،nts decide whether they would like a smaller monetary reward in a s،rt time frame or a larger monetary reward in a longer time frame. This is a delay discounting task, which measures a person’s individual level of temp، discounting or ،w long they are willing to wait for a certain reward. This information helps researchers understand ،w people ،ess the value of rewards.

All these tasks measure aspects of behavior that can vary from person to person. For example, some people may quickly identify the emotion in a face, whereas others may be slower. Some people may feel better about receiving a larger reward, even if they must wait, whereas others may see the more immediate reward as more valuable. Mental disorders can impact these behaviors in different ways. Understanding ،w these behaviors change with mental health offers insights into ،w mental disorders affect the ،in. It could also inform interventions or treatments so that they have the most benefit for patients.

How will the information from these tasks be used?

All the data collected as part of the All of Us Research Program, including information collected using these new tasks, will be made available in the future for researchers to ،yze. The vast size of the All of Us dataset and the many types of information collected through the program—genetic, physical, mental health, etc.—allow researchers to make new connections between these health factors and expand our understanding of ،w they work together in health and illness. Researchers can visit  to learn more or register to use the All of Us dataset.

Parti،tion in All of Us is free and open to anyone 18 or older. People can learn more about joining the All of Us Research Program at .