Schools are buying 'growth mindset' interventions despite scant evidence that they work well
- Written by Brooke Macnamara, Assistant Professor of Psychology, Case Western Reserve University
Ten years ago, after over two decades[1] of research on this topic, Carol Dweck – the Stanford University developer of “mindset theory” – concluded[2], “what students believe about their brains – whether they see their intelligence as something that’s fixed or something that can grow and change – has profound effects on their motivation, learning, and school achievement.” This idea – mindset – has become increasingly popular since then in education. Many school teachers are very enthusiastic about teaching growth mindsets in the classroom.
But does the claim regarding “growth mindset” interventions hold up under close scrutiny?
The federal government has spent millions of taxpayer dollars on mindset research. For instance, the Institute of Education Sciences is currently spending about US$3.5 million on a five-year study to determine if a particular commercially available mindset intervention – called Brainology[3] – is effective or not. The study is expected to be complete in 2019. However, Mindset Works, Inc.[4] has been selling Brainology to schools for thousands of dollars[5] for years, claiming that students benefit from using it. For example, Brainology is sold to the District of Columbia Public Schools.
What is it about growth mindset interventions that hold so much appeal? And how much of a difference do these interventions actually make when it comes to academic achievement?
I am a psychology professor who researches[6] learning and achievement, so these are interesting questions to me. To shine the light on these issues, several colleagues and I[7] set out to examine the effectiveness of growth mindset interventions on students’ academic achievement.
Growth mindsets defined
Before we share our findings regarding growth mindset theory, it makes sense to first explain what growth mindset theory entails.
According to the theory, people can hold “fixed” mindsets or “growth” mindsets. Those who hold fixed mindsets believe that intelligence – or other attributes – are relatively stable. Those with fixed mindsets are thought to interpret challenges as signs they lack the intelligence needed to be successful. This leads these individuals to give up when they struggle or to become “devastated by setbacks[8].”
In contrast, people who hold growth mindsets believe that intelligence – or other attributes – can grow with effort. They are thought to interpret challenges as learning opportunities. This leads to exerting more effort when struggling and overcoming setbacks, according to Dweck’s theory.
This has led to the development of growth mindset intervention programs for schools.
Her colleague at Stanford, mathematics professor Jo Boaler, has stated there is a “powerful impact[9] of growth mindset messages upon students’ attainment.”
School districts are buying
School districts have invested time and money in Brainology and other growth mindset interventions, and mindset researchers have called for policies[10] to include these interventions in education. But since school districts are increasingly dealing with decimated budgets[11], it makes sense to question whether investments in growth mindset interventions are a wise use of tax dollars and and a wise use of teachers’ and students’ time.
To answer this question, my colleagues and I chose to look at the data on growth mindset interventions overall. This approach is called a meta-analysis, a process in which researchers attempt to find all relevant studies on a given topic and analyze them all. Meta-analyses generally provide a clearer picture of the true effects than any single study can provide.
Unimpressive results
Growth mindset interventions typically teach students that the brain is like a muscle and can grow with effort. Students learn “how they can make their brains work better and grow smarter[12].” For example[13], they might read a paper describing the idea that the brain grows smarter when challenged and then come up with a personal example of a time they “got smarter” by practicing and improving at something. These interventions are thought to “lead to large gains in student achievement[14].”
However, in our meta-analysis, we found a very small effect of growth mindset interventions on academic achievement – specifically, a standardized mean difference of 0.08. This is roughly equivalent to less than one-tenth of one grade point. To put the size of this effect in perspective, consider that the average effect size for a psychological educational intervention[15] (such as[16] teaching struggling readers how to identify main ideas and to create graphic organizers that reflect relations within a passage) is 0.57. This average effect size is more than seven times the average effect size of growth mindset interventions.
We did find modest, but still relatively small, effects for students at a high risk of academic failure – 0.19 – and for students coming from poverty – 0.34. However, in both cases, the amount of evidence was limited, so these results must be interpreted with caution.
This is a view with which Carol Dweck disagrees. In an article written in response to this piece[17], Dweck asserts that the effect sizes “don’t look so small when you use the right comparisons.”
A problematic purchase
From our standpoint, we also discovered problems with how many of the intervention studies were conducted. For example, many of the studies did not conduct what’s called a manipulation check – that is, testing students’ mindsets before and after the intervention to assess whether the intervention actually influenced students’ mindsets. Of those that did test for this, many of the results indicated that the intervention did nothing to influence students’ mindsets. For this reason, differences between the groups in academic achievement often cannot be attributed to growth mindsets.
Our findings suggest that at least some of the claims about growth mindsets – such as how they supposedly have profound effects on academic achievement[18], benefit both high- and low-achieving students[19], or are especially important for students facing situational challenges[20] – are not warranted. In fact, in more than two-thirds of the studies the effects were not statistically significantly different from zero, meaning most of the time, the interventions were ineffective.
Time and money spent on one thing means that those funds and that time are not being spent on something else. School officials, policymakers and other stakeholders may want to think twice before they buy a growth mindset intervention product or dedicate part of their curriculum to teaching growth mindsets thinking it’s going to make a difference in children’s academic performance. Our research suggests there is a good chance it won’t.
References
- ^ over two decades (scholar.google.com)
- ^ concluded (www.nais.org)
- ^ Brainology (www.mindsetworks.com)
- ^ Mindset Works, Inc. (www.mindsetworks.com)
- ^ thousands of dollars (www.mindsetworks.com)
- ^ researches (scholar.google.com)
- ^ colleagues and I (journals.sagepub.com)
- ^ devastated by setbacks (www.nais.org)
- ^ powerful impact (www.youcubed.org)
- ^ called for policies (journals.sagepub.com)
- ^ decimated budgets (www.cbpp.org)
- ^ how they can make their brains work better and grow smarter (maryschmidt.pbworks.com)
- ^ For example (web.stanford.edu)
- ^ large gains in student achievement (journals.sagepub.com)
- ^ psychological educational intervention (journals.sagepub.com)
- ^ such as (www.tandfonline.com)
- ^ in response to this piece (theconversation.com)
- ^ profound effects on academic achievement (www.nais.org)
- ^ benefit both high- and low-achieving students (www.mindsetworks.com)
- ^ especially important for students facing situational challenges (mindsetscholarsnetwork.org)
Authors: Brooke Macnamara, Assistant Professor of Psychology, Case Western Reserve University
