Advertisement

Does Brain Training Work?

Experts are skeptical about the effectiveness of games that claim to improve cognitive function. 

By | April 21, 2014

FLICKR, J E THERIOTCompanies hawking brain-training games have enjoyed massive success in recent years. Joe Hardy, the vice president of research and development at Lumosity—one of the most well-known of these companies—told The Scientist in an e-mail that his firm has more than 50 million users. These ventures bank on consumers’ expectations of cognitive benefits from brain training, but the scientific evidence to date suggests that the games do little beyond make people better at the specific tasks involved in game-play.

“Psychologists have been trying to come up with ways to increase intelligence for a very long time,” said D. Zachary Hambrick, a professor of psychology at Michigan State University. “We’ve been interested in increasing intelligence for almost as long as we’ve studied intelligence, which is over a century.”

Psychologist Randall Engle’s group at Georgia Tech has previously shown that working memory capacity is highly correlated with complex learning, problem solving, and general attention control. But he pointed out that this correlation does not mean that by increasing working memory capacity, fluid intelligence can be increased. “This idea that intelligence can be trained would be a great thing if it were true,” Engle said.

In 2008, scientists at the University of Michigan and the University of Bern in Switzerland published a paper in PNAS that concluded training for just 10 hours on a working memory task known as the adaptive dual n-back task, which appears in some forms in commercial brain-training software, could improve some measures of fluid intelligence—that which is behind the ability to solve problems. The researchers uncovered something unusual: evidence for far transfer—performance on a reasoning task improved after practicing a working-memory task. While near transfer—training on a task that leads to improvements in identical or similar tasks—is fairly common, far transfer had been observed only rarely.

The researchers also described a dosage effect of training on the dual n-back task. “The longer you train, the bigger the impact is,” said coauthor Martin Buschkuehl, who is now the director of education research at MIND Research Institute, a nonprofit organization in Irvine, California that has created game-based mathematics software available in elementary schools across the U.S.

When Engle’s group tried to repeat the findings of the 2008 PNAS paper, “we totally failed to replicate the . . . study,” he said. For the paper that resulted from their efforts, which was published in 2012 in Journal of Experimental Psychology, the researchers taught the same working memory tasks, in which participants were presented with stimuli one right after the other and are asked to recall which occurred a certain number of times previously, to one group of young adults; an adaptive visual search task to a second group; and no task to a control group. The researchers assessed the participants at the beginning, middle, and end of the training programs for measures of cognitive function, including fluid intelligence and multitasking. The groups that practiced the n-back and the visual search tasks improved their performance on those tasks specifically, but the team found no positive transfer to the other cognitive abilities they tested.

“If it’s too good to be true, it probably isn’t true,” said Engle. He suggested that the 2008 study and others like it that have shown the benefit of training tasks may have lacked appropriate controls, which his group corrected for by using the visual search task group. The dual n-back task also does not relate well to real-world cognition, he said. Engle said he has extensively used other types of tasks that better predict real-world cognition. When his team tested the far transfer of these complex working memory span tasks for a paper published in Psychological Science in 2013, the researchers found that even improvements on the performance of the complex span tasks did not transfer to increases in measures of fluid intelligence.

Other groups have also encountered problems replicating the results of the 2008 study. Work published in 2012 in Intelligence suggested that working memory training did not improve intelligence in young adults. The participants in this study improved their performance on the training task, but the researchers found no improvements in the subjects’ fluid intelligence or working memory capacity.

“Data obtained so far doesn’t seem to show that working memory capacity was expanded after working memory training,” coauthor Weng-Tink Chooi, who is now a researcher at the Advanced Medical and Dental Institute of the Universiti Sains Malaysia, wrote in an e-mail to The Scientist. “What is more consistently observed is that improvements are noted on the trained task and other tasks that share the same specific skills/processes engaged as the trained task.”

“We take this non-replication very seriously,” said Buschkuehl. “What we now need to do is find out why some studies worked and some did not.” This month, Buschkuehl and his colleagues published a paper in Memory & Cognition, suggesting a role for intrinsic motivation and individual differences in outcomes of cognitive training. “I think it is worth going forward with cognitive training even though there are some studies that did not find an effect,” he said.

A meta-analysis of the work on transfer after working memory training from researchers at the University of Oslo in Norway published in Developmental Psychology last year suggested that improvements in working memory after practicing tasks did not last over the long term. The meta-analysis also found no evidence that improvements in working memory generalize to other cognitive functions, and experts remain cautious.

“I am not totally negative about the potential for brain training,” said David Meyer, a psychologist and cognitive scientist who directs the University of Michigan’s Brain, Cognition, and Action Laboratory. But he added that there are certainly vast individual differences in the effectiveness of brain training and highlighted the dearth of sound evidence for far transfer. “What the brain-training games do is help you to get better at particular, relatively limited kinds of tasks that in effect are exercised by the game,” Meyer said. “The implication on the part of the companies is that somehow you’re going to get better at everything that is mental, and there is no evidence to show that.”

“Research has not been able to capture significant and actual benefits that the participants and brain-training software creators are claiming,” agreed Chooi.

Meyer is optimistic that questions about the effectiveness of brain-training games can be answered empirically, but “we’re going to need an enormous amount more research than has been invested so far,” he said. 

Clarification (April 22): This article has been updated to clarify that Lumosity has 50 million users. An earlier version said 50 million subscribers.

Add a Comment

Avatar of: You

You

Processing...
Processing...

Sign In with your LabX Media Group Passport to leave a comment

Not a member? Register Now!

LabX Media Group Passport Logo

Comments

Avatar of: .M....

.M....

Posts: 2

April 22, 2014

If you want to increase your IQ, have a cup of coffee . . . or espresso.

Avatar of: David Bird

David Bird

Posts: 2

April 22, 2014

But do these exercises help maintain existing cognitive skills? I don't need to get smarter. but I very much want to ameliorate degeneration as I get older!

Avatar of: Tony S

Tony S

Posts: 4

Replied to a comment from David Bird made on April 22, 2014

April 22, 2014

Agreed! At 65 I wonder how much longer things will hold together. 

Avatar of: Tony S

Tony S

Posts: 4

April 22, 2014

The only two experiences I've had that actually increased my lucidity was meditating and taking LSD; the former seemed to have done its business long term after only using it for a short while and the latter also seemed to have done whatever good it did after only a few sessions. I'd be curious about taking it now though as my memory seems to have developed some annoying quirks and my cognitive abilities seem oddly reticent too. Being a senior is no walk in the park.

Avatar of: Jim Dickinson

Jim Dickinson

Posts: 1

April 22, 2014

As a longtime subscriber and (almost) daily user of Lumosity, I am not aware that the site claims to increase intelligence, as suggested here.

I have found that regular use improves mental agility and dexterity, and improves memory -- very important to this 73-year-old!

Avatar of: Jahn

Jahn

Posts: 2

April 22, 2014

I gave a start when the cognitive dissonance, like a bad non-sequitur, jumped into the article--with psychologists who suggested that the games had any relationship to "increased intelligence".

They have missed the plot by suggesting that mental exercise has any connection with the goal of increasing intelligence.

April 23, 2014

Seed the vast syncytial neuronal network of the brain from any angle and with any spark, and see how the rest of the syncytium lights up either for good or bad, for short or long haul. The brain that is challenged by anything and from any angle is a brain whose capability is raised some notch; with either a near transfer or far transfer head start.

Avatar of: Neurona

Neurona

Posts: 33

April 23, 2014

 

 

I was put off by one company when they first came out and claimed to have over 2 dozen "scientific publications" evidencing the value of their methods.  They kindly provided a list of said publications, which included posters at meetings and internally produced documents; not juried publications at all. As far as I could tell, all the work to that point applied their methods to cognitively impaired persons, a far cry from the "everyman" market they are targeting.  That kind of extrapolation has created all kinds of problems for FDA-approved treatments and preventatives, let alone something like this which hasn't undergone that (imperfect) level of quality control.  These unprofessional citations came all while advertising that "neuroscientists" designed their program. No bona fide neuroscientist with actual research and publication experience would ever stoop to claim that the abstract of a poster at a meeting (a "presentation") is equivalent to a "publication".  Lost me at "hello". 

 

 

 

 

 

Avatar of: Lucke

Lucke

Posts: 5

Replied to a comment from Neurona made on April 23, 2014

April 23, 2014

Well, unfortunatelly, anything that is displayed to the general public, such as a poster, may be called "publication"... But we know what value to take from it...

Avatar of: jkd80401

jkd80401

Posts: 2

Replied to a comment from Tony S made on April 22, 2014

April 23, 2014

That is similar to my experience;  I've been cautioned that the LSD available today is not the same quality or purity it was in the 1960s and have not tried any since 1971.  

 

Follow The Scientist

icon-facebook icon-linkedin icon-twitter icon-vimeo icon-youtube
Advertisement

Stay Connected with The Scientist

  • icon-facebook The Scientist Magazine
  • icon-facebook The Scientist Careers
  • icon-facebook Neuroscience Research Techniques
  • icon-facebook Genetic Research Techniques
  • icon-facebook Cell Culture Techniques
  • icon-facebook Microbiology and Immunology
  • icon-facebook Cancer Research and Technology
  • icon-facebook Stem Cell and Regenerative Science
Advertisement
New England BioLabs
New England BioLabs
Advertisement
The Scientist
The Scientist
Life Technologies