Why America Needs an Equivalent of the FDA for Educational Technologies

Peddling educational media and games is a lot like selling drugs to the parents of sick children: In both cases, the buyers are desperate. Those buying educational products often do so out of concern (or perhaps fear) for their child’s cognitive “health” and, thereby, their future as employable and successful adults. The hope is that some cognitive “treatment,” like a set of Baby Einstein DVDs or an iPad app, will ensure the “normal” mental development of their child, or perhaps provide them an advantage over other children. These practices are in some ways no different than anxiously shuttling infants and toddlers to pediatricians to see if they “are where they should be” or fretting over proper nutrition. However, the desperation and anxiety of parents serves as an incentive for those who develop and sell treatment options to overstate their benefits, if not outright deceive. Although regulations and institutions (i.e., the FDA) exist to help that ensure parents concerned about their son or daughter’s physiological development are not being swindled, those seeking to improve or ensure proper growth of their child’s cognitive abilities are on their own, and the market is replete with the educational equivalent of snake oil and laudanum.

Take the example of Baby Einstein. The developers of this DVD series promise that they are designed to “enrich your baby’s happiness” and “encourage [their] discovery of the world.” The implicit reference to Albert Einstein is meant to persuade parents that these DVDs provide a substantial educational benefit. Yet, there is good reason to be skeptical of Baby Einstein. The American Academy of Pediatrics, for instance, recommends against exposing children under two to television and movies to children as a precaution against the potential development harms. A 2007 study broke headlines when researchers found evidence that the daily watching of educational DVDs like Baby Einstein may slow communicative development in infants but had no significant effects on toddlers[1]. At the time, parents were already shelling out $200 million a year to Baby Einstein with the hope of stimulating their child’s brain. What they received, however, was likely no more than an overhyped electronic babysitter.  

Today, the new hot market for education technology is not DVDs but iPad and smartphone apps. Unsurprisingly, the cognitive benefits provided by them are just as uncertain. As Celilia Kang notes, “despite advertising claims, there are no major studies that show whether the technology is helpful or harmful.” Given this state of uncertainty, firms can overstate the benefits provided by their products and consumers have little to guide them in navigating the market. Parents are particularly easy marks. Much like how an individual receiving a drug or some other form of medical treatment is often in a poor epistemological position to evaluate its efficacy (they have little way of knowing how they would have turned out without treatment or with an alternative), parents generally cannot effectively appraise the cognitive boost given to their child by letting them watch a Baby Einstein DVD or play an ostensibly literacy-enhancing game on their iPad. They have no way of knowing if little Suzy would have learned her letters faster or slower with or without the educational technology, or if it were substituted with more time for play or being read to. They simply have no point of comparison. Lacking a time machine, they cannot repeat the experiment.

Move over, some parents might be motivated to look for reasons to justify their spending on educational technologies or simply want to feel that they have agency in improving their child’s capacities. Therefore, they are likely to suffer from a confirmation bias. It is far too easy for parents to convince themselves that little David counted to ten because of their wise decision to purchase an app that bleats the numbers out of the tablet’s speakers when they jab their finger toward the correct box. Educational technologies have their own placebo effect. It just so happens to affect the minds of parents, not the child using the technology. Moreover, determining whether or not one’s child has been harmed is no easy matter. Changes in behavior could be either over or under estimated depending on to what extent parents suffers from an overly nostalgic memory of their own childhood or generational amnesia concerning real significant differences.  

Yet, it is not only parents and their children who may be harmed by wasting time and money on learning technologies that are either not substantively more effective or even cognitively damaging. School districts spend billions of taxpayer money on new digital curricula and tools with unproven efficacy. There are numerous products, from Carengie’s “Cognitive Tutor” to Houghton Mifflin Harcourt’s “Destination Reading,” that make extravagant claims about their efficacy but have been found not to significantly improve learning outcomes over traditional textbooks when reviewed by the Department of Education. Nevertheless, both are still for sale. Websites for these software packages claim that they are “based on over 20 years of research into how students think and learn” and “empirical research and practice that helps identify, prevent, and remediate reading difficulties.” Nowhere is it stated on the companies’ websites that third party research suggests that these expensive pieces of software may not actually improve outcomes.  

Even if some educational technologies prove to be somewhat more effective than a book or numbered blocks, they may still be undesirable for other reasons. Does an app cut into time that might otherwise be spent playing with parents or siblings? Children, on average, already spend seven hours each day in front of screens, which automatically translates into less time spent outdoors on non-electronic hobbies and interactions. The cultural presumption that improved educational outcomes always lie with the “latest and greatest” only exacerbates this situation. Do educational technologies in school districts come at the costs of jobs for teachers or cut into budgets for music and arts programs? The Los Angeles school district has cut thousands of teachers from their payroll in recent years but, as Carlo Rotella notes, is spending $500 million in bond money to purchase iPads. All the above concerns do not even broach the subject of how people raised on tablets might be changed in undesirable ways as a result. What sorts of expectations, beliefs and dispositions might their usage be more compatible? Given concerns about how technologies like the Internet influence how people think in general, concerned citizens should not let childhood be dominated by them without adequate debate and testing.

Because of the potential for harm, uncertainty of benefit and the difficulty for consumers to be adequately informed concerning either, the US should develop an equivalent to the FDA for educational technologies. Many Americans trust the FDA to prevent recurrences of pharmaceutical mistakes like thalidomide, the morning sickness drug that led to dead and deformed babies. Why not entrust a similar institution to help ensure that future children are not cognitively stunted, as may have happened with Baby Einstein DVDs, or simply that parents and school districts do not waste money on the educational equivalent of 19th century hair tonics and “water cures?”

The FDA, of course, is not perfect. Some aspects of human health are too complex to be parsed out through the kinds of experimental studies the FDA requires. Just think of the perpetual controversy over what percentage of people’s diet should come from fats, proteins and starches. Likewise, some promising treatments may never get pursued because the return on investment may not match the expenses incurred in getting FDA approval. The medicinal properties of some naturally occurring substances, for instance, have often not been substantively tested because, in that state, they cannot be patented. Finally, how to intervene in the development of children is ultimately a matter of values. Even pediatric science has been shaped by cultural assumptions about what an ideal adult looks like. For instance, mid-twentieth century pediatricians insisted, in contrast to thousands of years of human history, that sleeping alone promoted the healthiest outcomes for children. Today, it is easy to recognize that such science was shaped by Western myths of the self-reliant or rugged individual.

The above problems would likely also affect any proposed agency for assessing educational technologies. What makes for “good” education depends on one's opinion concerning what kind of person education ought to produce. Is it more important that children can repeat the alphabet or count to ten at earlier and earlier ages or that they can approach the world with not only curiosity and wonder but also as a critical inquirer? Is the extension of the logic and aims of the formal education system to earlier and earlier ages via apps and other digital devices even desirable? Why not redirect some of the money going to proliferating iPad apps and robotic learning systems to ensuring all children have the option to attend something more like the "forest kindergartens" that have existed in Germany for decades? No scientific study that can answer such questions. Nevertheless, something like an Educational Technology Association would, in any case, represent one step toward a more ethically responsible and accountable educational technology industry.

_______________________________________
[1] Like any controversial study, its findings are a topic of contention. Other scholars have suggested that the data could be made to show a positive, negative or neutral result, depending on statistical treatment. The authors of the original study have countered, arguing that the critics have not undermined the original conclusion that the educational benefits of these DVDs are dubious at best and may crowd-out more effective practices like parents reading to their children.