The pros and cons of early years programs – where to start!

The pros and cons of early years programs – where to start!
10 May 2010

Smart… Safe… Best… Sure… there are so many ways to 'Start' these days, but once there was only Head Start. Since its inception in 1965 the program has been the most extensively applied and most heavily researched prevention effort in the US. About a million economically deprived children in the country currently receive its support at an annual cost of about $7 billion.

The results of evaluations of Head Start are notably mixed, particularly when compared to those from 'flagship programs' such as Abecedarian, the Chicago Child-Parent Centers and High/Scope Perry Preschool. Meanwhile, claims continue to be made for the benefits of pre-K schooling over early years programs. So where should a policy maker put the money?

In a recent edition of Social Policy Report, a regular publication of the Society for Research on Child Development, Jens Ludwig and Deborah Phillips use benefit-cost analysis to argue for Head Start. Their report, The Benefits and Costs of Head Start, shows that gains to participants and society have consistently exceeded the costs.

Short-term benefits of Head Start are well established, and are measured mainly in terms of academic skills, literacy, vocabulary and numeracy. Effect sizes of between 0.1 and 0.2 are common in recent robust experimental evaluations. But the equally abundant evidence about long-term gains is more shaky.

Economists Eliana Garces, Duncan Thomas and Janet Currie from the University of California Los Angeles compared children receiving Head Start with siblings who did not. They found significant benefits in terms of high school completion (22 points), college attendance (19 points) and involvement in crime (12 points).

Their study also uncovered significant differences by ethnic group. And, crucially, they detected the impact of funding: children going to better resourced Head Start centers make greater gains. The more you put in the more you get out. So the question is, how much more investment is needed?

Some sense of the answer comes from comparing the impact of Head Start and the High/Scope Perry Preschool project on vocabulary (as measured using the Peabody Picture Vocabulary Test). Head Start shows early benefits of about 0.25 of a standard deviation but these fade within three or four years. They are also less for African American children.

The impact of Perry Pre-school is much greater, about 0.9 of a standard deviation. And the impacts seem to last longer. The total cost per child of Perry Pre-school is roughly twice that of Head Start.

So could resources invested in Head Start be used better elsewhere? The results are not clear cut and readings of the evidence vary. Doug Besharov, Professor at the Maryland School of Public Policy and Senior Scholar at the American Enterprise Institute, for example, described the results of the Head Start national impact study as 'disappointingly small'; while Hirokazu Yoshikawa from New York University finds them 'consistently positive' and 'impressive'.

The difference of opinion leads the authors of “The Benefits and Costs of Head Start” into a discussion about the nuances of different evaluation strategies. Most agree that experimental evaluation is the best way to understand impact of prevention programs on health and development, but what kind of experiment?

Most evaluations of Head Start use 'Intention to Treat' strategies, in which all those randomly allocated to the program group are compared with controls, regardless of whether they actually started the program. By comparing only those who go onto the program with those who do not, what they call 'Treatment on the Treated' effect sizes rise by 0.1 and sometimes more.

These methodological considerations may pass most policy makers and practitioners by, but they may be important in deciding where scarce US prevention dollars are invested.

However, the conclusion of this discussion might be more simply put. First, no prevention program has sufficient 'reach'. Head Start is the most pervasive and well established of early years programs. It reaches just a million among 20 million aged four years or younger, of whom about four million live below the poverty line, drawn at its lowest level..

Second, investment in Head Start and in most other prevention programs is insufficient. One can see why scientists can get drawn into discussions about relative economic merits of pre-K versus Head Start or other prevention programs. Resources are scarce; policy makers have to make difficult decisions about what to buy. But a more rational strategy that invests early for later benefits would make these comparative questions irrelevant.

Finally, the wealth of evidence on Head Start is a reminder of how much there is still to learn. The Ludwig and Phillips paper alone raises important questions about understanding effect size, better comprehending the relationship between short and long term effects, and exploring more the relative merits of different evalation strategies.

See also: Can several thin reeds ever make a strong policy boat?, Getting the measure of the 'mileage' of preschool care and Pay now, break out of poverty later

References

Ludwig J and Miller D, "Does Head Start improve children's life chances?" Quarterly Journal of Economics, 122, 1, 159-208.

Puma, M., Bell, S. and colleagues (2005). "Head Start Impact Study: First year findings". Washington, DC: U.S. Department of Health and Human Services.

Graces E, Thomas D and Currie J, "Longer-term effects of Head Start" American Economic Review, 92(4), 999-1012

Explainers

Head Start

Part of President Lyndon Johnson's War on Poverty, Head Start was a pioneer in early years prevention programs. It is also the most used, having served more than 20 million preschool children since it was introduced in 1965, and now supporting supporting over 900,000. Head Start provides comprehensive education, health, nutrition, and parent involvement services to low-income children and their families. Results of evaluations, experimental and non-experimental, are mixed. The results of recent experimental evaluations, still ongoing, show consistent small to moderate impact in some, but not all areas of children's development. Benefits vary by site and recipient group.

Peabody Picture Vocabulary Test

The Peabody Picture Vocabulary Test measures verbal ability or scholastic aptitude. It can be used with children aged two years and upwards, and reliably with seven years and up. Now in its fourth edition, PPTV takes less then 15 minutes to complete. It does not require the child to read, and scoring is rapid and objective. Scores can be converted to an IQ score.

Intention to Treat

Intention to Treat is a term used in experimental evaluation to indicate that analysis of the results will include all cases randomly allocated to the intervention group, whether or not they receive the intervention. It is based on the assumption that in real life children and families may not turn up to appointments, take their medication or follow instructions. So including data on the progress of children dropping out of a program indicates impact on outcomes in the real world. The approach also helps to neutralize the effects of 'crossover' (when children in the control group get onto the program) and drop-out. Some analysts are more interested in what is called 'treatment on the treated', that is measuring just the impact on children getting the intervention.

Abecedarian

The Abecedarian program was introduced in 1972 among children of low-income households, mostly African American women from Chapel Hill, North Carolina. It provides high quality pre-school and educational childcare for children from birth to five years from disadvantaged backgrounds. It uses a systematic curriculum of ‘educational games’ with a particular emphasis on language and cognitive skills. A component for the first three years of school (ages 5-8) encourages parents to help with their children’s learning for at least 15 minutes a day. Evaluated by RCT, Abecedarian demonstrated benefits in terms of improved school readiness and achievement, age appropriate mental and physical development and lesser use of drugs, alcohol or tobacco. Cost-benefit analyses are also favorable.

High/Scope Perry Preschool project

Developed by the Division of Special Services of the Ypsilanti School District, Michigan between 1962 and 1967, and since implemented in many countries, the High/Scope or Perry Preschool program provides one or two years of part-day educational services and home visits to low-income three- and four-year-old children. The original recipients were low-IQ African American children. The program emphasises intellectual and social development and encourages children to make positive choices, solve problems, and to participate in activities that will further their health and development. Evaluated by randomized controlled trial, results from the initial program were modest in the early years, but lasting effects have been found on adult outcomes such as employment, earnings, and arrests. The program includes strong cost-benefit analysis.

The High/Scope Perry Preschool project is a Blueprints Promising Program.

Search form

Advertise here

Subscribe to our newsletter

Click here to subscribe to the Prevention Action Newsletter.

Monthly archive

Editor's Picks

There is more to the international transfer of prevention programs than just hitting the “copy and paste” buttons. The introduction of the Big Brothers Big Sisters mentoring program to Ireland offers insights into how to succeed.

Few people working with children will have heard the term “prevention scientist,” let alone know what one is or does. Yet this relatively new breed of researcher is behind the growing list of evidence-based programs being promoted in western developed countries. A new publication puts them under the microscope.

Crime and antisocial behavior prevention efforts have flourished over the last 10 years in the US. This progress can and should be used to help communities improve the life chances of their young people, a recent update urges.

Given the well-known barriers to implementing evidence-based programs, is it better to identify their discrete elements and trust practitioners to combine them in tailored packages depending on the needs of the child and family in question?

The final official review on child protection offers a shakeup of services.