Diana R Silver

Diana Silver

Diana R Silver

Scroll

Vice Dean of Faculty Affairs

Professor of Public Health Policy and Management

Professional overview

Dr. Diana Silver's research explores the impact of variation in the implementation, adoption and repeal of state and local public health policies on health outcomes, particularly alcohol consumption, motor vehicle crashes, tobacco use, and food safety. Some of her other work has examined variation in access to publicly funded services such as clinics, after-school programs, parks and playgrounds. Her work has been funded by the National Institutes of Health, the Robert Wood Johnson Foundation, the New York City Department of Health and Mental Hygiene, and several other funders.

Dr. Silver's work has been published in a variety of prominent journals, including the American Journal of Public Health, the American Journal of Health Promotion, Public Health, Tobacco Control, Journal of Safety Research, Social Science and Medicine, the American Journal of Evaluation, PLoS One, Journal of Community Health, Journal of Immigrant and Minority Health,  International Journal of Equity in Health, Globalization and Health, Youth and Society, Public Administration Review and Policy Studies Journal. She is an associate editor for the American Journal of Health Promotion, and serves on the New York City Department of Health’s Health Advisory Committee. She began her career focused on the developing policies and programs that could address the epidemics of AIDS, substance abuse and violence in New York City, in such settings as schools, workplaces, jails, and homeless shelters.

Dr. Silver teaches undergraduate and master’s level courses at the School of Global Health, and trains doctoral students. In 2015, Dr. Silver received NYU’s Distinguished Teaching Award, the university’s highest honor for teaching excellence.

Education

BA, History, Bates College, Lewiston, ME
MPH, Health Education, Hunter College, New York City, NY
PhD, Public Administration, New York University, New York City, NY

Honors and awards

Distinguished Teaching Award, New York University (2015)
Steinhardt Goddard Award (2011)
Annual Award for Outstanding Evaluation, American Evaluation Association (2010)
Public Affairs Resident Scholar, The Rockefeller Foundation (2007)

Areas of research and study

Access to Healthcare
Alcohol, Tobacco and Driving Policies
Food Safety Policies
Implementation and Impact of Public Health Regulations
Injury Prevention
New York Department of Health and Mental Hygiene
Public Health Law
Public Health Policy

Publications

Publications

Age, period, and cohort effects in motor vehicle mortality in the United States, 1980-2010: The role of sex, alcohol involvement, and position in vehicle

Macinko, J., Silver, D., & Bae, J. Y. (n.d.).

Publication year

2015

Journal title

Journal of Safety Research

Volume

52

Page(s)

47-57
Abstract
Abstract
Introduction Although substantive declines in motor vehicle fatalities in 1980-2010 have been observed, declines by position in the vehicle and alcohol involvement have not been well elucidated. Method Analyses of FARS data use the Intrinsic Estimator (IE) to produce estimates of all age, period, and cohort effects simultaneously by position in the car and by alcohol involvement. Results Declines in MVC deaths by position in the car vary for men and women by age and cohort over time. Cohorts born before 1970 had higher risks than those born later. Analyses using proxy indicators of alcohol involvement found the highest risks for those aged 16-24. By period, these risks declined more rapidly than non- alcohol related traffic fatalities. Conclusion Changes in risk patterns are consistent with evidence regarding the contributions of new technologies and public policy efforts to reduce fatalities, but gains have not been shared evenly by sex or position in the car. Practical applications Greater attention is needed in reducing deaths among older drivers and pedestrians. Gender differences should be addressed in prevention efforts aimed at reducing MVCs due to alcohol involvement.

Diffusion of impaired driving laws among US states

Macinko, J., & Silver, D. (n.d.).

Publication year

2015

Journal title

American journal of public health

Volume

105

Issue

9

Page(s)

1893-1900
Abstract
Abstract
Objectives. We examined internal and external determinants of state's adoption of impaired driving laws. Methods. Data included 7 state-level, evidence-based public health laws collected from 1980 to 2010. We used event history analyses to identify predictors of first-time law adoption and subsequent adoption between state pairs. The independent variables were internal state factors, including the political environment, legislative professionalism, government capacity, state resources, legislative history, and policy-specific risk factors. The external factors were neighboring states' history of law adoption and changes in federal law. Results. We found a strong secular trend toward an increased number of laws over time. The proportion of younger drivers and the presence of a neighboring state with similar laws were the strongest predictors of first-time law adoption. The predictors of subsequent law adoption included neighbor state adoption and previous legislative action. Alcohol laws were negatively associated with first-time adoption of impaired driving laws, suggesting substitution effects among policy choices. Conclusions. Organizations seeking to stimulate state policy changes may need to craft strategies that engage external actors, such as neighboring states, in addition to mobilizing within-state constituencies.

Patterns of alcohol consumption and related behaviors in Brazil: Evidence from the 2013 National Health Survey (PNS 2013)

Macinko, J., Mullachery, P., Silver, D., Jimenez, G., & Neto, O. L. M. (n.d.).

Publication year

2015

Journal title

PloS one

Volume

10

Issue

7
Abstract
Abstract
This study uses data from a nationally representative household survey (the 2013 National Health Survey, n = 62,986) to describe patterns of alcohol consumption and related behaviors among Brazilian adults. Analyses include descriptive and multivariable Poisson regression for self-reports in the past 30 days of: drinking any alcohol, binge drinking, binge drinking 4 or more times, and driving after drinking (DD); as well as age of alcohol consumption initiation. Results show that current drinking prevalence was 26%, with an average age of initiation of 18.7 years. Binge drinking was reported by 51% of drinkers, 43% of whom reported binge drinking 4 or more times. Drinking and driving was reported by nearly one quarter of those who drive a car/motorcycle. Current drinking was more likely among males, ages 25-34, single, urban, and those with more education. Binge drinking was more likely among males, older age groups, and people who started drinking before 18. Drinking and driving was higher among males, those with more education, and rural residents. Those who binge-drink were nearly 70% more likely to report DD. All behaviors varied significantly among Brazilian states. Given their potential health consequences, the levels of injurious alcohol behaviors observed here warrant increased attention from Brazilian policymakers and civil society.

Temporal trends in motor vehicle fatalities in the United States, 1968 to 2010 - a joinpoint regression analysis

Bandi, P., Silver, D., Mijanovich, T., & Macinko, J. (n.d.).

Publication year

2015

Journal title

Injury Epidemiology

Volume

2

Issue

1

Page(s)

1-11
Abstract
Abstract
Background: In the past 40 years, a variety of factors might have impacted motor vehicle (MV) fatality trends in the US, including public health policies, engineering innovations, trauma care improvements, etc. These factors varied in their timing across states/localities, and many were targeted at particular population subgroups. In order to identify and quantify differential rates of change over time and differences in trend patterns between population subgroups, this study employed a novel analytic method to assess temporal trends in MV fatalities between 1968 and 2010, by age group and sex. Methods: Cause-specific MV fatality data from traffic injuries between 1968 and 2010, based on death certificates filed in the 50 states, and DC were obtained from Centers for Disease Control and Prevention Wide-ranging Online Data for Epidemiologic Research (CDC WONDER). Long-term (1968 to 2010) and short-term (log-linear piecewise segments) trends in fatality rates were compared for males and females overall and in four separate age groups using joinpoint regression. Results: MV fatalities declined on average by 2.4% per year in males and 2.2% per year in females between 1968 and 2010, with significant declines observed in all age groups and in both sexes. In males overall and those 25 to 64 years, sharp declines between 1968 and mid-to-late 1990s were followed by a stalling until the mid-2000s, but rates in females experienced a long-term steady decline of a lesser magnitude than males during this time. Trends in those aged <1 to 14 years and 15 to 24 years were mostly steady over time, but males had a larger decline than females in the latter age group between 1968 and the mid-2000s. In ages 65+, short-term trends were similar between sexes. Conclusions: Despite significant long-term declines in MV fatalities, the application of Joinpoint Regression found that progress in young adult and middle-aged adult males stalled in recent decades and rates in males declined relatively more than in females in certain age groups. Future research is needed to establish the causes of these observed trends, including the potential role of contemporaneous MV-related policies and their repeal. Such research is needed in order to better inform the design and evaluation of future population interventions addressing MV fatalities nationally.

The effect of geography and citizen behavior on motor vehicle deaths in the United States

Abaid, N., Macinko, J., Silver, D., & Porfiri, M. (n.d.).

Publication year

2015

Journal title

PloS one

Volume

10

Issue

4
Abstract
Abstract
Death due to motor vehicle collisions (MVCs) remains a leading cause of death in the US and alcohol plays a prominent role in a large proportion of these fatalities nationwide. Rates for these incidents vary widely among states and over time. Here, we explore the extent to which driving volume, alcohol consumption, legislation, political ideology, and geographical factors influence MVC deaths across states and time. We specify structural equation models for extracting associations between the factors and outcomes for MVC deaths and compute correlation functions of states' relative geographic and political positions to elucidate the relative contribution of these factors. We find evidence that state-level variation in MVC deaths is associated with time-varying driving volume, alcohol consumption, and legislation. These relationships are modulated by state spatial proximity, whereby neighboring states are found to share similar MVC death rates over the thirty-year observation period. These results support the hypothesis that neighboring states exhibit similar risk and protective characteristics, despite differences in political ideology.

The geometry of motor vehicle deaths in the United States

Abaid, N., Porfiri, M., Silver, D., & Mancinko, J. (n.d.).

Publication year

2015

Journal title

PLoS One

Child passenger safety laws in the United States, 1978-2010: Policy diffusion in the absence of strong federal intervention

Bae, J. Y., Anderson, E., Silver, D., & Macinko, J. (n.d.).

Publication year

2014

Journal title

Social Science and Medicine

Volume

100

Page(s)

30-37
Abstract
Abstract
This article examines the diffusion of U.S. state child passenger safety laws, analyzing over-time changes and inter-state differences in all identifiable features of laws that plausibly influence crash-related morbidity and mortality. The observed trend shows many states' continuing efforts to update their laws to be consistent with latest motor vehicle safety recommendations, with each state modifying their laws on average 6 times over the 30-year period. However, there has been a considerable time lag in knowledge diffusion and policy adoption. Even though empirical evidence supporting the protective effect of child restraint devices was available in the early 1970s, laws requiring their use were not adopted by all 50 states until 1986. For laws requiring minors to be seated in rear seats, the first state law adoption did not occur until two decades after the evidence became publicly available. As of 2010, only 12 states explicitly required the use of booster seats, 9 for infant seats and 6 for toddler seats. There is also great variation among states in defining the child population to be covered by the laws, the vehicle operators subject to compliance, and the penalties resulting from non-compliance. Some states cover only up to 4-year-olds while others cover children up to age 17. As of 2010, states have as many as 14 exemptions, such as those for non-residents, non-parents, commercial vehicles, large vehicles, or vehicles without seatbelts. Factors such as the complexity of the state of the science, the changing nature of guidelines (from age to height/weight-related criteria), and the absence of coordinated federal actions are potential explanations for the observed patterns. The resulting uneven policy landscape among states suggests a strong need for improved communication among state legislators, public health researchers, advocates and concerned citizen groups to promote more efficient and effective policymaking.

Fifty-state survey of child passenger safety laws in the US, 1978-2010: A public health approach to analyzing legal intruments

Bae, J., Anderson, E., Silver, D., & Macinko, J. (n.d.).

Publication year

2014

Journal title

Social Science and Medicine

Volume

100

Page(s)

30-37

Utilization patterns and perceptions of playground users in New York City

Silver, D., Giorgio, M., & Mijanovich, T. (n.d.).

Publication year

2014

Journal title

Journal of Community Health

Volume

39

Issue

2

Page(s)

363-371
Abstract
Abstract
Playgrounds are assumed to be an important resource for physical activity. This study investigates seasonal utilization, user preferences, and perceptions of safety and upkeep of public playgrounds in New York City. A cross-sectional survey was conducted from May 2010 to January 2011 across 10 playgrounds in low/middle income neighborhoods in each of the five boroughs in New York City. A total of 1,396 adults accompanying children were surveyed. Outcomes included playground as main place of outdoor play, and perceptions of playground upkeep and safety. Covariates included socio-demographics and other characteristics of playground users. Multivariable logistic regression with playground/season fixed effects were used. Utilization varied substantially across the four seasons. Blacks had higher odds of reporting the playground as the main place of outdoor play (AOR 1.78, 95 % CI 1.13-2.80, p <.05). High income users had lower odds of reporting the playground as the main place of outdoor play (60-80,000: AOR 0.47, 95 % CI 0.29-0.76, p <.01, 80,000+: AOR 0.47, 95 % CI 0.28-0.79, p <.01). Racial differences in perceived upkeep and safety were not significant once playground/season fixed effects were included, highlighting the importance of neighborhood conditions. Women were more likely to report feeling unsafe within playgrounds (AOR 1.51, 95 % CI 1.12-2.02, p <.01). While some playground utilization is driven by individual characteristics, perceptions of public resources influences utilization and cannot be separated from neighborhood conditions. Increasing access to opportunities for physical activity for children requires new strategies beyond playground improvements.

Good Evaluation Measures: More Than Their Psychometric Properties

Weitzman, B. C., & Silver, D. (n.d.).

Publication year

2013

Journal title

American Journal of Evaluation

Volume

34

Issue

1

Page(s)

115-119
Abstract
Abstract
In this commentary, we examine Braverman's insights into the trade-offs between feasibility and rigor in evaluation measures and reject his assessment of the trade-off as a zero-sum game. We, argue that feasibility and policy salience are, like reliability and validity, intrinsic to the definition of a good measure. To reduce the tension between feasibility and measurement rigor, we argue that evaluators should make greater use of existing data, identify ways in which improved measurement will result in improved program management, and "thickly" invest measurement resources in areas where questions are most important and evaluation is most needed.

The effects of state regulations and alcohol consumption on traffic fatalities 1980-2010

Silver, D., Bae, J., Jimenez, G., Paul, M., & Mancinko, J. (n.d.).

Publication year

2013

Journal title

Public Health

Volume

127

Page(s)

1117-1125

Variation in U.S. traffic safety policy environments and motor vehicle fatalities 1980-2010

Silver, D., Macinko, J., Bae, J. Y., Jimenez, G., & Paul, M. (n.d.).

Publication year

2013

Journal title

Public Health

Volume

127

Issue

12

Page(s)

1117-1125
Abstract
Abstract
Objective: To examine the impact of variation in state laws governing traffic safety on motor vehicle fatalities. Study design: Repeated cross sectional time series design. Methods: Fixed effects regression models estimate the relationship between state motor vehicle fatality rates and the strength of the state law environment for 50 states, 1980-2010. The strength of the state policy environment is measured by calculating the proportion of a set of 27 evidence-based laws in place each year. The effect of alcohol consumption on motor vehicle fatalities is estimated using a subset of alcohol laws as instrumental variables. Results: Once other risk factors are controlled in statistical models, states with stronger regulation of safer driving and driver/passenger protections had significantly lower motor vehicle fatality rates for all ages. Alcohol consumption was strongly associated with higher MVC death rates, as were state unemployment rates. Conclusions: Encouraging laggard states to adopt the full range of available laws could significantly reduce preventable traffic-related deaths in the U.S. - especially those among younger individuals. Estimating the relationship between different policy environments and health outcomes can quantify the result of policy gaps.

How residential mobility and school choice challenge assumptions of neighborhood place-based interventions

Silver, D., Weitzman, B. C., Mijanovich, T., & Holleman, M. (n.d.).

Publication year

2012

Journal title

American Journal of Health Promotion

Volume

26

Issue

3

Page(s)

180-183
Abstract
Abstract
Purpose: Explore the importance of residential mobility and use of services outside neighborhoods when interventions targeting low-income families are planned and implemented. Design: Analysis of cross-sectional telephone household survey data on childhood mobility and school enrollment in four large distressed cities. Setting: Baltimore, Maryland; Detroit, Michigan; Philadelphia, Pennsylvania; and Richmond, Virginia. Subjects: Total of 1723 teens aged 10 to 18 years and their parents. Measures: Continuous self-report of the number of years parents lived in the neighborhood of residence and city; self-report of whether the child attends school in their neighborhood; and categorical self report of parents' marital status, mother's education, parent race, family income, child's age, and child's sex. Analysis: Chi-square and multivariate logistic regression. Results: In this sample, 85.2% of teens reported living in the city where they were born. However, only 44.4% of black teens lived in neighborhoods where they were born, compared with 59.2% of white teens. Although 50.3% of black teens attended schools outside of their current neighborhoods, only 31.4% of whites did. Residential mobility was more common among black than white children (odds ratio = 1.82; p <.001), and black teens had 43% lesser odds of attending school in their home communities. Conclusions: Mobility among low-income and minority families challenges some assumptions of neighborhood interventions premised on years of exposure to enriched services and changes in the built environment.

Improving state health policy assessment: An agenda for measurement and analysis

Macinko, J., & Silver, D. (n.d.).

Publication year

2012

Journal title

American journal of public health

Volume

102

Issue

9

Page(s)

1697-1705
Abstract
Abstract
We examine the scope of inquiry into the measurement and assessment of the state public health policy environment. We argue that there are gains to be made by looking systematically at policies both within and across health domains. We draw from the public health and public policy literature to develop the concepts of interdomain and intradomain policy comprehensiveness and illustrate how these concepts can be used to enhance surveillance of the current public health policy environment, improve understanding of the adoption of new policies, and enhance evaluations of the impact of such policies on health outcomes.

Transportation to clinic: Findings from a pilot clinic-based survey of low-income suburbanites

Silver, D., Blustein, J., & Weitzman, B. C. (n.d.).

Publication year

2012

Journal title

Journal of Immigrant and Minority Health

Volume

14

Issue

2

Page(s)

350-355
Abstract
Abstract
Health care policymakers have cited transportation barriers as key obstacles to providing health care to low-income suburbanites, particularly because suburbs have become home to a growing number of recent immigrants who are less likely to own cars than their neighbors. In a suburb of New York City,we conducted a pilot survey of low income, largely immigrant clients in four public clinics, to find out how much transportation difficulties limit their access to primary care. Clients were receptive to the opportunity to participate in the survey (response rate = 94%). Nearly one-quarter reported having transportation problems that had caused them to miss or reschedule a clinic appointment in the past. Difficulties included limited and unreliable local bus service, and a tenuous connection to a car. Our pilot work suggests that this population is willing to participate in a survey on this topic. Further, since even among those attending clinic there was significant evidence of past transportation problems, it suggests that a populationbased survey would yield information about substantial transportation barriers to health care.

Lifting boatswithout closing gaps: Child health outcomes in distressed us cities from 1992-2002

Silver, D., Mijanovich, T., Uyei, J., Kapadia, F., & Weitzman, B. C. (n.d.).

Publication year

2011

Journal title

American journal of public health

Volume

101

Issue

2

Page(s)

278-284
Abstract
Abstract
Objectives. We compared cause-specific mortality and birth rates for children and youths aged younger than 18 years in 100 US cities from 1992 through 2002. Methods. We used 5 census indicators to categorize the 100 most populous US cities in 1990 as economically distressed or nondistressed. We used Poisson regression to calculate rate ratios for cause-specific mortality and birth rates, comparing distressed cities to nondistressed cities overall and by race/ethnicity from 1992 through 2002. We also calculated rates of change in these variables within each city over this period. Results. Despite improvements in health for the study population in all cities, disparities between city groups held steady or widened over the study period. Gaps in outcomes between Whites and Blacks persisted across all cities. Living in a distressed city compounded the disparities in poor outcomes for Black children and youths. Conclusions. A strong national economy during the study period may have facilitated improvements in health outcomes for children and youths in US cities, but these benefits did not close gaps between distressed and nondistressed cities.

People versus place, tackling urban poverty: Guest blog for Media Matters

Silver, D. (n.d.).

Publication year

2010

Understanding the political context of "new" policy issues: The use of the advocacy coalition framework in the case of expanded after-school programs

Brecher, C., Brazill, C., Weitzman, B. C., & Silver, D. (n.d.).

Publication year

2010

Journal title

Journal of Public Administration Research and Theory

Volume

20

Issue

2

Page(s)

335-355
Abstract
Abstract
This article uses the Advocacy Coalition Framework to identify the stakeholders and their coalitions in the arena of after-school policy, which drew much new attention beginning in the early 1990s in many American cities. Using evidence from case studies in five cities, we show how the framework can be extended beyond stakeholder analysis to include identification of core and secondary value conflicts and of opportunities for policy analysis to help strengthen coalitions and pressures for change. Coalitions in each of the cities differ over core values relating to the purposes of after-school programs (academics versus "fun"), but policy analysts can promote common goals by developing options to deal with the secondary conflicts over the relative importance of facilities versus program content, the modes of collaboration between public schools and community based organizations, and the incentives for public school teachers to engage in staffing after-school programs.

Finding the impact in a messy intervention: Using an integrated design to evaluate a comprehensive citywide health initiative

Weitzman, B. C., Mijanovich, T., Silver, D., & Brecher, C. (n.d.).

Publication year

2009

Journal title

American Journal of Evaluation

Volume

30

Issue

4

Page(s)

495-514
Abstract
Abstract
This article uses the evaluation of the Robert Wood Johnson Foundation's (RWJF) Urban Health Initiative (UHI), a 10-year effort to improve health and safety outcomes in distressed cities, to demonstrate the strength of an evaluation design that integrates theory of change and quasi-experimental approaches, including the use of comparison cities. This paper focuses on the later stages of implementation and, especially, our methods for estimating program impacts. While the theory of change was used to make preliminary identification of intended outcomes, we used the sites' plans and early implementation to refine this list and revisit our strategy for estimating impacts. Using our integrated design, differences between program and comparison cities are considered impacts only if they were predicted by program theory, local plans for action, and early implementation. We find small, measurable changes in areas of greatest programmatic effort. We discuss the importance of the integrated design in identifying impacts.

The pros and cons of comprehensive community Initiatives at the city level: The case of the urban health Initiative

Silver, D., & Weitzman, B. (n.d.).

Publication year

2009

Journal title

The Foundation Review

Volume

1

Issue

1

Page(s)

85-95

If you build it, will they come?: Estimating unmet demand for after-school programs in america's distressed cities

Weitzman, B. C., Mijanovich, T., Silver, D., & Brazill, C. (n.d.).

Publication year

2008

Journal title

Youth and Society

Volume

40

Issue

1

Page(s)

3-34
Abstract
Abstract
Telephone-survey data were gathered from parents and youth in five of America's largest and most distressed cities to estimate unmet demand for after-school programs. Unmet demand was conceptualized as a function of low utilization and dissatisfaction with one's current arrangement; furthermore, the authors argue that dissatisfaction must stem from something that can be addressed through changes in policy or programs. Large numbers of parents of children who infrequently use after-school programs were found to indicate that they would increase utilization if there were improvements in the quality, access, or types of programming. However, large numbers of parents whose children do not participate or participate infrequently in after-school programs were also found to express satisfaction with their arrangement and indicated that they do not wish to change it. Expanding services with the assumption that children from these families will participate may be misguided.

Efforts to improve public policy and programs through data practice: Experiences in 15 distressed American cities

Weitzman, B. C., Silver, D., & Brazill, C. (n.d.).

Publication year

2006

Journal title

Public Administration Review

Volume

66

Issue

3

Page(s)

386-399
Abstract
Abstract
Philanthropies and government agencies interested in children's issues are encouraging localities to improve the process of collecting, linking, and sharing microdata and aggregated summary statistics. An implicit assumption of these efforts is that outcomes will improve as a result of the new approaches. However, there has been little systematic study of these efforts. In this article, we examine efforts to improve data practice in 15 distressed American cities. Interviews conducted in these cities revealed variation in the types of information collected, dissemination, and intended audiences. We identify significant challenges to these efforts, including adequate resources, turf battles, technical problems, access to information sources, inconsistent leadership, and absence of political will. We find that little is known about the impact of these initiatives on decision making. Assumptions that improved data practice will lead to improved policy making have not yet been realized in these cities.

Following the money: Using expenditure analysis as an evaluation tool

Brecher, C., Silver, D., Searcy, C., & Weitzman, B. C. (n.d.).

Publication year

2005

Journal title

American Journal of Evaluation

Volume

26

Issue

2

Page(s)

166-188
Abstract
Abstract
This article describes the nature and utility of fiscal analysis in evaluating complex community interventions. Using New York University's evaluation of the Robert Wood Johnson Foundation's Urban Health Initiative as an example, the authors describe issues arising in defining and operationalizing constructs for fiscal analysis. The approach's utility is demonstrated in the use of interim findings to help redefine the program's goals for resource allocation, to modify its theory of change to include greater emphasis on state-level action, and to emphasize the importance of local public schools as resource centers and intervention targets. The fiscal analysis also provides new insights into the limitations of "preventive" versus "corrective" spending categories and helps make goals for such functional reallocation more realistic. The authors discuss limitations of fiscal analysis due to available data quality, the extent of cooperation needed from public officials to collect relevant data, and the level of expertise needed to interpret the data.

Integrating a comparison group design into a theory of change evalutation

Weitzman, B., Silver, D., & Dillman, K. N. (n.d.). In E. Stern (Ed.), Evaluation research methods: The case of the urban health initiative (1–).

Publication year

2005

Integrating a comparison group design into a theory of change evaluation: The case of the urban health initiative

Weitzman, B. C., Silver, D., & Dillman, K. N. (n.d.).

Publication year

2002

Journal title

American Journal of Evaluation

Volume

23

Issue

4

Page(s)

371-385
Abstract
Abstract
This paper describes how we strengthened the theory of change approach to evaluating a complex social initiative by integrating it with a quasi-experimental, comparison group design. We also demonstrate the plausibility of selecting a credible comparison group through the use of cluster analysis, and describe our work in validating that analysis with additional measures. The integrated evaluation design relies on two points of comparison: (1) program theory to program experience; and (2) program cities to comparison cities. We describe how we are using this integrated design to evaluate the Robert Wood Johnson Foundation's Urban Health Initiative, an effort that aims to improve health and safety outcomes for children and youth in five distressed urban areas through a process of citywide, multi-sector planning and changed public and private systems. We also discuss how the use of two research frameworks and multiple methods can enrich our ability to test underlying assumptions and evaluate overall program effects. Using this integrated approach has provided evidence that the earliest phases of this initiative are unfolding as the theory would predict, and that the comparison cities are not undergoing a similar experience to those in UHI. Despite many remaining limitations, this integrated evaluation can provide greater confidence in assessing whether future changes in health and safety outcomes may have resulted from the Urban Health Initiative (UHI).

Contact

drs1@nyu.edu 708 Broadway New York, NY, 10003