104 research outputs found

    Designing Reliable Impact Evaluations

    Get PDF

    Program Applicants as a Comparison Group in Evaluating Training Programs: Theory and a Test

    Get PDF
    The authors begin with a thorough assessment of the many nonexperimental employment and training program evaluation techniques based on non-random comparison groups. These techniques typically use econometric methods to estimate the effects of employment and training programs by using comparison groups from non-program external sources. Then, recognizing the inherent drawbacks in these methods, Bell, Orr, Blomquist and Cain respond by reintroducing an evaluation method first implemented in the 1960s, the use of internal comparison groups consisting of nonparticipating program applicants. These groups include withdrawals, screen-outs and no-shows of the programs being evaluated in order to solve the selection bias problem. By applying to the program, say the authors, nonparticipating applicants reveal themselves to have some of the same difficult-to-measure, personal characteristics that inspire participants to seek help in response to their current economic situation. The methodology of this technique is updated, then tested against the random experimental findings derived from a controlled job training experiment, the AFDC Homemaker-Home Health Aide Demonstrations. Encouraging results are presented along with useful suggestions for designers and implementers of all types of program evaluations.https://research.upjohn.org/up_press/1080/thumbnail.jp

    Methods Used to Evaluate Employment and Training Programs in the Past

    Get PDF
    The authors begin with a thorough assessment of the many nonexperimental employment and training program evaluation techniques based on non-random comparison groups. These techniques typically use econometric methods to estimate the effects of employment and training programs by using comparison groups from non-program external sources. Then, recognizing the inherent drawbacks in these methods, Bell, Orr, Blomquist and Cain respond by reintroducing an evaluation method first implemented in the 1960s, the use of internal comparison groups consisting of nonparticipating program applicants. These groups include withdrawals, screen-outs and no-shows of the programs being evaluated in order to solve the selection bias problem. By applying to the program, say the authors, nonparticipating applicants reveal themselves to have some of the same difficult-to-measure, personal characteristics that inspire participants to seek help in response to their current economic situation. The methodology of this technique is updated, then tested against the random experimental findings derived from a controlled job training experiment, the AFDC Homemaker-Home Health Aide Demonstrations. Encouraging results are presented along with useful suggestions for designers and implementers of all types of program evaluations.https://research.upjohn.org/up_press/1080/thumbnail.jp

    Effects of Environmental Agents on the Attainment of Puberty: Considerations When Assessing Exposure to Environmental Chemicals in the National Childrenā€™s Study

    Get PDF
    The apparent decline in the age at puberty in the United States raises a general level of concern because of the potential clinical and social consequences of such an event. Nutritional status, genetic predisposition (race/ethnicity), and environmental chemicals are associated with altered age at puberty. The Exposure to Chemical Agents Working Group of the National Childrenā€™s Study (NCS) presents an approach to assess exposure for chemicals that may affect the age of maturity in children. The process involves conducting the assessment by life stages (i.e., in utero, postnatal, peripubertal), adopting a general categorization of the environmental chemicals by biologic persistence, and collecting and storing biologic specimens that are most likely to yield meaningful information. The analysis of environmental samples and use of questionnaire data are essential in the assessment of chemicals that cannot be measured in biologic specimens, and they can assist in the evaluation of exposure to nonpersistent chemicals. Food and dietary data may be used to determine the extent to which nutrients and chemicals from this pathway contribute to the variance in the timing of puberty. Additional research is necessary in several of these areas and is ongoing. The NCS is uniquely poised to evaluate the effects of environmental chemicals on the age at puberty, and the above approach will allow the NCS to accomplish this task

    URL Universal Resource Locator WWW World Wide Web

    No full text
    Abstract The World Wide Web has become an important resource for public awareness and for educating the worldā€™s population, including its political leaders, students, researchers, teachers, and ordinary citizens seeking information. Relevant information on photosynthesis-related web sites is grouped into several categories: (1) group sites, (2) sites by subject, (3) individual researcherā€™s sites, (4) sites for educators and students, and (5) other useful sites

    Are Classical Experiments Needed for Manpower Policy

    No full text
    The critical element that distinguishes classical experiments from all other modes of analysis is the random assignment of treatment to enrollees in a study. This paper examines the major methodological advantages of random assignment for the purpose of estimating the effectiveness of current manpower policy. It also reviews the claimed methodological and ethical objections to experiments. The main valid objection to an experiment is neither methodological nor ethical, it is the experiment's cost in relation to that of nonexperimental methods of analysis. The authors argue that the offsetting gain from experimentation is the inherent reliability of experimental estimates of treatment effects. The paper offers a simple framework for deciding whether the improved reliability of treatment-effect estimates is worth the added cost of experimentation. It concludes with an assessment of the actual value of experiments for evaluating current manpower policies.

    FOR133-72 ON POVER1YD,scWK~J~~ WELFARE POLICY AND THE EMPLOYMENT RATE OF AFDC MOTHERS

    No full text
    The authors are respectively visiting staff economist in the Polic

    Is Subsidized Employment Cost Effective for Welfare Recipients? Experimental Evidence from Seven State Demonstrations

    No full text
    This paper examines the benefits and costs of training and subsidized employment provided to welfare recipients in demonstration programs in seven states. A classical experimental design is used to estimate the effect of these demonstrations on earnings and welfare benefits over 33 months following program entry. Both effects are substantial and, in some cases, long-lived. When combined with data on program costs, these findings indicate that, while not always cost effective for taxpayers, subsidized employment for welfare recipients does convey positive net benefits to participants and to society as a whole.
    • ā€¦
    corecore