Outcomes and Cost-Effectiveness of Two Nicotine Replacement Treatment Delivery Models for a Tobacco Quitline

Many tobacco cessation quitlines provide nicotine replacement therapy (NRT) in the U.S. but consensus is lacking regarding the best shipping protocol or NRT amounts. We evaluated the impact of the Minnesota QUITPLAN® Helpline’s shift from distributing NRT using a single eight-week shipment to a two-shipment protocol. For this observational study, the eight week single-shipment cohort (n = 247) received eight weeks of NRT (patches or gum) at once, while the split-shipment cohort (n = 160) received five weeks of NRT (n = 94), followed by an additional three weeks of NRT if callers continued with counseling (n = 66). Patient satisfaction, retention, quit rates, and cost associated with the three groups were compared. A higher proportion of those receiving eight weeks of NRT, whether in one or two shipments, reported that the helpline was “very helpful” (77.2% of the single-shipment group; 81.1% of the two-shipment group) than those receiving five weeks of NRT (57.8% of the one-shipment group) (p = 0.004). Callers in the eight week two-shipment group completed significantly more calls (3.0) than callers in the five week one-shipment group (2.4) or eight week single-shipment group (1.7) (p < 0.001). Using both responder and intent-to-treat calculations, there were no significant differences in 30-day point prevalence abstinence at seven months among the three protocol groups even when controlling for demographic and tobacco use characteristics, and treatment group protocol. The mean cost per caller was greater for the single-shipment phase than the split-shipment phase ($350 vs.$326) due to the savings associated with not sending a second shipment to some participants. Assuming no difference in abstinence rates resulting from the protocol change, cost-per-quit was lowest for the five week one-shipment group ($1,155), and lower for the combined split-shipment cohort ($1,242) than for the single-shipment cohort ($1,350). Results of this evaluation indicate that while satisfaction rates increase among those receiving more counseling and NRT, quit rates do not, even when controlling for demographic and tobacco use characteristics

The relation between media promotions and service volume for a statewide tobacco quitline and a web-based cessation program

<p>Abstract</p> <p>Background</p> <p>This observational study assessed the relation between mass media campaigns and service volume for a statewide tobacco cessation quitline and stand-alone web-based cessation program.</p> <p>Methods</p> <p>Multivariate regression analysis was used to identify how weekly calls to a cessation quitline and weekly registrations to a web-based cessation program are related to levels of broadcast media, media campaigns, and media types, controlling for the impact of external and earned media events.</p> <p>Results</p> <p>There was a positive relation between weekly broadcast targeted rating points and the number of weekly calls to a cessation quitline and the number of weekly registrations to a web-based cessation program. Additionally, print secondhand smoke ads and online cessation ads were positively related to weekly quitline calls. Television and radio cessation ads and radio smoke-free law ads were positively related to web program registration levels. There was a positive relation between the number of web registrations and the number of calls to the cessation quitline, with increases in registrations to the web in 1 week corresponding to increases in calls to the quitline in the subsequent week. Web program registration levels were more highly influenced by earned media and other external events than were quitline call volumes.</p> <p>Conclusion</p> <p>Overall, broadcast advertising had a greater impact on registrations for the web program than calls to the quitline. Furthermore, registrations for the web program influenced calls to the quitline. These two findings suggest the evolving roles of web-based cessation programs and Internet-use practices should be considered when creating cessation programs and media campaigns to promote them. Additionally, because different types of media and campaigns were positively associated with calls to the quitline and web registrations, developing mass media campaigns that offer a variety of messages and communicate through different types of media to motivate tobacco users to seek services appears important to reach tobacco users. Further research is needed to better understand the complexities and opportunities involved in simultaneous promotion of quitline and web-based cessation services.</p

Using citation analysis methods to assess the influence of STEM education evaluation

University of Minnesota Ph.D. dissertation. May 2008. Major: Educational Psychology. Advisor: Frances Lawrenz. 1 computer file (PDF); x, 206 pages.This study explores the validity of using citation analysis methods as a way of assessing the influence of program evaluations conducted within the areas of science, technology, engineering, and mathematics (STEM). Interest in the broad influence of evaluations has caught the attention of evaluation theorists, practitioners, and funders recently. However, methods for measuring the influence of evaluations have yet to be developed and validated. Citation analysis is widely used within scientific research communities to measure the relative influence of scientific research and/or specific scientists. This study explores the applicability of citation analysis for understanding the broad impact of STEM education program evaluations. Nine assumptions regarding the validity of using citation analysis methods to assess STEM education evaluation product influence are examined using data from four sources: (1) citation analysis data, (2) the opinions of an expert panel, (3) data from a survey of primary investigators and evaluators from local projects connected with four national program evaluations, and (4) a review of relevant literatures. The data collected for the validation study suggest that citation analysis methods provide data to help understand, to a limited extent, the influence of large-scale program evaluations on the fields of STEM education and evaluation. In particular, citation data can be used to understand and compare patterns of influence of multi-site STEM program evaluations. Citations, however, are only one among many possible measures of one limited type of influence arising from the dissemination of evaluation products. Additionally, citation data do not appear to be useful for precisely quantifying the actual level of influence of any one evaluation. Moreover, the examination of the content of citations is critical. Without understanding the content of the citations, judgments cannot be made about whether citations are actually measuring influence. Consequently, it is important to stress that citations are only one measure of one possible influence arising from an evaluation and are limited and should be interpreted as such