User's Guide to the ROI Forecasting Calculator: Estimating ROI for Medicaid Quality Improvement Programs

Explains the online tool for state Medicaid agencies, health plans, and stakeholders to assess the cost-savings potential of quality improvement measures. Outlines analytical issues and best practices for each component and how to interpret the results

Predicting with sparse data

It is well known that effective prediction of project cost related factors is an important aspect of software engineering. Unfortunately, despite extensive research over more than 30 years, this remains a significant problem for many practitioners. A major obstacle is the absence of reliable and systematic historic data, yet this is a sine qua non for almost all proposed methods: statistical, machine learning or calibration of existing models. In this paper we describe our sparse data method (SDM) based upon a pairwise comparison technique and Saaty's Analytic Hierarchy Process (AHP). Our minimum data requirement is a single known point. The technique is supported by a software tool known as DataSalvage. We show, for data from two companies, how our approach — based upon expert judgement — adds value to expert judgement by producing significantly more accurate and less biased results. A sensitivity analysis shows that our approach is robust to pairwise comparison errors. We then describe the results of a small usability trial with a practising project manager. From this empirical work we conclude that the technique is promising and may help overcome some of the present barriers to effective project prediction

Estimating Uncertainty of Bus Arrival Times and Passenger Occupancies

Travel time reliability and the availability of seating and boarding space are important indicators of bus service quality and strongly influence users’ satisfaction and attitudes towards bus transit systems. With Automated Vehicle Location (AVL) and Automated Passenger Counter (APC) units becoming common on buses, some agencies have begun to provide real-time bus location and passenger occupancy information as a means to improve perceived transit reliability. Travel time prediction models have also been established based on AVL and APC data. However, existing travel time prediction models fail to provide an indication of the uncertainty associated with these estimates. This can cause a false sense of precision, which can lead to experiences associated with unreliable service. Furthermore, no existing models are available to predict individual bus occupancies at downstream stops to help travelers understand if there will be space available to board. The purpose of this project was to develop modeling frameworks to predict travel times (and associated uncertainties) as well as individual bus passenger occupancies. For travel times, accelerated failure-time survival models were used to predict the entire distribution of travel times expected. The survival models were found to be just as accurate as models developed using traditional linear regression techniques. However, the survival models were found to have smaller variances associated with predictions. For passenger occupancies, linear and count regression models were compared. The linear regression models were found to outperform count regression models, perhaps due to the additive nature of the passenger boarding process. Various modeling frameworks were tested and the best frameworks were identified for predictions at near stops (within five stops downstream) and far stops (further than eight stops). Overall, these results can be integrated into existing real-time transit information systems to improve the quality of information provided to passengers