A System Dynamics Evaluation Model: Implementation of Health Information Exchange for Public Health Reporting

The objective of this study is to evaluate complex dynamics involved in implementing electronic health information exchange for public health reporting at a state health department, and to identify policy implications to inform similar implementations. Qualitative data were collected over eight months from seven experts at NYS DOH who implemented web services and protocols for querying, receipt, and validation of electronic data supplied by regional health information organizations. Extensive project documentation also was collected. During group meetings experts described the implementation process and created reference modes and causal diagrams that the evaluation team used to build a preliminary model. System dynamics modeling techniques were applied iteratively to build causal loop diagrams representing the implementation. Validation of the diagrams was done iteratively by individual experts followed by group review online, and through confirmatory review of documents a! nd artifacts. Three casual loop diagrams captured well-recognized system dynamics: Sliding Goals, Project Rework, and Maturity of Resources. The findings were associated with specific policies that address funding, leadership, ensuring expertise, planning for rework, communication, and timeline management. This evaluation illustrates the value of a qualitative approach to system dynamics modeling. As a tool for strategic thought about complicated and intense processes, qualitative models can be produced with fewer resources than a full simulation, yet still provide insights that are timely and relevant. System dynamics techniques clarified endogenous and exogenous factors at play in a highly complex technology implementation, which may inform other states engaged in implementing HIE supported by federal HITECH legislatio

Learning in an Introductory Physics MOOC: All Cohorts Learn Equally, Including an On-Campus Class

We studied student learning in the MOOC 8.MReV Mechanics ReView, run on the edX.org open source platform. We studied learning in two ways. We administered 13 conceptual questions both before and after instruction, analyzing the results using standard techniques for pre- and posttesting. We also analyzed each week’s homework and test questions in the MOOC, including the pre- and posttests, using item response theory (IRT). This determined both an average ability and a relative improvement in ability over the course. The pre- and posttesting showed substantial learning: The students had a normalized gain slightly higher than typical values for a traditional course, but significantly lower than typical values for courses using interactive engagement pedagogy. Importantly, both the normalized gain and the IRT analysis of pre- and posttests showed that learning was the same for different cohorts selected on various criteria: level of education, preparation in math and physics, and overall ability in the course. We found a small positive correlation between relative improvement and prior educational attainment. We also compared homework performance of MIT freshmen taking a reformed on-campus course with the 8.MReV students, finding them to be considerably less skillful than the 8.MReV students.Google (Firm) (Faculty Award)Massachusetts Institute of TechnologyNational Science Foundation (U.S.

Learning in an Introductory Physics MOOC: All Cohorts Learn Equally, Including an On-Campus Class

We studied student learning in the MOOC 8.MReV Mechanics ReView, run on the edX.org open source platform. We studied learning in two ways. We administered 13 conceptual questions both before and after instruction, analyzing the results using standard techniques for pre- and posttesting. We also analyzed each week’s homework and test questions in the MOOC, including the pre- and posttests, using item response theory (IRT). This determined both an average ability and a relative improvement in ability over the course. The pre- and posttesting showed substantial learning: The students had a normalized gain slightly higher than typical values for a traditional course, but significantly lower than typical values for courses using interactive engagement pedagogy. Importantly, both the normalized gain and the IRT analysis of pre- and posttests showed that learning was the same for different cohorts selected on various criteria: level of education, preparation in math and physics, and overall ability in the course. We found a small positive correlation between relative improvement and prior educational attainment. We also compared homework performance of MIT freshmen taking a reformed on-campus course with the 8.MReV students, finding them to be considerably less skillful than the 8.MReV students

Establishing seafloor mapping priorities for coastal states

The Florida Coastal Mapping Program (FCMaP) is a consortium of State, Federal and academic partners that is undertaking the coordination of the collection and dissemination of consistent, high-resolution seafloor data for Florida's coastal zone. The coastal zone in the context of FCMaP refers to the area extending from the shoreline to the 200-m isobath. The high-resolution data is critical for a myriad of ocean and coastal resource management applications.An existing data gap analysis revealed that less than 20% of Florida's coastal waters have been mapped using modern bathymetric methods (multibeam sonar or airborne lidar), and in some areas, less than 5% of the seafloor has modern data; where data do exist, they often date to the 1800s. Addressing the need for a more comprehensive modern map of the seafloor will take an enormous amount of effort and funding, coordination and prioritization will be critical to success.FCMaP also undertook a formal statewide seafloor mapping prioritization to solicit input from a variety of stakeholders. The results provide the first statewide perspective of user and stakeholder mapping prioritization needs for the State of Florida. The prioritization dataset identifies specific locations that would benefit the most users or stakeholders, which can help to refine targeted mapping strategies. We found that new, consistent data would greatly support and improve multiple management activities. The approach used for this effort demonstrates an effective and replicable approach to addressing the need for seafloor mapping.•Statewide coastal seafloor mapping prioritization was accomplished for Florida.•80% of Florida's coastal seafloor has not been mapped with modern, high resolution technologies.•A novel online participatory GIS tool was developed to accomplished the prioritization process.•In addition to elevation information (bathymetry) the most desired data need is bottom type (hardness/smoothness).•A geospatial cluster analysis pinpoints specific areas where the highest numbers of respondents would benefit from data collection