Verification, Analytical Validation, and Clinical Validation (V3): The Foundation of Determining Fit-for-Purpose for Biometric Monitoring Technologies (BioMeTs)

Digital medicine is an interdisciplinary field, drawing together stakeholders with expertize in engineering, manufacturing, clinical science, data science, biostatistics, regulatory science, ethics, patient advocacy, and healthcare policy, to name a few. Although this diversity is undoubtedly valuable, it can lead to confusion regarding terminology and best practices. There are many instances, as we detail in this paper, where a single term is used by different groups to mean different things, as well as cases where multiple terms are used to describe essentially the same concept. Our intent is to clarify core terminology and best practices for the evaluation of Biometric Monitoring Technologies (BioMeTs), without unnecessarily introducing new terms. We focus on the evaluation of BioMeTs as fit-for-purpose for use in clinical trials. However, our intent is for this framework to be instructional to all users of digital measurement tools, regardless of setting or intended use. We propose and describe a three-component framework intended to provide a foundational evaluation framework for BioMeTs. This framework includes (1) verification, (2) analytical validation, and (3) clinical validation. We aim for this common vocabulary to enable more effective communication and collaboration, generate a common and meaningful evidence base for BioMeTs, and improve the accessibility of the digital medicine field

Transit Performance Measures in California

This research is the result of a California Department of Transportation (Caltrans) request to assess the most commonly available transit performance measures in California. Caltrans wanted to understand performance measures and data used by Metropolitan Planning Organizations (MPOs) and transit agencies to help it develop statewide measures. This report serves as a summary reference guide to help Caltrans understand the numerous and diverse performance measures used by MPOs and transit agencies in California. First, investigators review the available literature to identify a complete transit performance framework for the purposes of organizing agency measures, metrics, and data sources. Next, they review the latest transit performance measures documented in planning reports for the four largest MPOs in California (San Francisco Bay Area, Los Angeles, San Diego, and Sacramento). Researchers pay special attention to the transit performance measures used by these MPOs, because these measures are available for the majority of California’s population. Finally, investigators summarize 231 performance measures used by a total 26 local transit agencies in the State of California, based on transit planning documents available on the internet

Security, Privacy and Safety Risk Assessment for Virtual Reality Learning Environment Applications

Social Virtual Reality based Learning Environments (VRLEs) such as vSocial render instructional content in a three-dimensional immersive computer experience for training youth with learning impediments. There are limited prior works that explored attack vulnerability in VR technology, and hence there is a need for systematic frameworks to quantify risks corresponding to security, privacy, and safety (SPS) threats. The SPS threats can adversely impact the educational user experience and hinder delivery of VRLE content. In this paper, we propose a novel risk assessment framework that utilizes attack trees to calculate a risk score for varied VRLE threats with rate and duration of threats as inputs. We compare the impact of a well-constructed attack tree with an adhoc attack tree to study the trade-offs between overheads in managing attack trees, and the cost of risk mitigation when vulnerabilities are identified. We use a vSocial VRLE testbed in a case study to showcase the effectiveness of our framework and demonstrate how a suitable attack tree formalism can result in a more safer, privacy-preserving and secure VRLE system.Comment: Tp appear in the CCNC 2019 Conferenc

Monitoring Success in Choice Neighborhoods: A Proposed Approach to Performance Measurement

Offers a framework and tools for performance management in the initiative to transform poor neighborhoods into revitalized, sustainable mixed-income communities. Proposes system components, logic model, management reports, and performance indicators