Evaluating Fairness Metrics

Artificial Intelligence systems add significant value to decision-making. However, the systems must be fair because bias creeps into the system from sources like data and preprocessing algorithms. In this work, we explore fairness metrics discussing the shortfalls and benefits of each metric. The fairness metrics are demographic, statistical, and game theoretic. We find that the demographic fairness metrics are independent of the actual target value and hence have limited use. In contrast, the statistical fairness metrics can provide the thresholds to maximize fairness. The Minimax criterion was used to guide the search and help recommend the best model where the error among protected groups was minimum

Identifying Agile Practices to Reduce Defects in Medical Device Software Development

Medical Device Software (MDS) defects have caused death of patients and continue to be the major cause of recalls of medical devices in the US and Europe. Despite various approaches proposed to address defects, dealing with defects in MDS is an increasingly difficult task as MDS has become more complex to support a growing number of functions. To increase quality in any software development project, it is essential that defects are identified and addressed quickly in the early stages of the software development life cycle. Agile methods have been advocated to increase software quality by minimising defects through their agile practices. However, agile methods on their own are deficient in satisfying the regulatory requirements for the MDS domain. Instead, the common approach is to integrate agile practices into the plan driven methods. Consequently, frameworks have been developed to help developers in the MDS domain to accrue the benefits of agile development while fulfilling regulatory requirements. Despite the adoption of agile practices in MDS development, it is still unclear as to which agile practice(s) is effective and how it is applied to address MDS defects. The purpose of this research is to identify agile practices that can assist in addressing defects in MDS development. This will help MDS developers to select the appropriate agile practice(s) to address defects