What's my role? Modelling responsibility for AI-based safety-critical systems

AI-Based Safety-Critical Systems (AI-SCS) are being increasingly developed and deployed in the real world. These can pose a risk of harm to people and the environment, hence reducing that risk is an overarching priority during development and operation. Many contain Machine Learning (ML) components whose performance is hard to predict. As more AI systems become autonomous, a layer of risk management via human intervention has been removed. Following an accident it will be important to identify causal contributions and the different responsible actors behind those to learn from mistakes and prevent similar future events. Many authors have commented on the "responsibility gap" where it is difficult for developers and manufacturers to be held responsible for behaviour of an AI-SCS which contributes to harm. This is due to the complex development cycle for AI, the uncertainty in black-box AI components performance, and dynamic operating environment. Instead, a human operator of the AI-SCS can become a "liability sink" absorbing blame for the consequences of AI-SCS outputs they weren't responsible for creating, and may not have sufficient understanding of. This cross-disciplinary paper considers different types of responsibility (role, moral, legal and causal), and how they apply in the context of AI-SCS safety. We use a core conceptual formulation \textit{Actor(A) is responsible for Occurrence(O)} to create detailed role responsibility models, including related tasks and resources. Our aim is to present a practical method to precisely capture responsibility relationships, and provide clarity on the previously identified responsibility issues. We propose an analysis method to review the models for safety impacts. Our paper demonstrates the utility of the approach with two practical examples. The first is a retrospective analysis of the Tempe Arizona fatal collision involving an autonomous vehicle. The second is a safety focused predictive role-responsibility analysis for an AI-based diabetes co-morbidity prediction system. We show how our notation and analysis can illuminate responsibility issues during the AI development process and identify the impact of uncertainty surrounding how tasks were performed. For both examples, our focus was primarily on safety, with an aim of reducing unfair or disproportionate blame being placed on operators or developers of AI-SCS. We present a discussion and avenues for future research, including the development of a richer causal contribution model

Unravelling Responsibility for AI

To reason about where responsibility does and should lie in complex situations involving AI-enabled systems, we first need a sufficiently clear and detailed cross-disciplinary vocabulary for talking about responsibility. Responsibility is a triadic relation involving an actor, an occurrence, and a way of being responsible. As part of a conscious effort towards 'unravelling' the concept of responsibility to support practical reasoning about responsibility for AI, this paper takes the three-part formulation, 'Actor A is responsible for Occurrence O' and identifies valid combinations of subcategories of A, is responsible for, and O. These valid combinations - which we term "responsibility strings" - are grouped into four senses of responsibility: role-responsibility; causal responsibility; legal liability-responsibility; and moral responsibility. They are illustrated with two running examples, one involving a healthcare AI-based system and another the fatal collision of an AV with a pedestrian in Tempe, Arizona in 2018. The output of the paper is 81 responsibility strings. The aim is that these strings provide the vocabulary for people across disciplines to be clear and specific about the different ways that different actors are responsible for different occurrences within a complex event for which responsibility is sought, allowing for precise and targeted interdisciplinary normative deliberations

Outcomes of Children With Low-Grade Gliomas in Low- and Middle-Income Countries: A Systematic Review

Purpose: Pediatric CNS tumors are increasingly a priority, particularly with the WHO designation of low-grade glioma (LGG) as one of six index childhood cancers. There are currently limited data on outcomes of pediatric patients with LGGs in low- and middle-income countries (LMICs). Methods: To better understand the outcomes of LGGs in LMICs, this systematic review interrogated nine literature databases. Results: The search identified 14,977 publications. Sixteen studies from 19 countries met the selection criteria and were included for data abstraction and analysis. Eleven studies (69%) were retrospective reviews from single institutions, and one (6%) captured institutional data prospectively. The studies captured a total of 957 patients with a median of 49 patients per study. Seven (44%) of the studies described the treatment modalities used. Of 373 patients for whom there was information, 173 (46%) had a gross total or near total resection, 109 (29%) had a subtotal resection, and 91 (24%) had only a biopsy performed. Seven studies, with a total of 476 patients, described the frequency of use of radiotherapy and/or chemotherapy in the cohorts: 83 of these patients received radiotherapy and 76 received chemotherapy. The 5-year overall survival ranged from 69.2% to 93.5%, although lower survival rates were reported at earlier time points. We identified limitations in the published studies with respect to the cohort sizes and methodologies. Conclusion: The included studies reported survival rates frequently exceeding 80%, although the ultimate number of studies was limited, pointing to the paucity of studies describing the outcomes of children with LGGs in LMICs. This study underscores the need for more robust data on outcomes in pediatric LGG

Risk stratification in pediatric low-grade glioma and glioneuronal tumor treated with radiation therapy: An integrated clinicopathologic and molecular analysis

BackgroundManagement of unresectable pediatric low-grade glioma and glioneuronal tumor (LGG/LGGNT) is controversial. There are no validated prognostic features to guide use of radiation therapy (RT). Our study aimed to identify negative prognostic features in patients treated with RT using clinicopathologic and molecular data and validate these findings in an external dataset.MethodsChildren with non-metastatic, biopsy-proven unresectable LGG/LGGNT treated with RT at a single institution between 1997 and 2017 were identified. Recursive partitioning analysis (RPA) was used to stratify patients into low- and high-risk prognostic groups based on overall survival (OS). CNS9702 data were used for validation.ResultsOne hundred and fifty patients met inclusion criteria. Median follow-up was 11.4 years. RPA yielded low- and high-risk groups with 10-year OS of 95.6% versus 76.4% (95% CI: 88.7%–98.4% vs 59.3%–87.1%, P = 0.003), respectively. These risk groups were validated using CNS9702 dataset (n = 48) (4-year OS: low-risk vs high-risk: 100% vs 64%, P < 0.001). High-risk tumors included diffuse astrocytoma or location within thalamus/midbrain. Low-risk tumors included pilocytic astrocytoma/ganglioglioma located outside of the thalamus/midbrain. In the subgroup with known BRAF status (n = 49), risk stratification remained prognostic independently of BRAF alteration (V600E or fusion). Within the high-risk group, delayed RT, defined as RT after at least one line of chemotherapy, was associated with a further decrement in overall survival (P = 0.021).ConclusionA high-risk subgroup of patients, defined by diffuse astrocytoma histology or midbrain/thalamus tumor location, have suboptimal long-term survival and might benefit from timely use of RT. These results require validation

HF-VHF帯における生体等価ファントムを用いた電磁波と人体相互作用の検証

研究科: 千葉大学大学院工学研究科学位:千大院工博甲第工185号博士(工学)千葉大

Evaluation of the Pediatric Neuro-Oncology Resources Available in Chile

Purpose: Pediatric neuro-oncology resources are mostly unknown in Chile. We report the human and material resources available in Chilean hospitals providing pediatric neuro-oncology services. Methods: A cross-sectional survey was distributed to 17 hospitals providing pediatric neuro-oncology services (Programa Infantil Nacional de Drogas Antineoplásicas [PINDA] hospitals, 11; private, 6). Results: Response rate was 71% (PINDA, 8; private, 4). Pediatric neuro-oncology services were mainly provided within general hospitals (67%). Registries for pediatric CNS tumors and chemotherapy-related toxicities were available in 100% and 67% of hospitals, respectively. CNS tumors were treated by pediatric oncologists in 92% of hospitals; none were formally trained in neuro-oncology. The most used treatment protocols were the national PINDA protocols. All WHO essential medicines for childhood cancer were available in more than 80% of the hospitals except for gemcitabine, oxaliplatin, paclitaxel, and procarbazine. The median number of pediatric neurosurgeons per hospital was two (range, 2-6). General neuroradiologists were available in 83% of the centers. Pathology specimens were sent to neuropathologists (58%), adult pathologists (25%), and pediatric pathologists (17%). Intensity-modulated radiotherapy, conformal radiotherapy, and cobalt radiotherapy were used by 67%, 58%, and 42% of hospitals, respectively. Only one private hospital performed autologous hematopoietic cell transplant for children with CNS tumors. Conclusion: A wide range of up-to-date treatment modalities are available for children with CNS tumors. Our survey highlights future directions to improve the pediatric neuro-oncology services available in Chile such as the expansion of multidisciplinary clinics, palliative care services, long-term cancer survivorship programs, dedicated clinical research support teams, establishing standardized mechanism for sending pathologic specimen for second opinion to international specialized centers, and establishing specialized neuro-oncology training program

Therapeutic and Prognostic Implications of BRAF V600E in Pediatric Low-Grade Gliomas

Purpose BRAF V600E is a potentially highly targetable mutation detected in a subset of pediatric low-grade gliomas (PLGGs). Its biologic and clinical effect within this diverse group of tumors remains unknown. Patients and Methods A combined clinical and genetic institutional study of patients with PLGGs with long-term follow-up was performed (N = 510). Clinical and treatment data of patients with BRAF V600E mutated PLGG (n = 99) were compared with a large international independent cohort of patients with BRAF V600E mutated-PLGG (n = 180). Results BRAF V600E mutation was detected in 69 of 405 patients (17%) with PLGG across a broad spectrum of histologies and sites, including midline locations, which are not often routinely biopsied in clinical practice. Patients with BRAF V600E PLGG exhibited poor outcomes after chemotherapy and radiation therapies that resulted in a 10-year progression-free survival of 27% (95% CI, 12.1% to 41.9%) and 60.2% (95% CI, 53.3% to 67.1%) for BRAF V600E and wild-type PLGG, respectively (P < .001). Additional multivariable clinical and molecular stratification revealed that the extent of resection and CDKN2A deletion contributed independently to poor outcome in BRAF V600E PLGG. A similar independent role for CDKN2A and resection on outcome were observed in the independent cohort. Quantitative imaging analysis revealed progressive disease and a lack of response to conventional chemotherapy in most patients with BRAF V600E PLGG. Conclusion BRAF V600E PLGG constitutes a distinct entity with poor prognosis when treated with current adjuvant therapy. (C) 2017 by American Society of Clinical Oncolog

Therapeutic and Prognostic Implications of BRAF V600E in Pediatric Low-Grade Gliomas.

Purpose BRAF V600E is a potentially highly targetable mutation detected in a subset of pediatric low-grade gliomas (PLGGs). Its biologic and clinical effect within this diverse group of tumors remains unknown. Patients and Methods A combined clinical and genetic institutional study of patients with PLGGs with long-term follow-up was performed (N = 510). Clinical and treatment data of patients with BRAF V600E mutated PLGG (n = 99) were compared with a large international independent cohort of patients with BRAF V600E mutated-PLGG (n = 180). Results BRAF V600E mutation was detected in 69 of 405 patients (17%) with PLGG across a broad spectrum of histologies and sites, including midline locations, which are not often routinely biopsied in clinical practice. Patients with BRAF V600E PLGG exhibited poor outcomes after chemotherapy and radiation therapies that resulted in a 10-year progression-free survival of 27% (95% CI, 12.1% to 41.9%) and 60.2% (95% CI, 53.3% to 67.1%) for BRAF V600E and wild-type PLGG, respectively ( P \u3c .001). Additional multivariable clinical and molecular stratification revealed that the extent of resection and CDKN2A deletion contributed independently to poor outcome in BRAF V600E PLGG. A similar independent role for CDKN2A and resection on outcome were observed in the independent cohort. Quantitative imaging analysis revealed progressive disease and a lack of response to conventional chemotherapy in most patients with BRAF V600E PLGG. Conclusion BRAF V600E PLGG constitutes a distinct entity with poor prognosis when treated with current adjuvant therapy