Supplementary Material regarding included and excluded data, and the rationale

ali nouri

English

ZENODO

The SafetyOps Dilemma: a Systematic MappingStudy on Rapidity in Safe AD Development -Supplementary MaterialsAli NouriVolvo CarsGothenburg, Swedenali.nouri@volvocars.comBeatriz Cabrero-DanielUniversity of Gothenburg, SwedenDepartment of Computer Scienceand Engineeringbeatriz.cabrero-daniel@gu.seFredrik TörnerVolvo CarsGothenburg, Swedenfredrik.torner@volvocars.comChristian BergerUniversity of Gothenburg, SwedenDepartment of Computer Scienceand Engineeringchristian.berger@gu.seI. EXTRACTED DATATable I presents the extracted information about the selected studies in a concise and organized manner, making it easyfor readers to review and compare the studies. It includes essential information such as the year of publication, the industryaddressed, whether the study is peer-reviewed, or the source of the study. Table I provides a useful reference for researchersto gain a better understanding of the field.II. EXCLUDED STUDIESOn the other hand, Table II lists some of the excluded studies, identifying the reason for exclusion (rationale). Other studies,as discussed in the study, are excluded for their quality, rigour, or usage of non-empirical methods.Funded by Sweden’s Innovation Agency, Diarienummer: 2021-02585TABLE IEXTRACTED INFORMATION ABOUT THE INCLUDED STUDIESYear Title First author Industry Peer reviewed Source2018 Data Centric Communication and Con-tainerization for Future Automotive Soft-ware ArchitecturesS. Kugele Automotive Yes IEEE Xplore2018 Safely Entering the Deep A Review of Ver-ification and Validation for Machine Learn-ing and a Challenge Elicitation in the auto-motive industryM. Borg Automotive Yes Journal of Auto-motive SoftwareEngineering2018 It takes three to tango: Requirement, out-come/data, and AI driven developmentJ. Bosch embeddedsystems(automotive)Yes Google Scholar2018 Requirements engineering in the age ofsocietal-scale cyber-physical systems: Thecase of automated drivingK. Czarnecki Automotive Yes IEEE Xplore2019 Software engineering for automated vehi-cles addressing the needs of cars that runon software and dataK. Czarnecki Automotive Yes IEEE Xplore2019 The Automotive Take on Continuous Exper-imentation A Multiple Case StudyF. Giaimo Automotive Yes IEEE Xplore2019 Continuous Deployment for DependableSystems with Continuous Assurance CasesF. Warg SystemsengineeringYes IEEE Xplore2019 A model driven engineering framework tosupport the functional safety processB. Meyers Functional safetyengineering (au-tomotive)Yes IEEE Xplore2020 SafetyOps U. Siddique Safety engineer-ing (automotive)No Google Scholar2020 SafeOps a concept of continuous safety C. Fayollas Safety engineer-ing (automotive)Yes IEEE Xplore2021 Developing SEooC - Original Concepts andImplications when Extending to ADSR. Johansson Safety engineer-ing (automotive)Yes Google Scholar2021 Towards Establishing Continuous-XPipeline Using Modular Software-in-the-Loop Test EnvironmentsI. Raghupatruni Automotive Yes SAE TechnicalPaper series2022 Architecture as a Backbone for Safe De-vOps in Automotive SystemsS. Kugele Automotive Yes IEEE Xplore2022 An Industrial Experience Report aboutChallenges from Continuous MonitoringImprovement and Deployment for Au-tonomous Driving FeaturesA. Nouri Automotive Yes IEEE Xplore2022 Continuous Learning Approach to SafetyEngineeringR. Johansson Safety engineer-ing (automotive)Yes Google Scholar2022 STPA Driven Multilevel Runtime Monitor-ing for In Time Hazard DetectionA. Jayakumar Safety engineer-ingYes Springer2022 Automating Safety Argument Change Im-pact Analysis for Machine Learning Com-ponentsC. Cārlan Safety engineer-ingYes IEEE Xplore2022 DevOps and Safety? SafeOps! Towards En-suring Safety in Feature-Driven Develop-ment with Frequent ReleasesP. Munk Safety engineer-ingYes Springer2022 Towards Continuous Safety Assurance forAutonomous SystemsP. Schleiss Safety assurance Yes IEEE XploreTABLE IILIST OF EXCLUDED STUDIES IDENTIFYING THE REASON FOR EXCLUSIONYear Title First author Rationale2020 Towards a Taxonomy for Eliciting Design OperationContinuum Requirements of Cyber Physical SystemsJ. Ayerdi CPS requirement engineering with a railway industrycase study, not specific to safety.2021 Towards a continuous certification of safety criticalavionics softwareC. Baron Avionics method, no mention of automotive/safetyapplicability.2020 DevOps in an ISO Regulated Environment A Multi-vocal Literature ReviewM. Lie DevOps for medical devices, not automotive/safety-related.2020 A Continuous Certification Methodology for DevOps F. and Gau-denziGeneric paper, no claims about automotive/safetyapplicability.2020 Fast track lifecycle using SafeScrum and The AgileSafety CaseT. Myklebust Not peer-reviewed, quality low.2020 Integration of Security Standards in DevOpsPipelines: An Industry Case StudyF. Moyón It is not related to safety and automotive.2021 Developing and Operating Artificial IntelligenceModels in Trustworthy Autonomous SystemsM. Martı́nez-FernándezTrustworthiness of autonomous systems in DevOps,not safety-related.2020 Continuous Experimentation for Automotive Soft-ware on the Example of a Heavy Commercial Ve-hicle in Daily OperationF. Giaimo Heavy vehicle experimentation, challenging forsafety-critical applications in vehicles.2022 ACIA A Methodology for identification of Archi-tectural Design Patterns that support ContinuousIntegration based on Continuous AssessmentF. Helwani Is not related to safety.2023 Seven Lessons Learned From Automotive SoftwareSupplier CollaborationsV. Antinyan Not safety-relevant.2021 Proposing a Framework for Impact Analysis for LowCode Development PlatformsM. Overeem Not related to automotive safety.2015 Service Dependability with Continuously RevisedAssurance Cases by Multiple Stakeholders A CaseStudyK.KuramitsuAbout education services, not automotive safety-critical applications.2021 DDI A novel technology and innovation model fordependable collaborative and autonomous systemsE.ArmengaudNot related to DevOps.2019 Industrial Perspective on Reuse of Safety Artifactsin Software Product LinesR. Wolschke Focuses on reusing components and artifacts in newprojects, not continuously changing components.Only a small part discusses integrating safety, whichrequires further research.2021 Requirement Engineering Challenges for AI intenseSystems DevelopmentH. Heyn Is not related to safety applications.2022 Improving Documentation Agility in Safety CriticalSoftware Systems Development For AerospaceJ. SilvaCardosoRodriguesIs about aerospace with the need for further inves-tigation on the applicability of the solution in theautomotive industry and validation through industrycase studies.2020 A case study of agile software development forsafety Critical systems projectsM. Borg It is not related to the automotive industry.2016 Agile safety case for vehicle trial operations T.MyklebustaIt provides an oversimplified safety case for low-speed AD in Agile and does not consider high-speedAD and customer vehicles in the context of ISO orISO. However, it may be useful as a general safetyargument description.2020 A Preliminary View on Automotive Cyber SecurityManagement SystemsC.SchmittnerIs not relevant to safety or DevOps.2020 Scenarios in the Loop Integrated Requirements Anal-ysis and Automotive System ValidationR. Wiecher Discusses devOps and safety separately without pro-viding any solutions or challenges for DevOps safety.2022 Towards an AI driven business development frame-work A multi case studyH. John Discusses AI in general with some content onMLOps and safety, but not specifically DevOpssafety.2021 Machine Learning Development Audit FrameworkAssessment and Inspection of Risk and Quality ofData Model and Development ProcessJ. Stodt Not related to safety or DevOps.2022 Intelligence Driven Software Performance Assurance M.MoghadamIs a PhD thesis about machine learning and notrelevant to DevOps.2016 Organic Evolution of Development Organizations AnExperience ReportJ. Shahrokni It is not related to the safety of DevOps.2019 On the Nature of Automotive Service Architectures V. Cebotari It is not related to the safety of DevOps.2017 Deliverable Internet of Things Risk Analysis andAssessmentG. König It is not related to the safety of DevOps.2021 Exploring the Assessment List for Trustworthy AI inthe Context of Advanced Driver Assistance SystemsM. Borg It is not related to the safety of DevOps.2021 ADS Safety Assurance Future Directions M. Gyllen-hammarIt is not related to the safety of DevOps.2022 Taxonomy of Machine Learning Safety A Survey andPrimerZ. Mohseni It is not related to the safety of DevOps.2019 Software Verification and Validation Technologiesand ToolsM.RodriguezIt is not related to the safety of DevOps.2023 An investigation of challenges encountered whenspecifying training data and runtime monitors forsafety critical ML applicationsH. M. Heyn Focuses on the safety of machine learning, not De-vOps safety.

The SafetyOps Dilemma: a Systematic Mapping Study on Rapidity in Safe AD Development - Supplementary Materials

https://zenodo.org/record/8368558/files/The%20SafetyOps%20Dilemma_a%20Systematic%20Mapping%20Study%20on%20Rapidity%20in%20Safe%20AD%20Development%20-Supplementary%20Materials.pdf

The SafetyOps Dilemma: a Systematic Mapping Study on Rapidity in Safe AD Development - Supplementary Materials

Abstract

Similar works

Full text

Available Versions

ZENODO