3 research outputs found
Surveying Safety-relevant AI Characteristics
[Otros] The current analysis in the AI safety literature usually combines a risk or safety issue (e.g., interruptibility) with a particular paradigm for an AI agent (e.g., reinforcement learning).
However, there is currently no survey of safety-relevant characteristics of AI systems that may reveal neglected areas of
research or suggest to developers what design choices they
could make to avoid or minimise certain safety concerns. In
this paper, we take a first step towards delivering such a survey, from two angles. The first features AI system characteristics that are already known to be relevant to safety concerns,
including internal system characteristics, characteristics relating to the effect of the external environment on the system, and characteristics relating to the effect of the system on
the target environment. The second presents a brief survey of
a broad range of AI system characteristics that could prove
relevant to safety research, including types of interaction,
computation, integration, anticipation, supervision, modification, motivation and achievement. This survey enables further
work in exploring system characteristics and design choices
that affect safety concernsFMP and JHO were supported by the EU (FEDER) and the Spanish MINECO under grant TIN 2015-69175-C4-1-R, by Generalitat Valenciana (GVA) under grant PROME-TEOII/2015/013 and by the U.S. Air Force Office of Scientific Research under award number FA9550-17-1-0287.
FMP was also supported by INCIBE (Ayudas para la excelencia de los equipos de investigacion avanzada en
ciberseguridad), the European Commission, JRCÂżs Centre for Advanced Studies, HUMAINT project (Expert Contract CT-EX2018D335821-101), and UPV PAID-06-18 Ref. SP20180210. JHO was supported by a Salvador de Madariaga grant (PRX17/00467) from the Spanish MECD
for a research stay at the Leverhulme Centre for the Future of Intelligence (CFI), Cambridge, and a BEST grant (BEST/2017/045) from GVA for another research stay also at the CFI. JHO and SOH were supported by the Future of Life Institute (FLI) grant RFP2-152. SOH was also supported by the Leverhulme Trust Research Centre Grant RC2015-067 awarded to the Leverhulme Centre for the Future of Intelligence, and a a grant from Templeton World Charity FoundationHernández-Orallo, J.; MartĂnez-Plumed, F.; Avin, S.; Heigeartaigh, SO. (2019). Surveying Safety-relevant AI Characteristics. CEUR Workshop Proceedings. 1-9. http://hdl.handle.net/10251/146561S1
Recommended from our members
Using AI ethically to tackle covid-19.
Taking a principled approach is crucial to the successful use of AI in pandemic management, say Stephen Cave and colleaguesThe authors would like to thank the Leverhulme Trust for support via the Leverhulme Centre for the Future of Intelligence (grant RC-2015-067), and Rune Nyrup would additionally like to acknowledge the support of the Wellcome Trust (grant 213660/Z/18/Z)
Recommended from our members
Submission of Evidence to The Cabinet Office Enquiry on The Biological Security Strategy
This is a joint submission from researchers at the Centre for the Study of Existential Riski and BioRISC - Biosecurity Research Initiative at St Catharine’sii , alongside collaborators from the University of Bath, the University of Bradford and the Biological Security Research Centre at London Metropolitan University.
We argue here that there are a number of cross-cutting lessons to be learned from extant approaches to biosecurity, but that UK biological security — and the role of the UK as a soft-power leader in biosecurity globally — would be greatly enriched by the following:
• Work to enhance the capacity and policy participation of civil society and academic actors in developing and implementing the UK’s biological security strategy on an ongoing basis
• Work to further enhance biosecurity and bioethics education across both practice and policy communities
• Further developing an approach that sees biological security as intrinsically connected to a number of other intersecting concerns, most notably, environmental degradation and climate change.
• Establishing a national coordinating institution to act as a focal point for the UK’s national biological security strategy