Forecasting emergent risks in advanced AI systems: an analysis of a future road transport management system

S. McLean*, B. J. King, J. Thompson, T. Carden, N. A. Stanton, C. Baber, G. J.M. Read, P. M. Salmon

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

26 Downloads (Pure)

Abstract

Artificial Intelligence (AI) is being increasingly implemented within road transport systems worldwide. Next generation of AI, Artificial General Intelligence (AGI) is imminent, and is anticipated to be more powerful than current AI. AGI systems will have a broad range of abilities and be able to perform multiple cognitive tasks akin to humans that will likely produce many expected benefits, but also potential risks. This study applied the EAST Broken Links approach to forecast the functioning of an AGI system tasked with managing a road transport system and identify potential risks. In total, 363 risks were identified that could have adverse impacts on the stated goals of safety, efficiency, environmental sustainability, and economic performance of the road system. Further, risks beyond the stated goals were identified; removal from human control, mismanaging public relations, and self-preservation. A diverse set of systemic controls will be required when designing, implementing, and operating future advanced technologies. Practitioner summary: This study demonstrated the utility of HFE methods for formally considering risks associated with the design, implementation, and operation of future technologies. This study has implications for AGI research, design, and development to ensure safe and ethical AGI implementation.

Original languageEnglish
Pages (from-to)1750-1767
Number of pages18
JournalErgonomics
Volume66
Issue number11
DOIs
Publication statusPublished - 13 Dec 2023

Bibliographical note

Publisher Copyright:
© 2023 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.

Keywords

  • AI alignment
  • Artificial general intelligence
  • artificial intelligence
  • risk
  • road transport
  • safety

ASJC Scopus subject areas

  • Human Factors and Ergonomics
  • Physical Therapy, Sports Therapy and Rehabilitation

Fingerprint

Dive into the research topics of 'Forecasting emergent risks in advanced AI systems: an analysis of a future road transport management system'. Together they form a unique fingerprint.

Cite this