Tackling bias in AI health datasets through the STANDING Together initiative

Shaswath Ganapathi; Jo Palmer; Joseph E. Alderman; Melanie Calvert; Cyrus Espinoza; Jacqui Gath; Marzyeh Ghassemi; Katherine Heller; Francis Mckay; Alan Karthikesalingam; Stephanie Kuku; Maxine Mackintosh; Sinduja Manohar; Bilal A. Mateen; Rubeta Matin; Melissa McCradden; Lauren Oakden-Rayner; Johan Ordish; Russell Pearson; Stephen R. Pfohl; Negar Rostamzadeh; Elizabeth Sapey; Neil Sebire; Viknesh Sounderajah; Charlotte Summers; Darren Treanor; Alastair K. Denniston; Xiaoxuan Liu

doi:10.1038/s41591-022-01987-w

Tackling bias in AI health datasets through the STANDING Together initiative

Shaswath Ganapathi, Jo Palmer, Joseph E. Alderman, Melanie Calvert, Cyrus Espinoza, Jacqui Gath, Marzyeh Ghassemi, Katherine Heller, Francis Mckay, Alan Karthikesalingam, Stephanie Kuku, Maxine Mackintosh, Sinduja Manohar, Bilal A. Mateen, Rubeta Matin, Melissa McCradden, Lauren Oakden-Rayner, Johan Ordish, Russell Pearson, Stephen R. PfohlNegar Rostamzadeh, Elizabeth Sapey, Neil Sebire, Viknesh Sounderajah, Charlotte Summers, Darren Treanor, Alastair K. Denniston, Xiaoxuan Liu^*

^*Corresponding author for this work

Research output: Contribution to journal › Letter › peer-review

7 Citations (Scopus)

Original language	English
Pages (from-to)	2232-2233
Number of pages	2
Journal	Nature Medicine
Volume	28
Issue number	11
Early online date	26 Sept 2022
DOIs	https://doi.org/10.1038/s41591-022-01987-w
Publication status	Published - Nov 2022

Bibliographical note

Funding Information:
K.H., A.K., N.R. and S.R.P. are employees of Google. S.K. is a consultant for Hardian Health. D.T. and F.M. are funded by National Pathology Imaging Co-operative (NPIC, Pproject no. 104687), which is supported by a £50 million investment from the Data to Early Diagnosis and Precision Medicine strand of the government’s Industrial Strategy Challenge Fund, managed and delivered by UK Research and Innovation (UKRI). X.L., A.K.D., J.E.A. and J.P. are funded by NIHR, the NHS Transformation Directorate and the Health Foundation (AI_HI200014). M.J.C. is Director of the Birmingham Health Partners Centre for Regulatory Science and Innovation, Director of the Centre for the Centre for Patient Reported Outcomes Research and is a National Institute for Health and Care Research (NIHR) Senior Investigator. M.J.C. receives funding from the NIHR, UK Research and Innovation (UKRI), NIHR Birmingham Biomedical Research Centre, the NIHR Surgical Reconstruction and Microbiology Research Centre, NIHR ARC West Midlands, UK SPINE, European Regional Development Fund – Demand Hub and Health Data Research UK at the University of Birmingham and University Hospitals Birmingham NHS Foundation Trust, Innovate UK (part of UKRI), Macmillan Cancer Support, UCB Pharma, Janssen, GSK and Gilead, has received personal fees from Astellas, Aparito Ltd, CIS Oncology, Takeda, Merck, Daiichi Sankyo, Glaukos, GSK and the Patient-Centered Outcomes Research Institute (PCORI) outside the submitted work; a family member of M.J.C. owns shares in GSK. ES receives research funding from UKRI (MR/V033654/1 and MR/S002782/1), the British Lung Foundation, and Alpha 1 Foundation and NIHR. C.S. receives research funding from the National Institute for Health and Care Research (NIHR133788), UKRI (MR/P502091/1 and MR/X005070/1), the Wellcome Trust, and the NIHR Cambridge Biomedical Research Centre (BRC1215-20014). All other authors declare no conflicts.

This project is funded by The NHS AI Lab at the NHS Transformation Directorate and the Health Foundation and managed by the National Institute for Health and Care Research (AI_HI200014). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS Transformation Directorate, the Health Foundation or the National Institute for Health and Care Research.

ASJC Scopus subject areas

General Biochemistry,Genetics and Molecular Biology

Access to Document

10.1038/s41591-022-01987-w

STANDING together: STANdards for Data INclusivity and Generalisabilit
Calvert, M.
NIHR
1/12/21 → 30/11/23
Project: Other Government Departments

Cite this

Ganapathi, S., Palmer, J., Alderman, J. E., Calvert, M., Espinoza, C., Gath, J., Ghassemi, M., Heller, K., Mckay, F., Karthikesalingam, A., Kuku, S., Mackintosh, M., Manohar, S., Mateen, B. A., Matin, R., McCradden, M., Oakden-Rayner, L., Ordish, J., Pearson, R., ... Liu, X. (2022). Tackling bias in AI health datasets through the STANDING Together initiative. Nature Medicine, 28(11), 2232-2233. https://doi.org/10.1038/s41591-022-01987-w

@article{99310f78bbfd400e8bfd30afaee71b2a,

title = "Tackling bias in AI health datasets through the STANDING Together initiative",

author = "Shaswath Ganapathi and Jo Palmer and Alderman, {Joseph E.} and Melanie Calvert and Cyrus Espinoza and Jacqui Gath and Marzyeh Ghassemi and Katherine Heller and Francis Mckay and Alan Karthikesalingam and Stephanie Kuku and Maxine Mackintosh and Sinduja Manohar and Mateen, {Bilal A.} and Rubeta Matin and Melissa McCradden and Lauren Oakden-Rayner and Johan Ordish and Russell Pearson and Pfohl, {Stephen R.} and Negar Rostamzadeh and Elizabeth Sapey and Neil Sebire and Viknesh Sounderajah and Charlotte Summers and Darren Treanor and Denniston, {Alastair K.} and Xiaoxuan Liu",

note = "Funding Information: K.H., A.K., N.R. and S.R.P. are employees of Google. S.K. is a consultant for Hardian Health. D.T. and F.M. are funded by National Pathology Imaging Co-operative (NPIC, Pproject no. 104687), which is supported by a £50 million investment from the Data to Early Diagnosis and Precision Medicine strand of the government{\textquoteright}s Industrial Strategy Challenge Fund, managed and delivered by UK Research and Innovation (UKRI). X.L., A.K.D., J.E.A. and J.P. are funded by NIHR, the NHS Transformation Directorate and the Health Foundation (AI_HI200014). M.J.C. is Director of the Birmingham Health Partners Centre for Regulatory Science and Innovation, Director of the Centre for the Centre for Patient Reported Outcomes Research and is a National Institute for Health and Care Research (NIHR) Senior Investigator. M.J.C. receives funding from the NIHR, UK Research and Innovation (UKRI), NIHR Birmingham Biomedical Research Centre, the NIHR Surgical Reconstruction and Microbiology Research Centre, NIHR ARC West Midlands, UK SPINE, European Regional Development Fund – Demand Hub and Health Data Research UK at the University of Birmingham and University Hospitals Birmingham NHS Foundation Trust, Innovate UK (part of UKRI), Macmillan Cancer Support, UCB Pharma, Janssen, GSK and Gilead, has received personal fees from Astellas, Aparito Ltd, CIS Oncology, Takeda, Merck, Daiichi Sankyo, Glaukos, GSK and the Patient-Centered Outcomes Research Institute (PCORI) outside the submitted work; a family member of M.J.C. owns shares in GSK. ES receives research funding from UKRI (MR/V033654/1 and MR/S002782/1), the British Lung Foundation, and Alpha 1 Foundation and NIHR. C.S. receives research funding from the National Institute for Health and Care Research (NIHR133788), UKRI (MR/P502091/1 and MR/X005070/1), the Wellcome Trust, and the NIHR Cambridge Biomedical Research Centre (BRC1215-20014). All other authors declare no conflicts. This project is funded by The NHS AI Lab at the NHS Transformation Directorate and the Health Foundation and managed by the National Institute for Health and Care Research (AI_HI200014). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS Transformation Directorate, the Health Foundation or the National Institute for Health and Care Research. ",

year = "2022",

month = nov,

doi = "10.1038/s41591-022-01987-w",

language = "English",

volume = "28",

pages = "2232--2233",

journal = "Nature Medicine",

issn = "1078-8956",

publisher = "Nature Publishing Group",

number = "11",

}

Ganapathi, S, Palmer, J, Alderman, JE , Calvert, M, Espinoza, C, Gath, J, Ghassemi, M, Heller, K, Mckay, F, Karthikesalingam, A, Kuku, S, Mackintosh, M, Manohar, S, Mateen, BA, Matin, R, McCradden, M, Oakden-Rayner, L, Ordish, J, Pearson, R, Pfohl, SR, Rostamzadeh, N, Sapey, E, Sebire, N, Sounderajah, V, Summers, C, Treanor, D, Denniston, AK & Liu, X 2022, 'Tackling bias in AI health datasets through the STANDING Together initiative', Nature Medicine, vol. 28, no. 11, pp. 2232-2233. https://doi.org/10.1038/s41591-022-01987-w

TY - JOUR

T1 - Tackling bias in AI health datasets through the STANDING Together initiative

AU - Ganapathi, Shaswath

AU - Palmer, Jo

AU - Alderman, Joseph E.

AU - Calvert, Melanie

AU - Espinoza, Cyrus

AU - Gath, Jacqui

AU - Ghassemi, Marzyeh

AU - Heller, Katherine

AU - Mckay, Francis

AU - Karthikesalingam, Alan

AU - Kuku, Stephanie

AU - Mackintosh, Maxine

AU - Manohar, Sinduja

AU - Mateen, Bilal A.

AU - Matin, Rubeta

AU - McCradden, Melissa

AU - Oakden-Rayner, Lauren

AU - Ordish, Johan

AU - Pearson, Russell

AU - Pfohl, Stephen R.

AU - Rostamzadeh, Negar

AU - Sapey, Elizabeth

AU - Sebire, Neil

AU - Sounderajah, Viknesh

AU - Summers, Charlotte

AU - Treanor, Darren

AU - Denniston, Alastair K.

AU - Liu, Xiaoxuan

N1 - Funding Information: K.H., A.K., N.R. and S.R.P. are employees of Google. S.K. is a consultant for Hardian Health. D.T. and F.M. are funded by National Pathology Imaging Co-operative (NPIC, Pproject no. 104687), which is supported by a £50 million investment from the Data to Early Diagnosis and Precision Medicine strand of the government’s Industrial Strategy Challenge Fund, managed and delivered by UK Research and Innovation (UKRI). X.L., A.K.D., J.E.A. and J.P. are funded by NIHR, the NHS Transformation Directorate and the Health Foundation (AI_HI200014). M.J.C. is Director of the Birmingham Health Partners Centre for Regulatory Science and Innovation, Director of the Centre for the Centre for Patient Reported Outcomes Research and is a National Institute for Health and Care Research (NIHR) Senior Investigator. M.J.C. receives funding from the NIHR, UK Research and Innovation (UKRI), NIHR Birmingham Biomedical Research Centre, the NIHR Surgical Reconstruction and Microbiology Research Centre, NIHR ARC West Midlands, UK SPINE, European Regional Development Fund – Demand Hub and Health Data Research UK at the University of Birmingham and University Hospitals Birmingham NHS Foundation Trust, Innovate UK (part of UKRI), Macmillan Cancer Support, UCB Pharma, Janssen, GSK and Gilead, has received personal fees from Astellas, Aparito Ltd, CIS Oncology, Takeda, Merck, Daiichi Sankyo, Glaukos, GSK and the Patient-Centered Outcomes Research Institute (PCORI) outside the submitted work; a family member of M.J.C. owns shares in GSK. ES receives research funding from UKRI (MR/V033654/1 and MR/S002782/1), the British Lung Foundation, and Alpha 1 Foundation and NIHR. C.S. receives research funding from the National Institute for Health and Care Research (NIHR133788), UKRI (MR/P502091/1 and MR/X005070/1), the Wellcome Trust, and the NIHR Cambridge Biomedical Research Centre (BRC1215-20014). All other authors declare no conflicts. This project is funded by The NHS AI Lab at the NHS Transformation Directorate and the Health Foundation and managed by the National Institute for Health and Care Research (AI_HI200014). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS Transformation Directorate, the Health Foundation or the National Institute for Health and Care Research.

PY - 2022/11

Y1 - 2022/11

UR - http://www.scopus.com/inward/record.url?scp=85138757115&partnerID=8YFLogxK

U2 - 10.1038/s41591-022-01987-w

DO - 10.1038/s41591-022-01987-w

M3 - Letter

C2 - 36163296

AN - SCOPUS:85138757115

SN - 1078-8956

VL - 28

SP - 2232

EP - 2233

JO - Nature Medicine

JF - Nature Medicine

IS - 11

ER -

Tackling bias in AI health datasets through the STANDING Together initiative

Bibliographical note

ASJC Scopus subject areas

Access to Document

Projects

STANDING together: STANdards for Data INclusivity and Generalisabilit

Cite this