Using combined environmental-clinical classification models to predict role functioning outcome in clinical high-risk states for psychosis and recent-onset depression

Linda A. Antonucci; Nora Penzel; Rachele Sanfelici; Alessandro Pigoni; Lana Kambeitz-Ilankovic; Dominic Dwyer; Anne Ruef; Mark Sen Dong; Ömer Faruk Öztürk; Theresa Haidl; Marlene Rosen; Adele Ferro; Giulio Pergola; Ileana Andriola; Giuseppe Blasi; Stephan Ruhrmann; Frauke Schultze-Lutter; Peter Falkai; Joseph Kambeitz; Rebekka Lencer; Udo Dannlowski; Rachel Upthegrove; Raimo K.R. Salokangas; Christos Pantelis; Eva Meisenzahl; Stephen J. Wood; Paolo Brambilla; Stefan Borgwardt; Alessandro Bertolino; Nikolaos Koutsouleris

doi:10.1192/bjp.2022.16

Using combined environmental-clinical classification models to predict role functioning outcome in clinical high-risk states for psychosis and recent-onset depression

Linda A. Antonucci^*, Nora Penzel, Rachele Sanfelici, Alessandro Pigoni, Lana Kambeitz-Ilankovic, Dominic Dwyer, Anne Ruef, Mark Sen Dong, Ömer Faruk Öztürk, Theresa Haidl, Marlene Rosen, Adele Ferro, Giulio Pergola, Ileana Andriola, Giuseppe Blasi, Stephan Ruhrmann, Frauke Schultze-Lutter, Peter Falkai, Joseph Kambeitz, Rebekka LencerUdo Dannlowski, Rachel Upthegrove, Raimo K.R. Salokangas, Christos Pantelis, Eva Meisenzahl, Stephen J. Wood, Paolo Brambilla, Stefan Borgwardt, Alessandro Bertolino, Nikolaos Koutsouleris

^*Corresponding author for this work

Psychology

Research output: Contribution to journal › Article › peer-review

Abstract

Background: Clinical high-risk states for psychosis (CHR) are associated with functional impairments and depressive disorders. A previous PRONIA study predicted social functioning in CHR and recent-onset depression (ROD) based on structural magnetic resonance imaging (sMRI) and clinical data. However, the combination of these domains did not lead to accurate role functioning prediction, calling for the investigation of additional risk dimensions. Role functioning may be more strongly associated with environmental adverse events than social functioning.

Aims: We aimed to predict role functioning in CHR, ROD and transdiagnostically, by adding environmental adverse events-related variables to clinical and sMRI data domains within the PRONIA sample.

Method: Baseline clinical, environmental and sMRI data collected in 92 CHR and 95 ROD samples were trained to predict lower versus higher follow-up role functioning, using support vector classification and mixed k-fold/leave-site-out cross-validation. We built separate predictions for each domain, created multimodal predictions and validated them in independent cohorts (74 CHR, 66 ROD).

Results: Models combining clinical and environmental data predicted role outcome in discovery and replication samples of CHR (balanced accuracies: 65.4% and 67.7%, respectively), ROD (balanced accuracies: 58.9% and 62.5%, respectively), and transdiagnostically (balanced accuracies: 62.4% and 68.2%, respectively). The most reliable environmental features for role outcome prediction were adult environmental adjustment, childhood trauma in CHR and childhood environmental adjustment in ROD.

Conclusions: Findings support the hypothesis that environmental variables inform role outcome prediction, highlight the existence of both transdiagnostic and syndrome-specific predictive environmental adverse events, and emphasise the importance of implementing real-world models by measuring multiple risk dimensions.

Original language	English
Pages (from-to)	229–245
Number of pages	17
Journal	British Journal of Psychiatry
Volume	220
Issue number	4
Early online date	14 Feb 2022
DOIs	https://doi.org/10.1192/bjp.2022.16
Publication status	Published - 20 Apr 2022

Bibliographical note

Funding
This work was supported by the EU-FP7-HEALTH grant for the project ‘PRONIA’ (Personalized Prognostic Tools for Early Psychosis Management; PI: N.K., agreement number: 602152) and by the Structural European Funding of the Italian Minister of Education and Research (Attraction and International Mobility – AIM - action, grant agreement No 1859959). The AIM action also funds L.A.A.’s salary.

Declaration of interest
A.B. has received lecture fees from Otsuka, Janssen and Lundbeck; and consultant fees from Biogen. N.K. has received honoraria for talks presented at education meetings organised by Otsuka/Lundbeck. N.K. and E.M. hold commercial patents that are related to the present work (https://patents.google.com/patent/US20160192889/). C.P. participated in advisory boards for Janssen-Cilag, AstraZeneca, Lundbeck and Servier; received honoraria for talks presented at educational meetings organized by AstraZeneca, Janssen-Cilag, Eli Lilly, Pfizer, Lundbeck and Shire; and was supported by National Health and Medical Research Council Senior Principal Research Fellowship (grants 628386 and 1105825) and European Union–National Health and Medical Research Council (grant 1075379). G.P.'s position is funded by the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement number 798181. L.A.A.'s salary is funded from the Structural European Funding of the Italian Minister of Education (Attraction and International Mobility – AIM - action, grant agreement number 1859959). L.K.-I., D.D., F.S.-L. and R.U. are members of the BJPsych editorial board and did not take part in the review or decision-making process of this paper. No other disclosures were reported.

Keywords

Machine learning
personalised psychiatry
PRONIA
psychosis
role functioning

ASJC Scopus subject areas

Psychiatry and Mental health

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1192/bjp.2022.16Licence: None: All rights reserved

Cite this

Antonucci, L. A., Penzel, N., Sanfelici, R., Pigoni, A., Kambeitz-Ilankovic, L., Dwyer, D., Ruef, A., Sen Dong, M., Öztürk, Ö. F., Haidl, T., Rosen, M., Ferro, A., Pergola, G., Andriola, I., Blasi, G., Ruhrmann, S., Schultze-Lutter, F., Falkai, P., Kambeitz, J., ... Koutsouleris, N. (2022). Using combined environmental-clinical classification models to predict role functioning outcome in clinical high-risk states for psychosis and recent-onset depression. British Journal of Psychiatry, 220(4), 229–245. https://doi.org/10.1192/bjp.2022.16

@article{85b2274b6de041a39e494ee845fb5db5,

title = "Using combined environmental-clinical classification models to predict role functioning outcome in clinical high-risk states for psychosis and recent-onset depression",

abstract = "Background: Clinical high-risk states for psychosis (CHR) are associated with functional impairments and depressive disorders. A previous PRONIA study predicted social functioning in CHR and recent-onset depression (ROD) based on structural magnetic resonance imaging (sMRI) and clinical data. However, the combination of these domains did not lead to accurate role functioning prediction, calling for the investigation of additional risk dimensions. Role functioning may be more strongly associated with environmental adverse events than social functioning.Aims: We aimed to predict role functioning in CHR, ROD and transdiagnostically, by adding environmental adverse events-related variables to clinical and sMRI data domains within the PRONIA sample.Method: Baseline clinical, environmental and sMRI data collected in 92 CHR and 95 ROD samples were trained to predict lower versus higher follow-up role functioning, using support vector classification and mixed k-fold/leave-site-out cross-validation. We built separate predictions for each domain, created multimodal predictions and validated them in independent cohorts (74 CHR, 66 ROD).Results: Models combining clinical and environmental data predicted role outcome in discovery and replication samples of CHR (balanced accuracies: 65.4% and 67.7%, respectively), ROD (balanced accuracies: 58.9% and 62.5%, respectively), and transdiagnostically (balanced accuracies: 62.4% and 68.2%, respectively). The most reliable environmental features for role outcome prediction were adult environmental adjustment, childhood trauma in CHR and childhood environmental adjustment in ROD.Conclusions: Findings support the hypothesis that environmental variables inform role outcome prediction, highlight the existence of both transdiagnostic and syndrome-specific predictive environmental adverse events, and emphasise the importance of implementing real-world models by measuring multiple risk dimensions.",

keywords = "Machine learning, personalised psychiatry, PRONIA, psychosis, role functioning",

author = "Antonucci, {Linda A.} and Nora Penzel and Rachele Sanfelici and Alessandro Pigoni and Lana Kambeitz-Ilankovic and Dominic Dwyer and Anne Ruef and {Sen Dong}, Mark and {\"O}zt{\"u}rk, {{\"O}mer Faruk} and Theresa Haidl and Marlene Rosen and Adele Ferro and Giulio Pergola and Ileana Andriola and Giuseppe Blasi and Stephan Ruhrmann and Frauke Schultze-Lutter and Peter Falkai and Joseph Kambeitz and Rebekka Lencer and Udo Dannlowski and Rachel Upthegrove and Salokangas, {Raimo K.R.} and Christos Pantelis and Eva Meisenzahl and Wood, {Stephen J.} and Paolo Brambilla and Stefan Borgwardt and Alessandro Bertolino and Nikolaos Koutsouleris",

note = "Funding This work was supported by the EU-FP7-HEALTH grant for the project {\textquoteleft}PRONIA{\textquoteright} (Personalized Prognostic Tools for Early Psychosis Management; PI: N.K., agreement number: 602152) and by the Structural European Funding of the Italian Minister of Education and Research (Attraction and International Mobility – AIM - action, grant agreement No 1859959). The AIM action also funds L.A.A.{\textquoteright}s salary. Declaration of interest A.B. has received lecture fees from Otsuka, Janssen and Lundbeck; and consultant fees from Biogen. N.K. has received honoraria for talks presented at education meetings organised by Otsuka/Lundbeck. N.K. and E.M. hold commercial patents that are related to the present work (https://patents.google.com/patent/US20160192889/). C.P. participated in advisory boards for Janssen-Cilag, AstraZeneca, Lundbeck and Servier; received honoraria for talks presented at educational meetings organized by AstraZeneca, Janssen-Cilag, Eli Lilly, Pfizer, Lundbeck and Shire; and was supported by National Health and Medical Research Council Senior Principal Research Fellowship (grants 628386 and 1105825) and European Union–National Health and Medical Research Council (grant 1075379). G.P.'s position is funded by the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement number 798181. L.A.A.'s salary is funded from the Structural European Funding of the Italian Minister of Education (Attraction and International Mobility – AIM - action, grant agreement number 1859959). L.K.-I., D.D., F.S.-L. and R.U. are members of the BJPsych editorial board and did not take part in the review or decision-making process of this paper. No other disclosures were reported.",

year = "2022",

month = apr,

day = "20",

doi = "10.1192/bjp.2022.16",

language = "English",

volume = "220",

pages = "229–245",

journal = "British Journal of Psychiatry",

issn = "0007-1250",

publisher = "Royal College of Psychiatrists",

number = "4",

}

Antonucci, LA, Penzel, N, Sanfelici, R, Pigoni, A, Kambeitz-Ilankovic, L, Dwyer, D, Ruef, A, Sen Dong, M, Öztürk, ÖF, Haidl, T, Rosen, M, Ferro, A, Pergola, G, Andriola, I, Blasi, G, Ruhrmann, S, Schultze-Lutter, F, Falkai, P, Kambeitz, J, Lencer, R, Dannlowski, U, Upthegrove, R, Salokangas, RKR, Pantelis, C, Meisenzahl, E, Wood, SJ, Brambilla, P, Borgwardt, S, Bertolino, A & Koutsouleris, N 2022, 'Using combined environmental-clinical classification models to predict role functioning outcome in clinical high-risk states for psychosis and recent-onset depression', British Journal of Psychiatry, vol. 220, no. 4, pp. 229–245. https://doi.org/10.1192/bjp.2022.16

Using combined environmental-clinical classification models to predict role functioning outcome in clinical high-risk states for psychosis and recent-onset depression. / Antonucci, Linda A.; Penzel, Nora; Sanfelici, Rachele et al.
In: British Journal of Psychiatry, Vol. 220, No. 4, 20.04.2022, p. 229–245.

Research output: Contribution to journal › Article › peer-review

TY - JOUR

T1 - Using combined environmental-clinical classification models to predict role functioning outcome in clinical high-risk states for psychosis and recent-onset depression

AU - Antonucci, Linda A.

AU - Penzel, Nora

AU - Sanfelici, Rachele

AU - Pigoni, Alessandro

AU - Kambeitz-Ilankovic, Lana

AU - Dwyer, Dominic

AU - Ruef, Anne

AU - Sen Dong, Mark

AU - Öztürk, Ömer Faruk

AU - Haidl, Theresa

AU - Rosen, Marlene

AU - Ferro, Adele

AU - Pergola, Giulio

AU - Andriola, Ileana

AU - Blasi, Giuseppe

AU - Ruhrmann, Stephan

AU - Schultze-Lutter, Frauke

AU - Falkai, Peter

AU - Kambeitz, Joseph

AU - Lencer, Rebekka

AU - Dannlowski, Udo

AU - Upthegrove, Rachel

AU - Salokangas, Raimo K.R.

AU - Pantelis, Christos

AU - Meisenzahl, Eva

AU - Wood, Stephen J.

AU - Brambilla, Paolo

AU - Borgwardt, Stefan

AU - Bertolino, Alessandro

AU - Koutsouleris, Nikolaos

N1 - Funding This work was supported by the EU-FP7-HEALTH grant for the project ‘PRONIA’ (Personalized Prognostic Tools for Early Psychosis Management; PI: N.K., agreement number: 602152) and by the Structural European Funding of the Italian Minister of Education and Research (Attraction and International Mobility – AIM - action, grant agreement No 1859959). The AIM action also funds L.A.A.’s salary. Declaration of interest A.B. has received lecture fees from Otsuka, Janssen and Lundbeck; and consultant fees from Biogen. N.K. has received honoraria for talks presented at education meetings organised by Otsuka/Lundbeck. N.K. and E.M. hold commercial patents that are related to the present work (https://patents.google.com/patent/US20160192889/). C.P. participated in advisory boards for Janssen-Cilag, AstraZeneca, Lundbeck and Servier; received honoraria for talks presented at educational meetings organized by AstraZeneca, Janssen-Cilag, Eli Lilly, Pfizer, Lundbeck and Shire; and was supported by National Health and Medical Research Council Senior Principal Research Fellowship (grants 628386 and 1105825) and European Union–National Health and Medical Research Council (grant 1075379). G.P.'s position is funded by the European Union's Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement number 798181. L.A.A.'s salary is funded from the Structural European Funding of the Italian Minister of Education (Attraction and International Mobility – AIM - action, grant agreement number 1859959). L.K.-I., D.D., F.S.-L. and R.U. are members of the BJPsych editorial board and did not take part in the review or decision-making process of this paper. No other disclosures were reported.

PY - 2022/4/20

Y1 - 2022/4/20

N2 - Background: Clinical high-risk states for psychosis (CHR) are associated with functional impairments and depressive disorders. A previous PRONIA study predicted social functioning in CHR and recent-onset depression (ROD) based on structural magnetic resonance imaging (sMRI) and clinical data. However, the combination of these domains did not lead to accurate role functioning prediction, calling for the investigation of additional risk dimensions. Role functioning may be more strongly associated with environmental adverse events than social functioning.Aims: We aimed to predict role functioning in CHR, ROD and transdiagnostically, by adding environmental adverse events-related variables to clinical and sMRI data domains within the PRONIA sample.Method: Baseline clinical, environmental and sMRI data collected in 92 CHR and 95 ROD samples were trained to predict lower versus higher follow-up role functioning, using support vector classification and mixed k-fold/leave-site-out cross-validation. We built separate predictions for each domain, created multimodal predictions and validated them in independent cohorts (74 CHR, 66 ROD).Results: Models combining clinical and environmental data predicted role outcome in discovery and replication samples of CHR (balanced accuracies: 65.4% and 67.7%, respectively), ROD (balanced accuracies: 58.9% and 62.5%, respectively), and transdiagnostically (balanced accuracies: 62.4% and 68.2%, respectively). The most reliable environmental features for role outcome prediction were adult environmental adjustment, childhood trauma in CHR and childhood environmental adjustment in ROD.Conclusions: Findings support the hypothesis that environmental variables inform role outcome prediction, highlight the existence of both transdiagnostic and syndrome-specific predictive environmental adverse events, and emphasise the importance of implementing real-world models by measuring multiple risk dimensions.

AB - Background: Clinical high-risk states for psychosis (CHR) are associated with functional impairments and depressive disorders. A previous PRONIA study predicted social functioning in CHR and recent-onset depression (ROD) based on structural magnetic resonance imaging (sMRI) and clinical data. However, the combination of these domains did not lead to accurate role functioning prediction, calling for the investigation of additional risk dimensions. Role functioning may be more strongly associated with environmental adverse events than social functioning.Aims: We aimed to predict role functioning in CHR, ROD and transdiagnostically, by adding environmental adverse events-related variables to clinical and sMRI data domains within the PRONIA sample.Method: Baseline clinical, environmental and sMRI data collected in 92 CHR and 95 ROD samples were trained to predict lower versus higher follow-up role functioning, using support vector classification and mixed k-fold/leave-site-out cross-validation. We built separate predictions for each domain, created multimodal predictions and validated them in independent cohorts (74 CHR, 66 ROD).Results: Models combining clinical and environmental data predicted role outcome in discovery and replication samples of CHR (balanced accuracies: 65.4% and 67.7%, respectively), ROD (balanced accuracies: 58.9% and 62.5%, respectively), and transdiagnostically (balanced accuracies: 62.4% and 68.2%, respectively). The most reliable environmental features for role outcome prediction were adult environmental adjustment, childhood trauma in CHR and childhood environmental adjustment in ROD.Conclusions: Findings support the hypothesis that environmental variables inform role outcome prediction, highlight the existence of both transdiagnostic and syndrome-specific predictive environmental adverse events, and emphasise the importance of implementing real-world models by measuring multiple risk dimensions.

KW - Machine learning

KW - personalised psychiatry

KW - PRONIA

KW - psychosis

KW - role functioning

UR - http://www.scopus.com/inward/record.url?scp=85124964248&partnerID=8YFLogxK

U2 - 10.1192/bjp.2022.16

DO - 10.1192/bjp.2022.16

M3 - Article

C2 - 35152923

AN - SCOPUS:85124964248

SN - 0007-1250

VL - 220

SP - 229

EP - 245

JO - British Journal of Psychiatry

JF - British Journal of Psychiatry

IS - 4

ER -

Using combined environmental-clinical classification models to predict role functioning outcome in clinical high-risk states for psychosis and recent-onset depression

Abstract

Bibliographical note

Keywords

ASJC Scopus subject areas

UN SDGs

Access to Document

Fingerprint

Cite this