Personalized Risk Analysis to Improve the Psychological Resilience of Women Undergoing Treatment for Breast Cancer: Development of a Machine Learning-Driven Clinical Decision Support Tool.
C Manikis, Georgios; Simos, Nikolaos-Ioannis; Kourou, Konstantinaet al.
2023 • In Journal of Medical Internet Research, 25, p. 43838
breast cancer; classification; explainability; interventions; machine learning; mental health; risk assessment; well-being; Humans; Female; Prospective Studies; Quality of Life; Risk Assessment; Machine Learning; Breast Neoplasms; Decision Support Systems, Clinical; Resilience, Psychological; Health Informatics
Abstract :
[en] BACKGROUND: Health professionals are often faced with the need to identify women at risk of manifesting poor psychological resilience following the diagnosis and treatment of breast cancer. Machine learning algorithms are increasingly used to support clinical decision support (CDS) tools in helping health professionals identify women who are at risk of adverse well-being outcomes and plan customized psychological interventions for women at risk. Clinical flexibility, cross-validated performance accuracy, and model explainability permitting person-specific identification of risk factors are highly desirable features of such tools.
OBJECTIVE: This study aimed to develop and cross-validate machine learning models designed to identify breast cancer survivors at risk of poor overall mental health and global quality of life and identify potential targets of personalized psychological interventions according to an extensive set of clinical recommendations.
METHODS: A set of 12 alternative models was developed to improve the clinical flexibility of the CDS tool. All models were validated using longitudinal data from a prospective, multicenter clinical pilot at 5 major oncology centers in 4 countries (Italy, Finland, Israel, and Portugal; the Predicting Effective Adaptation to Breast Cancer to Help Women to BOUNCE Back [BOUNCE] project). A total of 706 patients with highly treatable breast cancer were enrolled shortly after diagnosis and before the onset of oncological treatments and were followed up for 18 months. An extensive set of demographic, lifestyle, clinical, psychological, and biological variables measured within 3 months after enrollment served as predictors. Rigorous feature selection isolated key psychological resilience outcomes that could be incorporated into future clinical practice.
RESULTS: Balanced random forest classifiers were successful at predicting well-being outcomes, with accuracies ranging between 78% and 82% (for 12-month end points after diagnosis) and between 74% and 83% (for 18-month end points after diagnosis). Explainability and interpretability analyses built on the best-performing models were used to identify potentially modifiable psychological and lifestyle characteristics that, if addressed systematically in the context of personalized psychological interventions, would be most likely to promote resilience for a given patient.
CONCLUSIONS: Our results highlight the clinical utility of the BOUNCE modeling approach by focusing on resilience predictors that can be readily available to practicing clinicians at major oncology centers. The BOUNCE CDS tool paves the way for personalized risk assessment methods to identify patients at high risk of adverse well-being outcomes and direct valuable resources toward those most in need of specialized psychological interventions.
Disciplines :
Treatment & clinical psychology
Author, co-author :
C Manikis, Georgios ✱; Foundation for Research and Technology-Hellas, Institute of Computer Science, Heraklion, Greece
Simos, Nikolaos-Ioannis ✱; Université de Liège - ULiège > Département des sciences cliniques > Neurologie ; Foundation for Research and Technology-Hellas, Institute of Computer Science, Heraklion, Greece
Kourou, Konstantina ; Department of Materials Science and Engineering, University of Ioannina, Ioannina, Greece ; Foundation for Research and Technology-Hellas, Biomedical Research Institute, Ioannina, Greece
Kondylakis, Haridimos ; Foundation for Research and Technology-Hellas, Institute of Computer Science, Heraklion, Greece
Poikonen-Saksela, Paula ; Comprehensive Cancer Center, Helsinki University Hospital, University of Helsinki, Helsinki, Finland
Mazzocco, Ketti ; Applied Research Division for Cognitive and Psychological Science, European Institute of Oncology Istituto di Ricovero e Cura a Carattere Scientifico, Milan, Italy ; Department of Oncology and Hemato-Oncology, University of Milan, Milan, Italy
Pat-Horenczyk, Ruth ; School of Social Work and Social Welfare,The Hebrew University of Jerusalem, Jerusalem, Israel
Sousa, Berta ; Breast Unit, Champalimaud Research and Clinical Centre, Champalimaud Foundation, Lisbon, Portugal
Oliveira-Maia, Albino J ; Champalimaud Research and Clinical Centre, Champalimaud Foundation, Lisbon, Portugal
Mattson, Johanna ; Comprehensive Cancer Center, Helsinki University Hospital, University of Helsinki, Helsinki, Finland
Roziner, Ilan ; Department of Communication Disorders, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
Marzorati, Chiara ; Applied Research Division for Cognitive and Psychological Science, European Institute of Oncology Istituto di Ricovero e Cura a Carattere Scientifico, Milan, Italy
Marias, Kostas ; Foundation for Research and Technology-Hellas, Institute of Computer Science, Heraklion, Greece
Nuutinen, Mikko ; Nordic Healthcare Group, Helsinkifin, Finland
Karademas, Evangelos ; Foundation for Research and Technology-Hellas, Institute of Computer Science, Heraklion, Greece
Fotiadis, Dimitrios ; Department of Materials Science and Engineering, University of Ioannina, Ioannina, Greece ; Foundation for Research and Technology-Hellas, Biomedical Research Institute, Ioannina, Greece
✱ These authors have contributed equally to this work.
Language :
English
Title :
Personalized Risk Analysis to Improve the Psychological Resilience of Women Undergoing Treatment for Breast Cancer: Development of a Machine Learning-Driven Clinical Decision Support Tool.
Publication date :
12 June 2023
Journal title :
Journal of Medical Internet Research
ISSN :
1439-4456
eISSN :
1438-8871
Publisher :
JMIR Publications Inc., Canada
Volume :
25
Pages :
e43838
Peer reviewed :
Peer Reviewed verified by ORBi
Funding text :
This project received funding from the European Union Horizon 2020 research and innovation program under grant 777167.AJO-M received grants from Schuhfried GmBH, Janssen, and Compass Pathways, Ltd; received payment or honoraria from Merck Sharp&Dohme (MSD), Neurolite AG, Janssen, and the European Monitoring Centre for Drugs and Drug Addiction; participated in advisory boards for Janssen and Angelini; and participated in investigator-driven research funded by Fundação para Ciência e Tecnologia (PTDC/MED-NEU/31331/2017; PTDC/SAU-NUT/3507/2021; PTDC/MED-NEU/1552/2021), Fundação para Ciência e Tecnologia and El Fondo Europeo de Desarrollo Regional (FEDER; PTDC/MEC-PSQ/30302/2017-IC&DT_LISBOA-01-0145-FEDER-030845; PTDC/MEC PSQ/30302/2017_LISBOA-01-0145 -FEDER-30302), the European Commission Horizon 2020 program (H2020-SC1-DTH-2019-875358-FAITH), the European Joint Programme in Rare Diseases (Joint Translational Call 2019) through Fundação para Ciência e Tecnologia (EJPRD/0001/2020), and the European Research Council (grant 950357).
Global Cancer Observatory. World Health Organization. URL: https://gco.iarc.fr/ [accessed 2023-05-23]
Roine E, Sintonen H, Kellokumpu-Lehtinen PL, Penttinen H, Utriainen M, Vehmanen L, et al. Long-term health-related quality of life of breast cancer survivors remains impaired compared to the age-matched general population especially in young women. Results from the prospective controlled BREX exercise study. Breast 2021 Oct;59:110-116 [FREE Full text] [doi: 10.1016/j.breast.2021.06.012] [Medline: 34225091]
Deshields TL, Heiland MF, Kracen AC, Dua P. Resilience in adults with cancer: development of a conceptual model. Psychooncology 2016 Jan;25(1):11-18 [doi: 10.1002/pon.3800] [Medline: 25787828]
Aizpurua-Perez I, Perez-Tejada J. Resilience in women with breast cancer: a systematic review. Eur J Oncol Nurs 2020 Dec;49:101854 [doi: 10.1016/j.ejon.2020.101854] [Medline: 33120216]
Borgi M, Collacchi B, Ortona E, Cirulli F. Stress and coping in women with breast cancer: unravelling the mechanisms to improve resilience. Neurosci Biobehav Rev 2020 Dec;119:406-421 [doi: 10.1016/j.neubiorev.2020.10.011] [Medline: 33086128]
Johnston MC, Porteous T, Crilly MA, Burton CD, Elliott A, Iversen L, et al. Physical disease and resilient outcomes: a systematic review of resilience definitions and study methods. Psychosomatics 2015 Mar;56(2):168-180 [FREE Full text] [doi: 10.1016/j.psym.2014.10.005] [Medline: 25620566]
Tan PN, Steinbach M, Kumar V. Introduction to Data Mining. Noida, Uttar Pradesh, India: Pearson Education India; 2016.
Bishop CM. Pattern Recognition and Machine Learning. New York, NY, USA: Springer; 2006.
Gunning D, Stefik M, Choi J, Miller T, Stumpf S, Yang GZ. XAI-explainable artificial intelligence. Sci Robot 2019 Dec 18;4(37):eaay7120 [doi: 10.1126/scirobotics.aay7120] [Medline: 33137719]
Došilović FK, Brčić M, Hlupić N. Explainable artificial intelligence: a survey. In: Proceedings of the 41st International Convention on Information and Communication Technology, Electronics and Microelectronics. 2009 Oct Presented at: MIPRO '18; May 21-25, 2018; Opatija, Croatia p. 0210-0215 URL: https://ieeexplore.ieee.org/document/8400040
Adadi A, Berrada M. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI. IEEE Access 2018 Sep 16;6:52138-52160 [FREE Full text] [doi: 10.1109/access.2018.2870052]
Molnar C. Interpretable Machine Learning: A Guide For Making Black Box Models Explainable. Morrisville, NC, USA: Lulu Press; 2021.
Ayer T, Alagoz O, Chhatwal J, Shavlik JW, Kahn Jr CE, Burnside ES. Breast cancer risk estimation with artificial neural networks revisited: discrimination and calibration. Cancer 2010 Jul 15;116(14):3310-3321 [FREE Full text] [doi: 10.1002/cncr.25081] [Medline: 20564067]
Kim W, Kim KS, Lee JE, Noh DY, Kim SW, Jung YS, et al. Development of novel breast cancer recurrence prediction model using support vector machine. J Breast Cancer 2012 Jun;15(2):230-238 [FREE Full text] [doi: 10.4048/jbc.2012.15.2.230] [Medline: 22807942]
LG A, AT E. Using three machine learning techniques for predicting breast cancer recurrence. J Health Med Inform 2013;04(02):124-126 [FREE Full text] [doi: 10.4172/2157-7420.1000124]
Higgins O, Short BL, Chalup SK, Wilson RL. Artificial intelligence (AI) and machine learning (ML) based decision support systems in mental health: an integrative review. Int J Ment Health Nurs (forthcoming) 2023 Feb 06 [doi: 10.1111/inm.13114] [Medline: 36744684]
Ahmadi M, Nopour R. Clinical decision support system for quality of life among the elderly: an approach using artificial neural network. BMC Med Inform Decis Mak 2022 Nov 12;22(1):293 [FREE Full text] [doi: 10.1186/s12911-022-02044-9] [Medline: 36371224]
Aaronson NK, Ahmedzai S, Bergman B, Bullinger M, Cull A, Duez NJ, et al. The European organization for research and treatment of cancer QLQ-C30: a quality-of-life instrument for use in international clinical trials in oncology. J Natl Cancer Inst 1993 Mar 03;85(5):365-376 [doi: 10.1093/jnci/85.5.365] [Medline: 8433390]
Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: the PANAS scales. J Pers Soc Psychol 1988 Jun;54(6):1063-1070 [doi: 10.1037//0022-3514.54.6.1063] [Medline: 3397865]
Simard S, Savard J. Fear of Cancer Recurrence Inventory: development and initial validation of a multidimensional measure of fear of cancer recurrence. Support Care Cancer 2009 Mar;17(3):241-251 [doi: 10.1007/s00520-008-0444-y] [Medline: 18414902]
Heitzmann CA, Merluzzi TV, Jean-Pierre P, Roscoe JA, Kirsh KL, Passik SD. Assessing self-efficacy for coping with cancer: development and psychometric analysis of the brief version of the Cancer Behavior Inventory (CBI-B). Psychooncology 2011 Mar;20(3):302-312 [doi: 10.1002/pon.1735] [Medline: 20878830]
Watson M, Law M, dos Santos M, Greer S, Baruch J, Bliss J. The Mini-MAC: further development of the Mental Adjustment to Cancer scale. J Psychosoc Oncol 1994 Oct 31;12(3):33-46 [doi: 10.1300/J077V12N03_03]
Bonanno GA, Pat-Horenczyk R, Noll J. Coping flexibility and trauma: the Perceived Ability to Cope With Trauma (PACT) scale. Psychol Trauma 2011 Jun;3(2):117-129 [doi: 10.1037/a0020921]
Morrill EF, Brewer NT, O'Neill SC, Lillie SE, Dees EC, Carey LA, et al. The interaction of post-traumatic growth and post-traumatic stress symptoms in predicting depressive symptoms and quality of life. Psychooncology 2008 Sep;17(9):948-953 [doi: 10.1002/pon.1313] [Medline: 18213677]
Moser A, Stuck AE, Silliman RA, Ganz PA, Clough-Gorr KM. The eight-item modified Medical Outcomes Study Social Support Survey: psychometric evaluation showed excellent performance. J Clin Epidemiol 2012 Oct;65(10):1107-1116 [FREE Full text] [doi: 10.1016/j.jclinepi.2012.04.007] [Medline: 22818947]
Rocchi S, Ghidelli C, Burro R, Vitacca M, Scalvini S, Della Vedova AM, et al. The Walsh Family Resilience Questionnaire: the Italian version. Neuropsychiatr Dis Treat 2017 Dec 14;13:2987-2999 [FREE Full text] [doi: 10.2147/NDT.S147315] [Medline: 29290684]
Campbell-Sills L, Stein MB. Psychometric analysis and refinement of the Connor-davidson Resilience Scale (CD-RISC): validation of a 10-item measure of resilience. J Trauma Stress 2007 Dec;20(6):1019-1028 [doi: 10.1002/jts.20271] [Medline: 18157881]
Garnefski N, Kraaij V. Cognitive emotion regulation questionnaire – development of a short 18-item version (CERQ-short). Pers Individ Dif 2006 Oct;41(6):1045-1053 [doi: 10.1016/j.paid.2006.04.010]
Brown KW, Ryan RM. The benefits of being present: mindfulness and its role in psychological well-being. J Pers Soc Psychol 2003 Apr;84(4):822-848 [doi: 10.1037/0022-3514.84.4.822] [Medline: 12703651]
Scheier MF, Carver CS, Bridges MW. Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the Life Orientation Test. J Pers Soc Psychol 1994 Dec;67(6):1063-1078 [doi: 10.1037//0022-3514.67.6.1063] [Medline: 7815302]
Pettini G, Sanchini V, Pat-Horenczyk R, Sousa B, Masiero M, Marzorati C, et al. Predicting effective adaptation to breast cancer to help women BOUNCE back: protocol for a multicenter clinical pilot study. JMIR Res Protoc 2022 Oct 12;11(10):e34564 [FREE Full text] [doi: 10.2196/34564] [Medline: 36222801]
Wu Y, Levis B, Sun Y, He C, Krishnan A, Neupane D, DEPRESsion Screening Data (DEPRESSD) HADS Group. Accuracy of the hospital anxiety and depression scale depression subscale (HADS-D) to screen for major depression: systematic review and individual participant data meta-analysis. BMJ 2021 May 10;373:n972 [FREE Full text] [doi: 10.1136/bmj.n972] [Medline: 33972268]
Vodermaier A, Millman RD. Accuracy of the hospital anxiety and depression scale as a screening tool in cancer patients: a systematic review and meta-analysis. Support Care Cancer 2011 Dec;19(12):1899-1908 [doi: 10.1007/s00520-011-1251-4] [Medline: 21898134]
Breiman L. Random forests. Mach Learn 2001;45:5-32 [FREE Full text] [doi: 10.1007/978-3-030-62008-0_35]
Simos NJ, Dimitriadis SI, Kavroulakis E, Manikis GC, Bertsias G, Simos P, et al. Quantitative identification of functional connectivity disturbances in neuropsychiatric lupus based on resting-state fMRI: a robust machine learning approach. Brain Sci 2020 Oct 25;10(11):777 [FREE Full text] [doi: 10.3390/brainsci10110777] [Medline: 33113768]
Zhong Y, Chalise P, He J. Nested cross-validation with ensemble feature selection and classification model for high-dimensional biological data. Commun Stat Simul Comput 2023;52(1):110-125 [FREE Full text] [doi: 10.1080/03610918.2020.1850790]
Parvandeh S, Yeh HW, Paulus MP, McKinney BA. Consensus features nested cross-validation. Bioinformatics 2020 May 01;36(10):3093-3098 [FREE Full text] [doi: 10.1093/bioinformatics/btaa046] [Medline: 31985777]
Pedregosa F, Gramfort A, Thirion B, Varoquaux G, Michel V, Grisel O, et al. Scikit-learn: machine learning in Python. J Mach Learn Res 2011;12(85):2825-2830 [FREE Full text] [doi: 10.3389/fninf.2014.00014]
Lemaître G, Nogueira F, Aridas CK. Imbalanced-learn: a python toolbox to tackle the curse of imbalanced datasets in machine learning. J Mach Learn Res 2017;18:1-5 [FREE Full text]
Liu XY, Wu J, Zhou ZH. Exploratory undersampling for class-imbalance learning. IEEE Trans Syst Man Cybern B Cybern 2009 Apr;39(2):539-550 [doi: 10.1109/TSMCB.2008.2007853] [Medline: 19095540]
Greenwell BM. pdp: an R package for constructing partial dependence plots. R J 2017;9(1):421-436 [FREE Full text] [doi: 10.32614/rj-2017-016]
Daniel WA, Jingyu Z. Visualizing the effects of predictor variables in black box supervised learning models. J R Stat Soc Series B Stat Methodol 2020 Jun 11;82(4):1056-1086 [FREE Full text] [doi: 10.1111/rssb.12377]
Fisher A, Rudin C, Dominici F. All models are wrong, but many are useful: learning a variable's importance by studying an entire class of prediction models simultaneously. J Mach Learn Res 2019;20:177 [FREE Full text] [Medline: 34335110]
Mateusz S, Przemyslaw B. Explanations of model predictions with live and breakDown packages. R J 2018 Dec;10(2):395-409 [FREE Full text] [doi: 10.32614/rj-2018-072]
Baniecki H, Kretowicz W, Piatyszek P, Wisniewski J, Biecek P. dalex: responsible machine learning with interactive explainability and fairness in python. J Mach Learn Res 2021 Sep:1-7 [FREE Full text]
Biecek P. DALEX: explainers for complex predictive models in R. J Mach Learn Res 2018;19(84):1-5 [FREE Full text] [doi: 10.48550/arXiv.1806.08915]
Assessment list for trustworthy artificial intelligence (ALTAI). European Commission. 2020 Jul 17. URL: https://digital-strategy.ec.europa.eu/en/library/assessment-list-trustworthy-artificial-intelligence-altai-self-assessment [accessed 2023-05-22]
Price 2nd WN, Gerke S, Cohen IG. Potential liability for physicians using artificial intelligence. JAMA 2019 Nov 12;322(18):1765-1766 [doi: 10.1001/jama.2019.15064] [Medline: 31584609]
Samek W, Wiegand T, Müller KR. Explainable artificial intelligence: understanding, visualizing and interpreting deep learning models. ITU J (Geneva) 2017 Oct 13:39-48 [FREE Full text]
Kelly CJ, Karthikesalingam A, Suleyman M, Corrado G, King D. Key challenges for delivering clinical impact with artificial intelligence. BMC Med 2019 Oct 29;17(1):195 [FREE Full text] [doi: 10.1186/s12916-019-1426-2] [Medline: 31665002]
Leventhal H, Halm E, Horowitz C, Leventhal EA, Ozakinci G. Living with chronic illness: a contextualized, self-regulation approach. In: Sutton S, Baum A, Johnston M, editors. The Sage Handbook of Health Psychology. London, UK: Sage Publication; 2005:197-240
Lazarus RS, Folkman S. Stress, Appraisal, and Coping. New York, NY, USA: Springer; 1984.