Quantifying the recollection of discomfort and emotional suffering during a stay in intensive care: development and validation of the EXPRIM questionnaire : EXPRIM: quantification of discomfort experienced during an ICU stay. - 2026
Quantifying the recollection of discomfort and emotional suffering during a stay in intensive care: development and validation of the EXPRIM questionnaire : EXPRIM: quantification of discomfort experienced during an ICU stay.
Critical illness; Discomfort; Recollection; Suffering; Survivors; Humans; Female; Male; Middle Aged; Surveys and Questionnaires/standards; Reproducibility of Results; Psychometrics; Adult; Aged; Quality of Life; Mental Recall; Intensive Care Units; Critical Care/psychology; Stress, Psychological/psychology
Abstract :
[en] [en] BACKGROUND: Discomfort perceived by patients during an intensive care unit (ICU) stay may limit their function, well-being, and quality of life after their stay. This study creates a comprehensive questionnaire (EXPRIM) able to distinguish and quantify the recollection of discomfort and emotional suffering experienced during a stay in an ICU stay, and to assess its performance.
METHOD: The measurement properties of the questionnaire were tested in a first sample of 50 patients recruited between February and July 2024 in a tertiary ICU, using internal consistency, test-retest reliability, standard error of measurement (SEM), and construct validity. Content validity was also tested, in a second sample of 20 patients and 10 ICU healthcare providers recruited between April and June 2024 in a regional ICU, using face-to-face qualitative interviews based on a semi-structured interview guide assessing comprehensibility, relevance and comprehensiveness of the instruction and items.
RESULTS: EXPRIM is a 30-item questionnaire developed in French and translated in English. Its total score ranges from 0 to 10, reflecting the weighting of discomfort versus suffering. The internal consistency was very good (Cronbach's alpha coefficient 0.81). The intra- and inter-examinator reliabilities were excellent (Intraclass Coefficient Correlation = 0.875 and 0.858, respectively). SEM ranged from -0.071 to 0.035. Good correlations were found between EXPRIM and other questionnaires measuring similar concepts. There was good evidence of content validity to explore recollection of the ICU stay.
CONCLUSIONS: The EXPRIM questionnaire is a new tool with excellent psychometric properties to quantitatively assess the ICU experiences survivors recall after discharge. It is a promising tool to explore the extent of discomfort and emotional suffering during an ICU stay and to compare experiences between patients or populations.
Disciplines :
Anesthesia & intensive care
Author, co-author :
Minguet, Pauline ; Centre Hospitalier Universitaire de Liège - CHU > > Service des soins intensifs
Gerard, Laura; Vivalia, Hôpital de Libramont, Libramont, Belgium
COLSON, Camille ; Centre Hospitalier Universitaire de Liège - CHU > > Soins intensifs chirurgie (+1D)
NEIS GILSON, Sarah ; Centre Hospitalier Universitaire de Liège - CHU > > Service des soins intensifs
Misset, Benoît ; Université de Liège - ULiège > Département des sciences cliniques
Lambermont, Bernard; Université de Liège - ULiège
Kalfon, Pierre; Réanimation polyvalente, Hôpital privé La Casamance, Aubagne, France
Chase, J Geoffrey ; Université de Liège - ULiège > Département d'astrophysique, géophysique et océanographie (AGO) > Thermodynamique des phénomènes irréversibles ; Department of Mechanical Engineering, Centre for Bio-Engineering, University of Canterbury, Christchurch, New Zealand
Beil, Michael; Department of Medicine, National Health Service Highland, Inverness, UK
Bruyère, Olivier ; Université de Liège - ULiège > Département des sciences de la santé publique > Santé publique, Epidémiologie et Economie de la santé
Beaudart, Charlotte ; Université de Liège - ULiège > Département des sciences de la santé publique > Epidémiologie générale ; Clinical Pharmacology and Toxicology Research Unit, Department of Biomedical Sciences, Faculty of Medicine, Namur Research Institute for Life Sciences, University of Namur, Namur, Belgium
Rousseau, Anne-Françoise ; Université de Liège - ULiège > Département de pharmacie > Chimie médicale
Language :
English
Title :
Quantifying the recollection of discomfort and emotional suffering during a stay in intensive care: development and validation of the EXPRIM questionnaire : EXPRIM: quantification of discomfort experienced during an ICU stay.
Zengin N Oren B Ustundag H The relationship between stressors and intensive care unit experiences Nurs Crit Care 2020 25 2 109 116 31407452
Wilson ME Beesley S Grow A Rubin E Hopkins RO Hajizadeh N Brown SM Humanizing the intensive care unit Crit Care 2019 23 1 32 30691528 6350326
Capuzzo M Pinamonti A Cingolani E Grassi L Bianconi M Contu P Gritti G Alvisi R Analgesia, sedation, and memory of intensive care J Crit Care 2001 16 3 83 89 1:STN:280:DC%2BD3MnjvFyksA%3D%3D 11689763
Samuelson KA Unpleasant and pleasant memories of intensive care in adult mechanically ventilated patients-findings from 250 interviews Intensive Crit Care Nurs 2011 27 2 76 84 21371888
Salve G Mongodi S Mangiagalli M Tintim Lobato C Mojoli F Memories of ICU stay in patients admitted for severe COVID-19 Intensive Care Med 2024 50 4 602 604 38436721
van de Leur Jp van der Schans Cp Loef BG Deelman BG Geertzen JH Zwaveling JH Discomfort and factual recollection in intensive care unit patients Crit Care 2004 8 6 R467 473 15566593 1065072
Puntillo KA Arai S Cohen NH Gropper MA Neuhaus J Paul SM Miaskowski C Symptoms experienced by intensive care unit patients at high risk of dying Crit Care Med 2010 38 11 2155 2160 20711069 3377582
Rousseau AF Preiser JC To critically ill survivors: LIFE-UP! J Crit Care 2021 64 139 140 33878519
Prime D Arkless P Fine J Winter S Wakefield DB Scatena R Patient experiences during awake mechanical ventilation J Community Hosp Intern Med Perspect 2016 6 1 30426 26908386 4763562
Devlin JW Skrobik Y Gelinas C Needham DM Slooter AJC Pandharipande PP Watson PL Weinhouse GL Nunnally ME Rochwerg B et al. Clinical practice Guidelines for the prevention and management of pain, Agitation/Sedation, delirium Immobility, Sleep Disrupt Adult Patients the ICU. Crit Care Med 2018 46 9 e825 e873
Duymaz T Culha Y Investigation of environmental stressors and individualized care perceptions of inpatients in the intensive care unit Nurs Crit Care 2025 30 2 e13299 39993942
Gezginci E Goktas S Orhan BN The effects of environmental stressors in intensive care unit on anxiety and depression Nurs Crit Care 2022 27 1 113 119 32954635
Tilburgs B Bakker-Crommentuijn C de Graaf M van den Boogaard M Important and feasible patient- and family-centered intensive care interventions: a Delphi study with stakeholders Intensive Crit Care Nurs 2025 92 104253 41101097
Gravante F Trotta F Latina S Simeone S Alvaro R Vellone E Pucciarelli G Quality of life in ICU survivors and their relatives with post-intensive care syndrome: a systematic review Nurs Crit Care 2024 29 4 807 823 38622971
Kalfon P Alessandrini M Boucekine M Renoult S Geantot MA Deparis-Dusautois S Berric A Collange O Floccard B Mimoz O et al. Tailored multicomponent program for discomfort reduction in critically ill patients may decrease post-traumatic stress disorder in general ICU survivors at 1 year Intensive Care Med 2019 45 2 223 235 30701294
Rousseau AF Prescott HC Brett SJ Weiss B Azoulay E Creteur J Latronico N Hough CL Weber-Carstens S Vincent JL et al. Long-term outcomes after critical illness: recent insights Crit Care 2021 25 1 108 33731201 7968190
Schmidt KFR Gensichen JS Schroevers M Kaufmann M Mueller F Schelling G Gehrke-Beck S Boede M Heintze C Wensing M et al. Trajectories of post-traumatic stress in sepsis survivors two years after ICU discharge: a secondary analysis of a randomized controlled trial Crit Care 2024 28 1 35 38287438 10823628
Jackson JC Pandharipande PP Girard TD Brummel NE Thompson JL Hughes CG Pun BT Vasilevskis EE Morandi A Shintani AK et al. Depression, post-traumatic stress disorder, and functional disability in survivors of critical illness in the BRAIN-ICU study: a longitudinal cohort study Lancet Respir Med 2014 2 5 369 379 24815803 4107313
Teixeira C Rosa RG Sganzerla D Sanchez EC Robinson CC Dietrich C Kochhann R de Souza D Rech GS da Rdsr et al. The burden of mental illness among survivors of critical Care-risk factors and impact on Quality of Life: a multicenter prospective cohort study Chest 2021 160 1 157 164 33640377
Maartmann-Moe CC Solberg MT Larsen MH Steindal SA Patients’ memories from intensive care unit: a qualitative systematic review Nurs Open 2021 8 5 2221 2234 33611859 8363378
Jones C Griffiths RD Humphris G Skirrow PM Memory, delusions, and the development of acute posttraumatic stress disorder-related symptoms after intensive care Crit Care Med 2001 29 3 573 580 1:STN:280:DC%2BD3M3os1yltg%3D%3D 11373423
Bruera E Kuehn N Miller MJ Selmser P Macmillan K The Edmonton symptom assessment system (ESAS): a simple method for the assessment of palliative care patients J Palliat Care 1991 7 2 6 9 1:STN:280:DyaK3Mzjt1OqtA%3D%3D 1714502
Nelson JE Meier DE Oei EJ Nierman DM Senzel RS Manfredi PL Davis SM Morrison RS Self-reported symptom experience of critically ill cancer patients receiving intensive care Crit Care Med 2001 29 2 277 282 1:STN:280:DC%2BD3M7pslentg%3D%3D 11246306
Ballard KS Identification of environmental stressors for patients in a surgical intensive care unit Issues Ment Health Nurs 1981 3 1–2 89 108 1:STN:280:DyaL3M3hsVyrsw%3D%3D 6909159
Novaes MA Aronovich A Ferraz MB Knobel E Stressors in ICU: patients’ evaluation Intensive Care Med 1997 23 12 1282 1285 1:STN:280:DyaK1c7jtVylsQ%3D%3D 9470087
Bulbuloglu S Cinar F Curuk GN The effect of environmental stressors on patient experience in medical, surgical, and COVID-19 intensive Care unit J Patient Exp 2022 9 23743735221092545 35434297 9008315
Kalfon P Mimoz O Auquier P Loundou A Gauzit R Lepape A Laurens J Garrigues B Pottecher T Malledant Y Development and validation of a questionnaire for quantitative assessment of perceived discomforts in critically ill patients Intensive Care Med 2010 36 10 1751 1758 20502874
Baumstarck K Boucekine M Estagnasie P Geantot MA Berric A Simon G Floccard B Signouret T Fromentin M Nyunga M et al. Assessment of patients’ self-perceived intensive care unit discomforts: validation of the 18-item version of the IPREA Health Qual Life Outcomes 2019 17 1 29 30732654 6367827
Verdonk F Feyaerts D Badenes R Bastarache JA Bougle A Ely W Gaudilliere B Howard C Kotfis K Lautrette A et al. Upcoming and urgent challenges in critical care research based on COVID-19 pandemic experience Anaesth Crit Care Pain Med 2022 41 5 101121 35781076 9245393
Johnson C, Aaronson N, Blazeby JM, Bottomley A, Fayers P, Koller M, Kulis D, Ramage J, Sprangers M, Velikova G et al. (2011) Guidelines for developing questionnaire modules. Eur Organisation Res Treat Cancer. https://www.eortc.org/app/uploads/sites/2/2018/02/guidelines_for_developing_questionnaire-_final.pdf
USDo H FDACfDe HS Research HU FDACfBe HS Research Health USDo, Human Services FDACfD, radiological H: guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance Health Qual Life Outcomes 2006 4 79
Saltnes-Lillegard C Rustoen T Beitland S Puntillo K Hagen M Lerdal A Hofso K Self-reported symptoms experienced by intensive care unit patients: a prospective observational multicenter study Intensive Care Med 2023 49 11 1370 1382 37812229 10622338
Ashkenazy S Weissman C DeKeyser Ganz F Perception of discomfort by mechanical ventilation patients in the intensive Care unit: a qualitative study Intensive Crit Care Nurs 2021 64 103016 33676810
Mokkink LB Prinsen CA Bouter LM Vet HC Terwee CB The COnsensus-based Standards for the selection of health measurement INstruments (COSMIN) and how to select an outcome measurement instrument Braz J Phys Ther 2016 20 2 105 113 26786084 4900032
Inouye SK van Dyck CH Alessi CA Balkin S Siegal AP Horwitz RI Clarifying confusion: the confusion assessment method. A new method for detection of delirium Ann Intern Med 1990 113 12 941 948 1:STN:280:DyaK3M%2Flt1yisQ%3D%3D 2240918
de Vet Hcw Terwee CB Mokkink LB Knol DL Measurement in medicine 2011 Cambridge University Press
Bartko JJ The intraclass correlation coefficient as a measure of reliability Psychol Rep 1966 19 1 3 11 1:STN:280:DyaF287mtVertw%3D%3D 5942109
Terwee CB Bot SD de Boer MR van der Windt DA Knol DL Dekker J Bouter LM de Vet HC Quality criteria were proposed for measurement properties of health status questionnaires J Clin Epidemiol 2007 60 1 34 42 17161752
Terwee CB Prinsen CAC Chiarotto A Westerman MJ Patrick DL Alonso J Bouter LM de Vet HCW Mokkink LB COSMIN methodology for evaluating the content validity of patient-reported outcome measures: a Delphi study Qual Life Res 2018 27 5 1159 1170 1:STN:280:DC%2BC1MnitlSjtQ%3D%3D 29550964 5891557
Beaton DE Bombardier C Guillemin F Ferraz MB Guidelines for the process of cross-cultural adaptation of self-report measures Spine (Phila Pa 1976) 2000 25 24 3186 3191 1:STN:280:DC%2BD3M7jt1Cmug%3D%3D 11124735
Basile MJ Rubin E Wilson ME Polo J Jacome SN Brown SM Heras La Calle G Montori VM Hajizadeh N Humanizing the ICU patient: a qualitative exploration of behaviors experienced by patients, caregivers, and ICU staff Crit Care Explor 2021 3 6 e 0463
Kalfon P Baumstarck K Estagnasie P Geantot MA Berric A Simon G Floccard B Signouret T Boucekine M Fromentin M et al. A tailored multicomponent program to reduce discomfort in critically ill patients: a cluster-randomized controlled trial Intensive Care Med 2017 43 12 1829 1840 29181557
Gunnels MS Reisdorf EM Mandrekar J Chlan LL Assessing discomfort in American Adult intensive Care patients Am J Crit Care 2024 33 2 126 132 38424019
