[en] We aimed to assess the validity (criterion and cross-cultural validity) and reliability of the first occupational burnout (OB) detection tool designed for healthcare professionals in Belgium in the context of Swiss medical practice. Methods: First, we assessed the sensitivity and specificity of the Tool. We developed this tool based on the consultation reports of 42 patients and compared its detection to the results of the Oldenburg Burnout Inventory (OLBI), filled-in by patients before a consultation. Second, we performed an inter-rater reliability (IRR) assessment on the OB symptoms and detection reached by the Tool between a psychiatrist, two psychologists, and an occupational physician. Results: The Tool correctly identified over 80% of patients with OB, regardless of the cutoff value used for OLBI scores, reflecting its high sensitivity. Conversely, its
specificity strongly varied depending on the OLBI cutoff. There was a slight to fair overall greement
between the four raters on the detection of OB and the number of OB symptoms. Around 41%
of symptoms showed a substantial to an almost perfect agreement, and 36% showed a slight to a
moderate agreement. Conclusions: The Tool seems useful for identifying OB of moderate and strong severity in both the Belgian and Swiss contexts
Disciplines :
Social, industrial & organizational psychology Public health, health care sciences & services
Author, co-author :
Nguyen Huynh, Agathe; University of Lausanne > Department of Occupational and Environmental Health > Center for Primary Care an Public Health (UNISANTE)
Besse, Christine; CHUV > Department of Psychiatry
Mediouni, Zakia; University of Lausanne > Departement of Occupational and Environmental Health > Center for Primary Care and Public Health (UNISANTE)
El May, Emma; University of Lausanne > Department of Occupational and Environmental Health > Center for Primary Care and Public Health (UNISANTE)
Shoman, Yara; University of Lausanne > Department of Occupational and Environmental Health > Center for Primary Care and Public Health (UNISANTE)
Hansez, Isabelle ; Université de Liège - ULiège > Département de Psychologie > Valorisation des ressources humaines
Guseva Canu, Irina; University of Lausanne > Department of Occupational and Environmental Health > Center for Primary Care and Public Health (UNISANTE)
Language :
English
Title :
Diagnostic Performances of an Occupational Burnout Detection Method Designed for Healthcare Professionals
Publication date :
2021
Journal title :
International Journal of Environmental Research and Public Health
ISSN :
1660-4601
eISSN :
1661-7827
Publisher :
Multidisciplinary Digital Publishing Institute (MDPI), Basel, Switzerland
Volume :
18
Pages :
12300
Peer reviewed :
Peer Reviewed verified by ORBi
Funders :
General Directorate of Health of the Canton of Vaud
Guseva Canu, I.; Marca, S.C.; Dell’Oro, F.; Balázs, Á.; Bergamaschi, E.; Besse, C.; Bianchi, R.; Bislimovska, J.; Bjelajac, A.K.; Buggez, M.; et al. Harmonized definition of occupational burnout: A systematic review, semantic analysis, and Delphi consensus in 29 countries. Scand. J. Work. Environ. Health 2021, 47, 95–107. [CrossRef] [PubMed]
Rotenstein, L.; Torre, M.; Ramos, M.; Rosales, R.; Guille, C.; Sen, S.; Mata, D. Prevalence of burnout among physicians: A systematic review. J. Am. Med. Assoc. 2018, 320, 1131–1150. [CrossRef]
Ackerley, G.; Burnell, J.; Holder, D.; Kurdek, L. Burnout among licensed psychologists. Prof. Psychol. Res. Pract. 1988, 19, 624–631. [CrossRef]
Demerouti, E.; Bakker, A.; Nachreiner, F.; Schaufeli, W. The job demands-resources model of burnout. J. Appl. Psychol. 2001, 86, 499–512. [CrossRef] [PubMed]
Kristensen, T.; Borritz, M.; Villadsen, E.; Christensen, K. The Copenhagen burnout inventory: A new tool for the assessment of burnout. Work Stress 2005, 19, 192–207. [CrossRef]
Maslach, C.; Jackson, S.E.; Leiter, M.P. Maslach Burnout Inventory Manual, 3rd ed.; CPP, Inc: Mountain View, CA, USA, 1996.
Pines, A.; Aronson, E. Burnout: From Tedium to Personal Growth; Freedom Press: New York, NY, USA, 1981.
Marca, S.C.; Paatz, P.; Györkös, C.; Cuneo, F.; Bugge, M.D.; Godderis, L.; Bianchi, R.; Canu, I.G. Validation of questionnaires and rating scales used in medicine: Protocol for a systematic review of burnout self-reported measures. medRxiv 2020. [CrossRef]
Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C. The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes. J. Clin. Epidemiol. 2010, 63, 737–745. [CrossRef]
Shoman, Y.; Marca, S.; Bianchi, R.; Godderis, L.; van der Molen, H.; Guseva Canu, I. Psychometric properties of burnout measures: A systematic review. Epidemiol. Psychiatr. Sci. 2021, 30, E8. [CrossRef]
Service Public Fédéral. Détection Précoce du Burnout: Outil Pour le Médecin Généraliste Burnout (Early Detection of Burnout: BPSEWS Tool for the General Physician); 2020; Available online: https://www.souffrance-et-travail.com/magazine/burn-out/outil-de-detection-precoce-du-burn-out/(accessed on 18 November 2021).
Hansez, I.; Mairiaux, P.; Firket, P.; Braeckman, L. Recherche sur le Burnout au Sein de la Population Active Belge: Rapport Final (Research on Burnout in the Active Belgian Population: Final Report); 2010; Available online: https://orbi.uliege.be/handle/2268/90274 (accessed on 18 November 2021).
Hansez, I.; Rusu, D.; Firket, P.; Braeckman, L. Evolution 2010–2018 du Burnout en Belgique et Intérêt de L’utilisation Conjointe de Deux Outils de Diagnostic (Evolution 2010–2018 of Burnout in Belgium and the Benefit of a Joined Usage of Two Diagnostic BPSEWS Tools); 2019; Available online: https://emploi.belgique.be/sites/default/files/content/documents/Bien-%C3%AAtre%20au%20 travail/Projets%20de%20recherche/rapport_final_SPF_burnout.pdf (accessed on 18 November 2021).
Service Public Fédéral. Projets Pilote Prévention Intégrée Contre le Burnout (Pilot Projects for an Integrated Prevention of Burnout). Available online: https://socialsecurity.belgium.be/fr/elaboration-de-la-politique-sociale/projets-pilote-prevention-integree-contre-le-burn-out (accessed on 10 February 2020).
Schaufeli, W.B.; Taris, T.W. The conceptualization and measurement of burnout: Common ground and worlds apart The views expressed in Work & Stress Commentaries are those of the author(s), and do not necessarily represent those of any other person or organization, or of the journal. Work Stress 2005, 19, 256–262.
Hansez, I.; Firket, P.; Leclercq, C. Stades du Burnout et le Type de Prévention Approprié Selon le Stade. “Burnout: Les Clefs Pour Agir”. Available online: https://www.health.belgium.be/fr/stades-du-burnout-et-le-type-de-prevention-approprie-selon-le-stade (accessed on 12 December 2019).
Leclercq, C.; Braeckman, L.; Firket, P.; Babic, A.; Hansez, I. Interest of a joint use of two diagnostic tools of burnout: Comparison between the Oldenburg burnout inventory and the early detection tool of burnout completed by physicians. Int. J. Environ. Res. Public Health 2021, 18, 10544. [CrossRef]
Meirte, J.; Hellemans, N.; Anthonissen, M.; Denteneer, L.; Maertens, K.; Moortgat, P.; Van Daele, U. Benefits and disadvantages of electronic patient-reported outcome measures: Systematic review. JMIR Perioper. Med. 2020, 3, e15588. [CrossRef] [PubMed]
Turner, G.M.; Litchfield, I.; Finnikin, S.; Aiyegbusi, O.L.; Calvert, M. General practitioners’ views on use of patient reported outcome measures in primary care: A cross-sectional survey and qualitative study. BMC Fam. Pract. 2020, 21, 14. [CrossRef] [PubMed]
Nguyen Huynh, A.; Béguelin, A.; Krief, P.; Marion-Veyron, R.; Mediouni, Z.; Regamey, F.; Staeger, P.; Guseva Canu, I. Detection and treatment of burnout by physicians of Unisanté. Revue Médicale Suisse 2021, 27, 221–224.
Besse, C.; Grolimund Berset, D.; Studer, R.; Quarroz, S.; Praz-Christinaz, S.M.; Rivier, G.; Barlet-Ghaleb, C.; Danuser, B.; Bonsack, C. Consultation pluridisciplinaire “souffrance au travail”: Une exprérience romande (Multidisciplinary consultation “suffering at work”: An french-speaking Swiss experience). Revue Médicale Suisse 2016, 12, 276–279. [PubMed]
Bouter, L.; Zielhuis, G.; Zeegers, M. Diagnostic and prognostic research. In Textbook of Epidemiology; Bohn, Stafleu van Loghum: Houten, The Netherlands; Vrije Universiteit Amsterdam: Amsterdam, The Netherlands, 2017; pp. 171–201.
Nahavandi, K. Calculating sensitivity, specificity and predictive values for medical diagnostic tests. Gene Cell Tissue 2018, 5, 1–2. [CrossRef]
Power, M.; Fell, G.; Wright, M. Principles for high-quality, high-value testing. BMJ Evid. Based Med. 2013, 18, 5–10. [CrossRef]
StataCorp. Stata Statistical Software: Release 16; StataCorp LLC: College Station, TX, USA, 2019.
Cohen, J. A coefficient of agreement for nominal scales. Educ. Psychol. Meas. 1960, 20, 37–46. [CrossRef]
Light, R. Measures of response agreement for qualitative data: Some generalizations and alternatives. Psychol. Bull. 1971, 76, 365–377. [CrossRef]
Hallgren, K. Computing inter-rater reliability for observational data: An overview and tutorial. Tutor. Quant. Methods Psychol. 2012, 8, 23–34. [CrossRef]
Byrt, T.; Bishop, J.; Carlin, J. Bias, prevalence and kappa. J. Clin. Epidemiol. 1993, 46, 423–429. [CrossRef]
Siegel, S.; Castellan, N.J. Non Parametric Statistics for the Behavioral Sciences; McGraw-Hill Book Company: New York, NY, USA, 1988.
Landis, J.; Koch, G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [CrossRef] [PubMed]
McGraw, K.O.; Wong, S.P. Forming inferences about some intraclass correlation coefficients. Psychol. Methods 1996, 1, 30–46. [CrossRef]
Cicchetti, D. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol. Assess. 1994, 6, 284–290. [CrossRef]
Team, R.D.C. R: A Language Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2019.
Leiter, M.P.; Maslach, C. The impact of interpersonal environment on burnout and organizational commitment. J. Organ. Behav. 1988, 9, 297–308. [CrossRef]
Mäkikangas, A.; Kinnunen, U. The person-oriented approach to burnout: A systematic review. Burn. Res. 2016, 3, 11–23. [CrossRef]
World Health Organization. International Classification of Diseases for Mortality and Morbidity Statistics the Tenth Revision; WHO: Geneva, Switzerland, 2010.
Schaufeli, W.B.; Desart, S.; De Witte, H. Burnout assessment tool (BAT)-development, validity, and reliability. Int. J. Environ. Res. Public Health 2020, 17, 9495. [CrossRef]
Bianchi, R.; Schonfeld, I.; Laurent, E. Burnout–depression overlap: A review. Clin. Psychol. Rev. 2015, 36, 28–41. [CrossRef]
Guseva Canu, I.; Mesot, O.; Györkös, C.; Mediouni, Z.; Mehlum, I.S.; Bugge, M.D. Burnout syndrome in Europe: Towards a harmonized approach in occupational health practice and research. Ind. Health 2019, 57, 745–752. [CrossRef]
