Team training; patient safety; interdisciplinary; surveys; teamwork
Abstract :
[en] Teamwork training and evaluation are essential to enhance safety and quality of care. The lack of the psychometric testing of the TeamSTEPPS® Teamwork Attitudes Questionnaire (T-TAQ) and Teamwork Perceptions Questionnaire (T-TPQ) across different language and cultural settings has questioned their widespread use because such attitudes and perceptions are highly subjective and context-bound. The present study aims to translate the T-TAQ and T-TPQ into the French language and validate the psycho- metric properties of the two questionnaires in a public health context. A forward-backward translation process, panel reviewing, and pilot testing in two rounds were followed to develop the French versions. Confirmatory factor analysis (CFA) and Cronbach’s alpha were used to examine the factor structure and internal consistency, whereas two-way mixed Intraclass Correlation Coefficient (ICC) was performed to assess test-retest reliability. A total of 235 healthcare professionals in the French-speaking community of Belgium completed the T-TAQ and T-TPQ. After two to four weeks, 102 participants took part in the second round. Despite good fit indices as revealed by the CFA and Cronbach’s alpha from 0.53 to 0.75 for the five dimensions of the T-TAQ and 0.76 to 0.79 for the T-TPQ, the squared correlations among the constructs were higher than the average variance extracted. Two-way mixed ICCs indicated fair to good test-retest reliability for all the five constructs of the two questionnaires, except the leadership scale of the T-TAQ. The French-language versions of the T-TAQ and T-TPQ were semantically equivalent and culturally relevant with adequate test-retest reliability as compared to the English versions. These two instruments might be used to capture the overall attitude toward teamwork and perceptions of team skills and behaviors. Yet, further research is advisable to refine the scales to establish the discriminant validity of the different dimensions and discriminative power of the instruments.
Disciplines :
Education & instruction
Author, co-author :
Diep, Anh Nguyet ✱; Université de Liège - ULiège > Département des sciences de la santé publique > Simulation en santé publique
PAQUAY, Méryl ✱; Centre Hospitalier Universitaire de Liège - CHU > Autres Services Médicaux > Service des urgences
Servotte, Jean-Christophe; Haute Ecole Namur-Liège-Luxembourg > Cellule Recherche & Développement Centre Namur Simulation
Dardenne, Nadia ; Université de Liège - ULiège > Département des sciences de la santé publique > Biostatistique
Istas, Laure; Plateforme Pour l’Amélioration Continue de la Qualité des Soins et de la Sécurité des Patients, Brussels, Belgium
Van Ngoc, Pauline ; Université de Liège - ULiège > Département des sciences cliniques > Médecine générale
Charlier, Mathilde
GHUYSEN, Alexandre ✱; Centre Hospitalier Universitaire de Liège - CHU > Autres Services Médicaux > Service des urgences
Donneau, Anne-Françoise ✱; Université de Liège - ULiège > Département des sciences de la santé publique > Biostatistique
✱ These authors have contributed equally to this work.
Language :
English
Title :
Validation of a French-language version of TeamSTEPPS® T-TPQ and T-TAQ questionnaires
Baker, D., Salas, E., Barach, P., Battles, J., & King, H., (2007). The relation between teamwork and patient safety. In Carayon P. (ed.): Handbook of human factors and ergonomics in health care and patient safety. Mahwah, NJ: Lawrence Erlbaum (pp. 259–271).
Baker, D. P., Amodeo, A. M., Krokos, K. J., Slonim, A., & Herrera, H., (2010). Assessing teamwork attitudes in healthcare: Development of the TeamSTEPPS teamwork attitudes questionnaire. Quality & Safety in Health Care, 19 (6), 1–4. DOI: 10.1136/qshc.2009.036129.
Baker, D. P., Krokos, K. J., & Amodeo, A. M., (2008). TeamSTEPPS teamwork attitudes questionnaire manual. Washington, DC: American Institutes for Research.
Baker, D. P., Salas, E., King, H., Battles, J., & Barach, P., (2005). The role of teamwork in the professional education of physicians: Current status and assessment recommendations. The Joint Commission Journal on Quality and Patient Safety, 31 (4), 185–202. https://doi.org/10.1016/S1553-7250(05)31025-7
Ballangrud, R., Husebø, S. E., & Hall-Lord, M. L., (2017). Cross-cultural validation and psychometric testing of the Norwegian version of the TeamSTEPPS® teamwork perceptions questionnaire. BMC Health Services Research, 17 (1), 799. https://doi.org/10.1186/s12913-017-2733-y
Ballangrud, R., Husebø, S. E., & Hall-Lord, M. L., (2020). Cross-cultural validation and psychometric testing of the Norwegian version of TeamSTEPPS teamwork attitude questionnaire. Journal of Interprofessional Care, 34 (1), 116–123. https://doi.org/10.1080/13561820.2019.1638759
Beaton, D. E., Bombardier, C., Guillemin, F., & Ferraz, M. B., (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine, 25 (24), 3186–3191. https://doi.org/10.1097/00007632-200012150-00014
Bentler, P. M., & Chou, C.-P., (1987). Practical issues in structural modeling. Sociological Methods & Research, 16 (1), 78–117. https://doi.org/10.1177/0049124187016001004
Brandão, C. S., Fernandes, D. C., Collares, C. F., Fernandes, G. R., & Marin, H. F., (2016). Tradução e retrotradução do instrumento de avaliação do trabalho em equipe TeamSTEPPS® para uso no ensino por simulação no Brasil. Scientia Medica, 26 (4), 13. https://doi.org/10.15448/1980-6108.2016.4.24622
Capella, J., Smith, S., Philp, A., Putnam, T., Gilbert, C., Fry, W., Harvey, E., Wright, A., Henderson, K., Baker, D., Ranson, S., & ReMine, S., (2010). Teamwork training improves the clinical care of trauma patients. Journal of Surgical Education, 67 (6), 439–443. https://doi.org/10.1016/j.jsurg.2010.06.006
Castner, J., Foltz-Ramos, K., Schwartz, D. G., & Ceravolo, D. J., (2012). A leadership challenge: Staff nurse perceptions after an organizational TeamSTEPPS initiative. Journal of Nursing Administration, 42 (10), 467–472. https://doi.org/10.1097/NNA.0b013e31826a1fc1
Core Team, R., (2013). R: A language and environment for statistical computer. R Foundation for Statistical Computing, Vienna, Austria. https://www.r-project.org
Flin, R. H., O’Connor, P., & Crichton, M., (2008). Safety at the sharp end: A guide to non-technical skills. Ashgate Publishing, Ltd.
Floyd, F. J., & Widaman, K. F., (1995). Factor analysis in the development and refinement of clinical assessment instruments. Psychological Assessment, 7 (3), 286–299. https://doi.org/10.1037/1040-3590.7.3.286
Forse, R. A., Bramble, J. D., & McQuillan, R., (2011). Team training can improve operating room performance. Surgery, 150 (4), 771–778. https://doi.org/10.1016/j.surg.2011.07.076
Hall-Lord, M. L., Bååth, C., Ballangrud, R., & Nordin, A., (2021). The Swedish version of the TeamSTEPPS® teamwork attitudes questionnaire (T-TAQ): A validation study. BMC Health Services Research, 21 (1), 1–8. https://doi.org/10.1186/s12913-021-06111-1
Harlow, L. L., (2014). The essence of multivariate thinking: Basic themes and methods. Routledge.
Hopkins, W. G., (2000). Measures of reliability in sports medicine and science. Sports Medicine, 30 (1), 1–15. https://doi.org/10.2165/00007256-200030010-00001
Howe, E. E., (2014). Empowering certified nurse’s aides to improve quality of work life through a team communication program. Geriatric Nursing, 35 (2), 132–136. https://doi.org/10.1016/j.gerinurse.2013.11.004
Hu, L.-T., & Bentler, P. M., (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6 (1), 1–55. https://doi.org/10.1080/10705519909540118
Hwang, J.-I., & Ahn, J., (2015). Teamwork and clinical error reporting among nurses in Korean hospitals. Asian Nursing Research, 9 (1), 14–20. https://doi.org/10.1016/j.anr.2014.09.002
Keebler, J. R., Dietz, A. S., Lazzara, E. H., Benishek, L. E., Almeida, S. A., Toor, P. A., King, H. B., & Salas, E., (2014). Validation of a teamwork perceptions measure to increase patient safety. BMJ Quality & Safety, 23 (9), 718–726. https://doi.org/10.1136/bmjqs-2013-001942
Kohn, L. T., Corrigan, J. M., & Donaldson, M. S., (2000). Institute of Medicine (US) Committee on Quality of Health Care in America. In To err is human: Building a safer health system. National Academies.
Koo, T. K., & Li, M. Y., (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. Journal of Chiropractic Medicine, 15 (2), 155–163. https://doi.org/10.1016/j.jcm.2016.02.012
Körner, M., Wirtz, M. A., Bengel, J., & Göritz, A. S., (2015). Relationship of organizational culture, teamwork and job satisfaction in interprofessional teams. BMC Health Services Research, 15 (1), 243. https://doi.org/10.1186/s12913-015-0888-y
Lakatamitou, I., Lambrinou, E., Kyriakou, M., Paikousis, L., & Middleton, N., (2020). The Greek versions of the TeamSTEPPS teamwork perceptions questionnaire and Minnesota satisfaction questionnaire “short form”. BMC Health Services Research, 20 (1), 587. https://doi.org/10.1186/s12913-020-05451-8
Lynn, M. R., (1986). Determination and quantification of content validity. Nursing Research, 35 (6), 382–385. https://doi.org/10.1097/00006199-198611000-00017
MacKenzie, S. B., & Podsakoff, P. M., (2012). Common method bias in marketing: Causes, mechanisms, and procedural remedies. Journal of Retailing, 88 (4), 542–555. https://doi.org/10.1016/j.jretai.2012.08.001
Manser, T., (2009). Teamwork and patient safety in dynamic domains of healthcare: A review of the literature. Acta Anaesthesiologica Scandinavica, 53 (2), 143–151. https://doi.org/10.1111/j.1399-6576.2008.01717.x
Marsh, H. W., (1986). Negative item bias in ratings scales for preadolescent children: A cognitive-developmental phenomenon. Developmental Psychology, 22 (1), 37. https://doi.org/10.1037/0012-1649.22.1.37
Mayer, C. M., Cluff, L., Lin, W.-T., Willis, T. S., Stafford, R. E., Williams, C., Saunders, R., Short, K. A., Lenfestey, N., Kane, H. L., & Amoozegar, J. B., (2011). Evaluating efforts to optimize TeamSTEPPS implementation in surgical and pediatric intensive care units. The Joint Commission Journal on Quality and Patient Safety, 37 (8), 365–374. https://doi.org/10.1016/S1553-7250(11)37047-X
Neily, J., Mills, P. D., Young-Xu, Y., Carney, B. T., West, P., Berger, D. H., Mazzia, L. M., Paull, D. E., & Bagian, J. P., (2010). Association between implementation of a medical team training program and surgical mortality. Jama, 304 (15), 1693–1700. https://doi.org/10.1001/jama.2010.1506
Peberdy, M. A., Kaye, W., Ornato, J. P., Larkin, G. L., Nadkarni, V., Mancini, M. E., Nichol, G., Lane-Trultt, T., & R A., B., (2003). Cardiopulmonary resuscitation of adults in the hospital: A report of 14 720 cardiac arrests from the National Registry of Cardiopulmonary Resuscitation. Resuscitation, 58 (3), 297–308. https://doi.org/10.1016/S0300-9572(03)00215-6
Qu, J., Zhu, Y., Cui, L., Yang, L., Lai, Y., Ye, X., & Qu, B., (2020). Psychometric properties of the Chinese version of the TeamSTEPPS teamwork perceptions questionnaire to measure teamwork perceptions of Chinese residents: A cross-sectional study. BMJ Open, 10 (11), e039566. https://doi.org/10.1136/bmjopen-2020-039566
Salas, E., Sims, D. E., & Burke, C., (2005). Is there a “Big Five” in teamwork? Small Group Research, 36 (5), 555–599. https://doi.org/10.1177/1046496405277134
Silva, R., Saraiva, M., Cardoso, T., & Aragão, I. C., (2016). Medical Emergency Team: How do we play when we stay? Characterization of MET actions at the scene. Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, 24 (1), 1–6. https://doi.org/10.1186/s13049-016-0222-7
Sousa, V. D., & Rojjanasrirat, W., (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17 (2), 268–274. https://doi.org/10.1111/j.1365-2753.2010.01434.x
Staines, A., Lécureux, E., Rubin, P., Baralon, C., & Farin, A., (2020). Impact of TeamSTEPPS on patient safety culture in a Swiss maternity ward. International Journal for Quality in Health Care, 32 (9), 618–624. https://doi.org/10.1093/intqhc/mzz062
Stevens, M. J., & Campion, M. A., (1999). Staffing work teams: Development and validation of a selection test for teamwork settings. Journal of Management, 25 (2), 207–228. https://doi.org/10.1177/014920639902500205
Terwee, C., Bot, S., De Boer, M., Van Der Windt, D., Knol, D., Dekker, J., Bouter, L., & De Vet, H., (2007). Quality criteria were proposed for measurement properties of health status questionnaires. Journal of Clinical Epidemiology, 60 (1), 34–42. https://doi.org/10.1016/j.jclinepi.2006.03.012
Thomas, L., & Galla, C., (2013). Building a culture of safety through team training and engagement. BMJ Quality & Safety, 22 (5), 425–434. https://doi.org/10.1136/bmjqs-2012-001011
Unoki, T., Matsuishi, Y., Tsujimoto, T., Yotsumoto, R., Yamada, T., Komatsu, Y., Kashiwakura, D., & Yamamoto, N., (2021). Translation, reliability and validity of Japanese version the TeamSTEPPS® teamwork perceptions questionnaire. Nursing Open, 8 (1), 115–122. https://doi.org/10.1002/nop2.609
Weaver, S. J., Rosen, M. A., DiazGranados, D., Lazzara, E. H., Lyons, R., Salas, E., Knych, S. A., McKeever, M., Adler, L., Barker, M., & King, H. B., (2010). Does teamwork improve performance in the operating room? A multilevel evaluation. The Joint Commission Journal on Quality and Patient Safety, 36 (3), 133–142. https://doi.org/10.1016/S1553-7250(10)36022-3
Weir, J. P., (2005). Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. The Journal of Strength & Conditioning Research, 19 (1), 231–240. https://pubmed.ncbi.nlm.nih.gov/15705040/
Weld, L. R., Stringer, M. T., Ebertowski, J. S., Baumgartner, T. S., Kasprenski, M. C., Kelley, J. C., Cho, D. S., Tieva, E. A., & Novak, T. E., (2016). TeamSTEPPS improves operating room efficiency and patient safety. American Journal of Medical Quality, 31 (5), 408–414. https://doi.org/10.1177/1062860615583671
Winters, B. D., Weaver, S. J., Pfoh, E. R., Yang, T., Pham, J. C., & Dy, S. M., (2013). Rapid-response systems as a patient safety strategy: A systematic review. Annals of Internal Medicine, 158 (5_Part_2), 417–425. https://doi.org/10.7326/0003-4819-158-5-201303051-00009
Wolk, C. B., Locke, J., Salas, E., Eiraldi, R., Cronholm, P. F., & Mandell, D., (2020). An examination of the factor structure of TeamSTEPPS measures in school mental health teams. Journal of Psychologists and Counsellors in Schools, 30 (2), 172–184. https://doi.org/10.1017/jgc.2019.18
