Benchmarking of survival outcomes following Haematopoietic Stem Cell Transplantation (HSCT): an update of the ongoing project of the European Society for Blood and Marrow Transplantation (EBMT) and Joint Accreditation Committee of ISCT and EBMT (JACIE)
Saccardi, R.; Putter, H.; Eikema, DJet al.
2023 • In Bone Marrow Transplantation, 58, p. 659-666
[en] From 2016 EBMT and JACIE developed an international risk-adapted benchmarking program of haematopoietic stem cell transplant
(HSCT) outcome to provide individual EBMT Centers with a means of quality-assuring the HSCT process and meeting FACT-JACIE
accreditation requirements relating to 1-year survival outcomes. Informed by previous experience from Europe, North America and
Australasia, the Clinical Outcomes Group (COG) established criteria for patient and Center selection, and a set of key clinical
variables within a dedicated statistical model adapted to the capabilities of the EBMT Registry. The first phase of the project was
launched in 2019 to test the acceptability of the benchmarking model through assessment of Centers’ performance for 1-year data
completeness and survival outcomes of autologous and allogeneic HSCT covering 2013–2016. A second phase was delivered in July
2021 covering 2015–2019 and including survival outcomes. Reports of individual Center performance were shared directly with
local principal investigators and their responses were assimilated. The experience thus far has supported the feasibility,
acceptability and reliability of the system as well as identifying its limitations. We provide a summary of experience and learning so
far in this ‘work in progress’, as well as highlighting future challenges of delivering a modern, robust, data-complete, risk-adapted
benchmarking program across new EBMT Registry systems.
Disciplines :
Hematology
Author, co-author :
Saccardi, R.
Putter, H.
Eikema, DJ
Busto, MP
McGrath, E.
Middelkoop, B.
Adams, G.
Atlija, M.
Ayuk, A.
Baldomero, H.
Beguin, Yves ; Centre Hospitalier Universitaire de Liège - CHU > > Service d'hématologie clinique
Benchmarking of survival outcomes following Haematopoietic Stem Cell Transplantation (HSCT): an update of the ongoing project of the European Society for Blood and Marrow Transplantation (EBMT) and Joint Accreditation Committee of ISCT and EBMT (JACIE)
Craddock C, Hoelzer D, Komanduri KV. Current status and future clinical directions in the prevention and treatment of relapse following hematopoietic transplantation for acute myeloid and lymphoblastic leukemia. Bone Marrow Transpl. 2019;54:6–16. DOI: 10.1038/s41409-018-0203-8
Saini N, Marin D, Ledesma C, Delgado R, Rondon G, Popat UR, et al. Impact of TKIs post-allogeneic hematopoietic cell transplantation in Philadelphia chromosome-positive ALL. Blood. 2020;136:1786–9. DOI: 10.1182/blood.2019004685
Schlenk RF, Weber D, Fiedler W, Salih HR, Wulf G, Salwender H, et al. Midostaurin added to chemotherapy and continued single-agent maintenance therapy in acute myeloid leukemia with FLT3-ITD. Blood. 2019;133:840–51. DOI: 10.1182/blood-2018-08-869453
Burchert A. Maintenance therapy for FLT3-ITD-mutated acute myeloid leukemia. Haematologica. 2021;106:664–70. DOI: 10.3324/haematol.2019.240747
Chabannon C, Kuball J, Bondanza A, Dazzi F, Pedrazzoli P, Toubert A, et al. Hematopoietic stem cell transplantation in its 60s: A platform for cellular therapies. Sci Transl Med. 2018;10:eaap9630. DOI: 10.1126/scitranslmed.aap9630
Passweg JR, Baldomero H, Bader P, Bonini C, Duarte RF, Dufour C, et al. Use of haploidentical stem cell transplantation continues to increase: the 2015 European Society for Blood and Marrow Transplant activity survey report. Bone Marrow Transpl. 2017;52:811–7. DOI: 10.1038/bmt.2017.34
Nagler A, Labopin M, Houhou M, Aljurf M, Mousavi A, Hamladji RM, et al. Outcome of haploidentical versus matched sibling donors in hematopoietic stem cell transplantation for adult patients with acute lymphoblastic leukemia: a study from the Acute Leukemia Working Party of the European Society for Blood and Marrow Transplantation. J Hematol Oncol. 2021;14:53. DOI: 10.1186/s13045-021-01065-7
Sanz J, Galimard JE, Labopin M, Afanasyev B, Sergeevich MI, Angelucci E, et al. Post-transplant cyclophosphamide containing regimens after matched sibling, matched unrelated and haploidentical donor transplants in patients with acute lymphoblastic leukemia in first complete remission, a comparative study of the ALWP of the EBMT. J Hematol Oncol. 2021;14:84. DOI: 10.1186/s13045-021-01094-2
Dongelmans DA, Pilcher D, Beane A, Soares M, Del Pilar Arias Lopez M, Fernandez A, et al. Linking of global intensive care (LOGIC): An international benchmarking in critical care initiative. J Crit Care. 2020;60:305–10. DOI: 10.1016/j.jcrc.2020.08.031
Reponen E, Rundall TG, Shortell SM, Blodgett JC, Juarez A, Jokela R, et al. Benchmarking outcomes on multiple contextual levels in lean healthcare: a systematic review, development of a conceptual framework, and a research agenda. BMC Health Serv Res. 2021;21:161. DOI: 10.1186/s12913-021-06160-6
von Eiff W. International benchmarking and best practice management: in search of health care and hospital excellence. Adv Health Care Manag. 2015;17:223–52. DOI: 10.1108/S1474-823120140000017014
Snowden JA, Saccardi R, Orchard K, Ljungman P, Duarte RF, Labopin M, et al. Benchmarking of survival outcomes following haematopoietic stem cell transplantation: A review of existing processes and the introduction of an international system from the European Society for Blood and Marrow Transplantation (EBMT) and the Joint Accreditation Committee of ISCT and EBMT (JACIE). Bone Marrow Transpl. 2020;55:681–94. DOI: 10.1038/s41409-019-0718-7
Armand P, Kim HT, Logan BR, Wang Z, Alyea EP, Kalaycio ME, et al. Validation and refinement of the Disease Risk Index for allogeneic stem cell transplantation. Blood. 2014;123:3664–71. DOI: 10.1182/blood-2014-01-552984
Grimwade D, Hills RK, Moorman AV, Walker H, Chatters S, Goldstone AH, et al. Refinement of cytogenetic classification in acute myeloid leukemia: determination of prognostic significance of rare recurring chromosomal abnormalities among 5876 younger adult patients treated in the United Kingdom Medical Research Council trials. Blood. 2010;116:354–65. DOI: 10.1182/blood-2009-11-254441
Sorror ML, Storer B, Storb RF. Validation of the hematopoietic cell transplantation-specific comorbidity index (HCT-CI) in single and multiple institutions: limitations and inferences. Biol Blood Marrow Transpl. 2009;15:757–8. DOI: 10.1016/j.bbmt.2009.02.007
Berro M, Arbelbide JA, Rivas MM, Basquiera AL, Ferini G, Vitriu A, et al. Hematopoietic cell transplantation-specific comorbidity index predicts morbidity and mortality in autologous stem cell transplantation. Biol Blood Marrow Transpl. 2017;23:1646–50. DOI: 10.1016/j.bbmt.2017.06.014
Saad A, Mahindra A, Zhang MJ, Zhong X, Costa LJ, Dispenzieri A, et al. Hematopoietic cell transplant comorbidity index is predictive of survival after autologous hematopoietic cell transplantation in multiple myeloma. Biol Blood Marrow Transpl. 2014;20:402–8.e1. DOI: 10.1016/j.bbmt.2013.12.557
Sorror ML, Storb RF, Sandmaier BM, Maziarz RT, Pulsipher MA, Maris MB, et al. Comorbidity-age index: a clinical measure of biologic age before allogeneic hematopoietic cell transplantation. J Clin Oncol. 2014;32:3249–56. DOI: 10.1200/JCO.2013.53.8157
Putter H, Eikema DJ, de Wreede LC, McGrath E, Sanchez-Ortega I, Saccardi R, et al. Benchmarking survival outcomes: A funnel plot for survival data. Stat Methods Med Res. 2022;31:1171–1183. DOI: 10.1177/09622802221084130
van Buuren S, Boshuizen HC, Knook DL. Multiple imputation of missing blood pressure covariates in survival analysis. Stat Med. 1999;18:681–94. DOI: 10.1002/(SICI)1097-0258(19990330)18:6<681::AID-SIM71>3.0.CO;2-R
White IR, Royston P. Imputing missing covariate values for the Cox model. Stat Med. 2009;28:1982–98. DOI: 10.1002/sim.3618
Dohner H, Estey E, Grimwade D, Amadori S, Appelbaum FR, Buchner T, et al. Diagnosis and management of AML in adults: 2017 ELN recommendations from an international expert panel. Blood. 2017;129:424–47. DOI: 10.1182/blood-2016-08-733196
Gratwohl A, Brand R, McGrath E, van Biezen A, Sureda A, Ljungman P, et al. Use of the quality management system “JACIE” and outcome after hematopoietic stem cell transplantation. Haematologica. 2014;99:908–15. DOI: 10.3324/haematol.2013.096461
Marmor S, Begun JW, Abraham J, Virnig BA. The impact of center accreditation on hematopoietic cell transplantation (HCT). Bone Marrow Transpl. 2015;50:87–94. DOI: 10.1038/bmt.2014.219
Shouval R, Labopin M, Bomze D, Baerlocher GM, Capria S, Blaise D, et al. Risk stratification using FLT3 and NPM1 in acute myeloid leukemia patients autografted in first complete remission. Bone Marrow Transpl. 2020;55:2244–53. DOI: 10.1038/s41409-020-0936-z
Shouval R, Fein JA, Labopin M, Cho C, Bazarbachi A, Baron F, et al. Development and validation of a disease risk stratification system for patients with haematological malignancies: a retrospective cohort study of the European Society for Blood and Marrow Transplantation registry. Lancet Haematol. 2021;8:e205–e15. DOI: 10.1016/S2352-3026(20)30394-X
Snowden JA, McGrath E, Orchard K, Kroger N, Sureda A, Gratwohl A. Visions for a JACIE quality management system 4.0. Bone Marrow Transplant. 2021;56:2876–81.