Enhancing individual glomerular filtration rate assessment: can we trust the equation? Development and validation of machine learning models to assess the trustworthiness of estimated GFR compared to measured GFR. - 2025
Enhancing individual glomerular filtration rate assessment: can we trust the equation? Development and validation of machine learning models to assess the trustworthiness of estimated GFR compared to measured GFR.
Lanot, Antoine; Akesson, Anna; Nakano, Felipe Kenjiet al.
Chronic kidney disease; Creatinine; Glomerular filtration rate; Machine learning; Random forest; Humans; Male; Female; Middle Aged; Aged; Adult; Creatinine/blood; Cohort Studies; Machine Learning/standards; Glomerular Filtration Rate/physiology; Kidney Function Tests/methods; Kidney Function Tests/standards; Algorithms; Young Adult; Nephrology
Abstract :
[en] [en] BACKGROUND: Creatinine-based estimated glomerular filtration rate (eGFR) equations are widely used in clinical practice but exhibit inherent limitations. On the other side, measuring GFR is time consuming and not available in routine clinical practice. We developed and validated machine learning models to assess the trustworthiness (i.e. the ability of equations to estimate measured GFR (mGFR) within 10%, 20% or 30%) of the European Kidney Function Consortium (EKFC) equation at the individual level.
METHODS: This observational study used data from European and US cohorts, comprising 22,343 participants of all ages with available mGFR results. Four machine learning and two traditional logistic regression models were trained on a cohort of 9,202 participants to predict the likelihood of the EKFC creatinine-derived eGFR falling within 30% (p30), 20% (p20) or 10% (p10) of the mGFR value. The algorithms were internally and then externally validated on cohorts of respectively 3,034 and 10,107 participants. The predictors included in the models were creatinine, age, sex, height, weight, and EKFC.
RESULTS: The random forest model was the most robust model. In the external validation cohort, the model achieved an area under the curve of 0.675 (95%CI 0.660;0.690) and an accuracy of 0.716 (95%CI 0.707;0.725) for the P30 criterion. Sensitivity was 0.756 (95%CI 0.747;0.765) and specificity was 0.485 (95%CI 0.460; 0.511) at the 80% probability level that EKFC falls within 30% of mGFR. At the population level, the PPV of this machine learning model was 89.5%, higher than the EKFC P30 of 85.2%. A free web-application was developed to allow the physician to assess the trustworthiness of EKFC at the individual level.
CONCLUSIONS: A strategy using machine learning model marginally improves the trustworthiness of GFR estimation at the population level. An additional value of this approach lies in its ability to provide assessments at the individual level.
Disciplines :
Urology & nephrology
Author, co-author :
Lanot, Antoine; Normandie Univ, UNICAEN, CHU de Caen Normandie, Néphrologie, Caen, France. antoine.lanot@gadz.org ; Normandie Université, Unicaen, UFR de Médecine, 2 Rue Des Rochambelles, Caen, France. antoine.lanot@gadz.org ; ANTICIPE" U1086 INSERM-UCN, Centre François Baclesse, Caen, France. antoine.lanot@gadz.org
Akesson, Anna; Skane University Hospital, Clinical Studies Sweden Forum South, Remissgatan 4, Lund, 22185, Sweden ; Lund University, Malmö, Sweden
Nakano, Felipe Kenji; Department of Public Health and Primary Care, KU Leuven, Campus Kulak, Kortrijk, Belgium ; Itec, Imec Research Group, KU Leuven, Kortrijk, Belgium
Vens, Celine; Department of Public Health and Primary Care, KU Leuven, Campus Kulak, Kortrijk, Belgium ; Itec, Imec Research Group, KU Leuven, Kortrijk, Belgium
Björk, Jonas; Lund University, Box 117, 221 00, Lund, Sweden
Nyman, Ulf; , Östra Vallgatan 41, 223 61, Lund, Sweden
Grubb, Anders; Department of Clinical Chemistry and Pharmacology, Laboratory Lund University, Lund, 22185, Sweden
Sundin, Per-Ola; Karla Healthcare Centre, Faculty of Medicine and Health, Örebro University, Örebro, 701 85, Sweden
Eriksen, Björn O; University Hospital of North Norway (UNN), 9038, Breivika, Troms, Norway
Melsom, Toralf; University Hospital of North Norway (UNN), 9038, Breivika, Troms, Norway
Rule, Andrew D; Division of Nephrology and Hypertension, Mayo Clinic, Rochester, MN, USA
Berg, Ulla; Department of Clinical Science, Intervention and Technology, Division of Pediatrics, Karolinska Institutet, Karolinska University. Hospital Huddinge, 14186, Stockholm, Sweden
Littmann, Karin; Department of Medicine Huddinge, Karolinska Institutet, C2:91 Karolinska University Hospital, Huddinge, SE-141 52, Sweden
Åsling-Monemi, Kajsa; Barnnjursektionen K 88, Astrid Lindgrens Barnsjukhus, Karolinska University Hospital, Stockholm, 141 86, Sweden
Hansson, Magnus; Department of Clinical Chemistry, C1:74 Huddinge, Karolinska University Hospital, Stockholm, SE-141 86, Sweden
Larsson, Anders; Clinical Chemistry and Pharmacology, Entrance 61, 2Nd Floor, Akademiska Hospital, 751 85, Uppsala, Sweden
Courbebaisse, Marie; Service de Physiologie-Explorations, Fonctionnelles Renales Hopital Europeen Georges Pompidou, 20 Rue Leblanc, Paris, 75015, France
Dubourg, Laurence; Exploration Fonctionnelle Renale Pavillon P, Hopital Edouard Herriot, 5 Place d'Arsonval, 69437, Lyon, Cedex 03, France
Couzi, Lionel; CHU de Bordeaux, Nephrologie-Transplantation-Dialyse, Hopital Pellegrin, Universite de Bordeaux, Place Amelie Raba Leon, Bordeaux, 33076, France
Gaillard, Francois; Renal Transplantation Department, Assistance Publique-Hopitaux de Paris (AP-HP), Hopital Bichat, 46 Rue Henri Huchard, Paris, 75018, France
Garrouste, Cyril; Department of Nephrology, Clermont-Ferrand University Hospital, Clermont-Ferrand, France
Jacquemont, Lola; Service de Nephrologie Et Immunologie Clinique, CHU de Nantes, 30 Boulevard Jean Monnet, 44093, Nantes, Cedex 1, France
Kamar, Nassim; Department of Nephrology and Organ Transplantation, CHU Rangueil, 1 Avenue J.Poulhes, TSA 50032, 31059, Toulouse, Cedex 9, France
Legendre, Christophe; Transplantation Renale, Hopital Necker, 145 Rue de Sevres, Paris, 75015, France
Rostaing, Lionel; Service de Nephrologie, Hemodialyse, Aphereses Et Transplantation Renale, Hopital Michallon, Centre Hospitalier Universitaire Grenoble-Alpes, Boulevard de La Chantourne, La Tronche, 38700, France
Ebert, Natalie; Institute of Public Health, Charité. Universitätsmedizin Berlin, Luisenstrasse 57, Berlin, 10117, Germany
Schaeffner, Elke; Institute of Public Health, Charité. Universitätsmedizin Berlin, Luisenstrasse 57, Berlin, 10117, Germany
Bökenkamp, Arend; Amsterdam UMC, Vrije Universiteit, De Boelelaan 1112, Amsterdam, 1081 HV, the Netherlands
Mariat, Christophe; Service de Nephrologie, Dialyse Et Transplantation Renale, Hopital Nord, CHU de Saint-Etienne, 25 Boulevard Pasteur, 42055, Saint-Etienne, Cedex 2, France
Pottel, Hans ; Université de Liège - ULiège > Département des sciences cliniques ; Department of Public Health and Primary Care, KU Leuven, Campus Kulak, Kortrijk, Belgium
Delanaye, Pierre ; Université de Liège - ULiège > Département des sciences cliniques > Néphrologie ; Department of Nephrology-Dialysis-Apheresis, Hôpital Universitaire Carémeau, Nîmes, France
Enhancing individual glomerular filtration rate assessment: can we trust the equation? Development and validation of machine learning models to assess the trustworthiness of estimated GFR compared to measured GFR.
The Assessing Long Term Outcomes in Living Kidney Donors, Chronic Renal Insufficiency Cohort, Consortium for Radiologic Imaging Studies of Polycystic Kidney Disease, Diabetes Control and Complications Trial/Epidemiology of Diabetes Interventions and Complications.Preventing Early Renal Loss in Diabetes, African American Study of Kidney Disease and Hypertension, and Modified Diet in Renal Disease studies were performed by respective investigators and supported by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK). The data from these studies reported here were supplied by the NIDDK Central Repository. This manuscript was not prepared in collaboration with the investigators of the different studies and does not necessarily reflect the opinions or views of these studies, the NIDDK Central Repository, or the NIDDK. Not applicable.
KidneyDisease: Improving Global Outcomes (KDIGO) CKD Work Group. KDIGO 2024 clinical practice guideline for the evaluation and management of chronic kidney disease. Kidney Int. 2024;105: Suppl 4S:117–314.
H. Pottel J. Björk M. Courbebaisse L. Couzi N. Ebert B.O. Eriksen R.N. Dalton L. Dubourg F. Gaillard C. Garrouste A. Grubb L. Jacquemont M. Hansson N. Kamar E.J. Lamb C. Legendre K. Littmann C. Mariat T. Melsom L. Rostaing A.D. Rule E. Schaeffner P.O. Sundin S. Turner A. Bökenkamp U. Berg K. Åsling-Monemi L. Selistre A. Åkesson A. Larsson U. Nyman P. Delanaye Development and Validation of a Modified Full Age Spectrum Creatinine-Based Equation to Estimate Glomerular Filtration Rate: A Cross-sectional Analysis of Pooled Data Ann Intern Med 174 183 191 10.7326/M20-4366 33166224
P. Delanaye A.D. Rule E. Schaeffner E. Cavalier J. Shi A.N. Hoofnagle U. Nyman J. Björk H. Pottel Performance of the European Kidney Function Consortium (EKFC) creatinine-based equation in United States cohorts Kidney Int 105 3 629 637 1:CAS:528:DC%2BB2cXislKju7o%3D 10.1016/j.kint.2023.11.024 38101514 Epub 2023 Dec 13 PMID: 38101514
Delanaye P, Cavalier E, Stehlé T, Pottel H. Glomerular Filtration Rate Estimation in Adults: Myths and Promises. Nephron. 2024;148:408–14.
A. Burlacu A. Iftene E. Busoiu D. Cogean A. Covic Challenging the supremacy of evidence-based medicine through artificial intelligence: the time has come for a change of paradigms Nephrol Dial Transplant 35 191 194 31697377
Collins GS, Moons KGM, Dhiman P, Riley RD, Beam AL, Van Calster B, et al. TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ. 2024;385:e078378.
E.R. DeLong D.M. DeLong D.L. Clarke-Pearson Comparing the area under two or more correlated receiver operating characteristic curves: a nonparametric approach Biometrics 44 837 845
S. Nembrini I.R. König M.N. Wright The revival of the Gini importance? Bioinformatics 34 3711 3718 1:CAS:528:DC%2BC1MXps1akur8%3D 10.1093/bioinformatics/bty373 29757357 6198850
M.E. Matheny D. Whicher I.S. Thadaney Artificial Intelligence in Health Care: A Report From the National Academy of Medicine JAMA 323 509 510 10.1001/jama.2019.21579 31845963
Glassock RJ. Artificial intelligence in medicine and nephrology: the hope, the hype, and reality. Clin Kidney J. 2024;17:sfae074.
A. Verma V.C. Chitalia S.S. Waikar V.B. Kolachalama Machine Learning Applications in Nephrology: A Bibliometric Analysis Comparing Kidney Studies to Other Medicine Subspecialities Kidney Med 3 762 767 10.1016/j.xkme.2021.04.012 34693256 8515072
X. Liu N.-S. Li L.-S. Lv J.-H. Huang H. Tang J.-X. Chen et al. A comparison of the performances of an artificial neural network and a regression model for GFR estimation Am J Kidney Dis 62 1109 15 10.1053/j.ajkd.2013.07.010 24011972
H. Wang B. Bowe Z. Cui H. Yang S.J. Swamidass Y. Xie et al. A Deep Learning Approach for the Estimation of Glomerular Filtration Rate IEEE Trans Nanobiosci 21 560 569 10.1109/TNB.2022.3147957
S. Jiang Y. Li Y. Jiao D. Zhang Y. Wang W. Li A back propagation neural network approach to estimate the glomerular filtration rate in an older population BMC Geriatr 24 23 322 10.1186/s12877-023-04027-5
F.K. Nakano A. Åkesson J. de Boer K. Dedja R. D’hondt F.N. Haredasht J. Björk M. Courbebaisse L. Couzi N. Ebert B.O. Eriksen R.N. Dalton L. Derain-Dubourg F. Gaillard C. Garrouste A. Grubb L. Jacquemont M. Hansson N. Kamar C. Legendre K. Littmann C. Mariat T. Melsom L. Rostaing A.D. Rule E. Schaeffner P.O. Sundin A. Bökenkamp U. Berg K. Åsling-Monemi L. Selistre A. Larsson U. Nyman A. Lanot H. Pottel P. Delanaye C. Vens Comparison between the EKFC-equation and machine learning models to predict Glomerular Filtration Rate Sci Rep 14 26383 1:CAS:528:DC%2BB2cXisVSlu7bF 10.1038/s41598-024-77618-w 39487227 11530427
V. Singh V.K. Asari R. Rajasekaran A Deep Neural Network for Early Detection and Prediction of Chronic Kidney Disease Diagnostics (Basel) 12 116 10.3390/diagnostics12010116 35054287
Salekin A, Stankovic J. Detection of chronic kidney disease and selecting important predictive attributes. In: Salekin A, editor. 2016 IEEE International Conference on Healthcare Informatics (ICHI). Piscataway: IEEE; 2016. p. 262–270.
W. Wang G. Chakraborty B. Chakraborty Predicting the risk of chronic kidney disease (ckd) using machine learning algorithm Appl Sci 11 202 1:CAS:528:DC%2BB3cXhsVGhsrbK 10.3390/app11010202
F.P. Schena V.W. Anelli D.I. Abbrescia T. Di Noia Prediction of chronic kidney disease and its progression by artificial intelligence algorithms J Nephrol 35 1953 1971 10.1007/s40620-022-01302-3 35543912
Z. Fan Q. Yang Z. Xu K. Sun M. Yang R. Yin D. Zhao J. Fan H. Ma Y. Shen H. Xia Construct a classification decision tree model to select the optimal equation for estimating glomerular filtration rate and estimate it more accurately Sci Rep 12 14877 1:CAS:528:DC%2BB38XitlWms77O 10.1038/s41598-022-19185-6 36050407 9436941
A. Truchot M. Raynaud N. Kamar M. Naesens C. Legendre M. Delahousse O. Thaunat M. Buchler M. Crespo K. Linhares B.J. Orandi E. Akalin G.S. Pujol H.T. Silva Jr G. Gupta D.L. Segev X. Jouven A.J. Bentall M.D. Stegall C. Lefaucheur O. Aubert A. Loupy Machine learning does not outperform traditional statistical modelling for kidney allograft failure prediction Kidney Int 103 936 948 10.1016/j.kint.2022.12.011 36572246
Levey AS et al. K/DOQI clinical practice guidelines for chronic kidney disease: Evaluation, classification, and stratification. Am J Kidney Dis. 2002;39:i-ii+S1-S266.
Kidney Disease: Improving Global Outcomes (KDIGO) CKD Work Group. KDIGO Clinical Practice Guideline for the Evaluation and Management of Chronic Kidney Disease Kidney Int 2024 105 S117 S314
H. Pottel A.D. Rule N. Ebert B.O. Eriksen L. Dubourg E. Vidal-Petiot A. Grubb M. Hansson E.J. Lamb K. Littman C. Mariat T. Melsom E. Schaeffner P.O. Sundin A. Akesson A. Larsson E. Cavalier J.B. Bukabau E.K. Sumaili E. Yayo D. Monnet M. Flamant U. Nyman P. Delanaye Cystatin C-based equation to estimate GFR without the insclusion of race and sex New Engl J Med 388 333 343
J.J. Carrero E.L. Fu Y. Sang Biostat S. Ballew M. Evans C.G. Elinder et al. Discordances Between Creatinine and Cystatin C-Based Estimated GFR and Adverse Clinical Outcomes in Routine Clinical Practice Am J Kidney Dis 82 5 534 542 1:CAS:528:DC%2BB3sXhs1yiu7fL 10.1053/j.ajkd.2023.04.002 37354936