Looking for a balance between visual and automatic sleep scoring.

[en] Sleep recordings are visually classified in stages by experts in the field, based on consensus international criteria. This procedure is expensive and time-consuming. Automatic sleep scoring systems have, progressively over the years, demonstrated good levels of accuracy. Although the performance of these algorithms is believed to be high, however, there remains widespread skepticism in their daily use in clinical and scientific practice. In this comment to a recent publication of NPJ Digital Medicine, we express the reasons why we think the sleep expert should remain the central pivot in the pendulum between visual and automatic methodology, trying to find a new balance in the scientific debate.

Disciplines :

Neurology
Computer science
Neurosciences & behavior

Author, co-author :

Muto, Vincenzo ; Université de Liège - ULiège > GIGA > GIGA CRC In vivo Imaging

Berthomier, Christian ; PHYSIP, Paris, France

Language :

English

Title :

Looking for a balance between visual and automatic sleep scoring.

Publication date :

05 September 2023

Journal title :

npj Digital Medicine

eISSN :

2398-6352

Publisher :

Nature Research, England

Volume :

Issue :

Pages :

165

Peer reviewed :

Peer Reviewed verified by ORBi

Additional URL :

https://www.nature.com/articles/s41746-023-00915-7.pdf

Available on ORBi :

since 21 September 2023

Statistics

Number of views

7 (2 by ULiège)

Number of downloads

5 (1 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

Bibliography

Rechtschaffen, A. & Kales, A. A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Volunteers. (Public Health Service, US Government Printing Office, Washington DC, 1968).
Berry, R. B. et al. The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications. (American Academy of Sleep Medicine, 2017).
Berthomier, C. et al. Exploring scoring methods for research studies: accuracy and variability of visual and automated sleep scoring. J. Sleep Res. 29, 1–11 (2020). DOI: 10.1111/jsr.12994
Danker-Hopfe, H. et al. Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard. J. Sleep Res. 18, 74–84 (2009). DOI: 10.1111/j.1365-2869.2008.00700.x
Redline, S., Dean, D. & Sanders, M. H. Entering the era of ‘big data’: getting our metrics right. Sleep 36, 465–469 (2013). DOI: 10.5665/sleep.2524
Fiorillo, L. et al. Automated sleep scoring: a review of the latest approaches. Sleep Med. Rev. 48, 01204 (2019). DOI: 10.1016/j.smrv.2019.07.007
Nasiri, S., Ganglberger, W., Sun, H., Thomas, R. J. & Westover, M. B. Exploiting labels from multiple experts in automated sleep scoring. Sleep 46, zsad034 (2023). DOI: 10.1093/sleep/zsad034
Penzel, T. Sleep scoring moving from visual scoring towards automated scoring. Sleep 45, zsac190 (2022). DOI: 10.1093/sleep/zsac190
Van Der Donckt, J. et al. Do not sleep on traditional machine learning: simple and interpretable techniques are competitive to deep learning for sleep scoring. Biomed. Signal Process. Control 81, 104429 (2023). DOI: 10.1016/j.bspc.2022.104429
Phan, H. et al. Sleeptransformer: automatic sleep staging with interpretability and uncertainty quantification. IEEE Trans. Biomed. Eng. 69, 2456–2467 (2022). DOI: 10.1109/TBME.2022.3147187
Yang, G., Ye, Q. & Xia, J. Unbox the black-box for the medical explainable AI via multi-modal and multi-centre data fusion: a mini-review, two showcases and beyond. Inf. Fusion 77, 29–52 (2022). DOI: 10.1016/j.inffus.2021.07.016
Perslev, M. et al. U-Sleep: resilient high-frequency sleep staging. NPJ Digit. Med. 4, 72 (2021). DOI: 10.1038/s41746-021-00440-5
Fiorillo, L. et al. U-Sleep’s resilience to AASM guidelines. NPJ Digit. Med. 6, 33 (2023). DOI: 10.1038/s41746-023-00784-0
Virkkala, J., Hasan, J., Värri, A., Himanen, S. L. & Müller, K. Automatic sleep stage classification using two-channel electro-oculography. J. Neurosci. Methods 166, 109–115 (2007). DOI: 10.1016/j.jneumeth.2007.06.016
Berthomier, C. et al. Automatic analysis of single-channel sleep EEG: validation in healthy individuals. Sleep 30, 1587–1595 (2007). DOI: 10.1093/sleep/30.11.1587
De Chazal, P. et al. Sleep/wake measurement using a non-contact biomotion sensor. J. Sleep Res. 20, 356–366 (2011). DOI: 10.1111/j.1365-2869.2010.00876.x
Norman, R. G., Pal, I., Stewart, C., Walsleben, J. A. & Rapoport, D. M. Interobserver agreement among sleep scorers from different centers in a large dataset. Sleep 23, 1–8 (2000). DOI: 10.1093/sleep/23.7.1e
Phan, H. & Mikkelsen, K. Automatic sleep staging of EEG signals: recent development, challenges, and future directions. Physiol. Meas. 43, 4 (2022). DOI: 10.1088/1361-6579/ac6049
Malafeev, A. et al. Automatic human sleep stage scoring using deep neural networks. Front. Neurosci. 12, 781 (2018). DOI: 10.3389/fnins.2018.00781
Bakker, J. P. et al. Scoring sleep with artificial intelligence enables quantification of sleep stage ambiguity: hypnodensity based on multiple expert scorers and auto-scoring. Sleep 46, zsac154 (2023). DOI: 10.1093/sleep/zsac154
Lee, Y. J., Lee, J. Y., Cho, J. H. & Choi, J. H. Interrater reliability of sleep stage scoring: a meta-analysis. J. Clin. Sleep Med. 18, 193–202 (2022). DOI: 10.5664/jcsm.9538