A novel Transformer-based Anomaly Detection approach for ECG Monitoring Healthcare System

Nguyen, Thi Thuy Van; Heuchenne, Cédric; Tran, Kim Duc; Tran, Kim Phuc

doi:10.1007/978-3-031-53028-9_7

No full text

Paper published in a book (Scientific congresses and symposiums)

A novel Transformer-based Anomaly Detection approach for ECG Monitoring Healthcare System

Nguyen, Thi Thuy Van; Heuchenne, Cédric; Tran, Kim Duc et al.

2023 • In The Seventh International Conference on Safety and Security with IoT, Edition 1

Peer reviewed

Permalink
https://hdl.handle.net/2268/311904

DOI
10.1007/978-3-031-53028-9_7

Files (0)Send to Details Statistics Bibliography Similar publications

Files

Full Text

No document available.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

Anomaly detection; Transformer; Variational autoencoder; Multivariate exponentially weighted moving average; Support vector data description; Control chart; Federated learning; Embedded artificial intelligence

Abstract :

[en] Anomaly detection plays a crucial role across various domains, including healthcare, where identifying deviations from normal patterns can help with early intervention and improved outcomes. In healthcare, such as in ECG analysis, detecting abnormal signals is essential for timely diagnosis and treatment, as it can help identify potentially life-threatening conditions that could otherwise go undetected. In this work, by focusing on ECG anomaly detection as an illustrative healthcare application, we propose to use a transformer-based variational autoencoder network together with a MEWMA-SVDD control chart to achieve anomaly detection. By employing this approach, we can effectively control the false alarm rate to minimize unnecessary alerts. Our proposed framework not only excels in terms of accuracy but also reduces the false alarm rate, making it a favorable choice compared to existing methods

Disciplines :

Computer science

Author, co-author :

Nguyen, Thi Thuy Van ; Université de Liège - ULiège > HEC Liège Research

Heuchenne, Cédric ; Université de Liège - ULiège > HEC Liège : UER > UER Opérations : Statistique appliquée à la gestion et à l'économie

Tran, Kim Duc; Dong A University, Vietnam > International Research Institute for Artificial Intelligence and Data Science

Tran, Kim Phuc; University of Lille, France > ENSAIT, GEMTEX

Language :

English

Title :

A novel Transformer-based Anomaly Detection approach for ECG Monitoring Healthcare System

Publication date :

25 October 2023

Event name :

7th EAI International Conference on Safety and Security in Internet of Things

Event place :

Bratislava, Slovakia

Event date :

October 24-26, 2023

Audience :

International

Main work title :

The Seventh International Conference on Safety and Security with IoT, Edition 1

Publisher :

Springer, Cham

ISBN/EAN :

978-3-031-53027-2

Pages :

111–129

Peer reviewed :

Peer reviewed

Additional URL :

https://link.springer.com/chapter/10.1007/978-3-031-53028-9_7

Data Set :

https://doi.org/10.1007/978-3-031-53028-9_7

Available on ORBi :

since 25 January 2024

Statistics

Number of views

18 (3 by ULiège)

Number of downloads

0 (0 by ULiège)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

Bibliography

F.A. Acheampong, H.Nunoo-Mensah, W. Chen, Transformer models for text-based emotion detection: a review of Bert-based approaches. Artif. Intell. Rev. 54, 1–41 (2021)
D.M. Anstine, O. Isayev, Generative models as an emerging paradigm in the chemical sciences. J. Amer. Chem. Soc. 145(16), 8736–8750 (2023)
A. Banerjee, P. Burlina, R. Meth, Fast hyperspectral anomaly detection via SVDD, in 2007 IEEE International Conference on Image Processing, vol. 4 (2007), pp. IV–101–IV–104
M. Bertolini, D. Mezzogori, M. Neroni, F. Zammori, Machine learning for industrial applications: a comprehensive literature review. Expert Syst. Appl. 175, 114820 (2021)
H. Chen, Y. Wang, T.Guo, C. Xu, Y. Deng, Z. Liu, S. Ma, C. Xu, C. Xu, W. Gao, Pre-trained image processing transformer, in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2021), pp. 12299–12310
P. Dixit, S. Silakari, Deep learning algorithms for cybersecurity applications: a technological and status review. Comput. Sci. Rev. 39, 100317 (2021)
Z. Duan, M. Lu, Z. Ma, F. Zhu, Lossy image compression with quantized hierarchical VAEs, in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (2023), pp. 198–207
M. Fahim, A. Sillitti, Anomaly detection, analysis and prediction techniques in IoT environment: a systematic literature review. IEEE Access 7, 81664–81681 (2019)
A.L. Goldberger, L.A. Amaral, L. Glass, J.M. Hausdorff, P.C. Ivanov, R.G. Mark, J.E. Mietus, G.B. Moody, C.K. Peng, H.E. Stanley, PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. Circulation 101(23), e215–e220 (2000)
C. Jen, C. Wang, Real-time process monitoring based on multivariate control chart for anomalies driven by frequency signal via sound and electrocardiography cases. Processes 9(9), 1510 (2021)
Z. Kang, C. Catal, B. Tekinerdogan, Machine learning applications in production lines: a systematic literature review. Comput. Ind. Eng. 149, 106773 (2020)
D. Kingma, M. Welling, et al., An introduction to variational autoencoders. Found. Trends® Mach. Learn. 12(4), 307–392 (2019)
M. Lang, A low-complexity model-free approach for real-time cardiac anomaly detection based on singular spectrum analysis and nonparametric control charts. Technologies 6(1), 26 (2018)
A.B. Nassif, M.A. Talib, Q. Nasir, F.M. Dakalbab, Machine learning for anomaly detection: a systematic review. IEEE Access 9, 78658–78700 (2021)
H.D. Nguyen, H.L. Nguyen, N.H. Kieu, V.H. Nguyen, T.H. Truong, K.P. Tran, Trans-lighter: a light-weight federated learning-based architecture for remaining useful lifetime prediction. Comput. Ind. 148, 103888 (2023)
E.J. Pauwels, O. Ambekar, One class classification for anomaly detection: Support vector data description revisited, in ed. by P. Perner, Advances in Data Mining. Applications and Theoretical Aspects (Springer, Berlin, 2011), pp. 25–39
A. Raza, K.P. Tran, L. Koehl, S. Li, Anofed: adaptive anomaly detection for digital health using transformer-based federated learning and support vector data description. Eng. Appl. Artif. Intell. 121, 106051 (2023)
S.A.Salloum, M. Alshurideh, A. Elnagar, K. Shaalan, Machine learning and deep learning techniques for cybersecurity: a review, in The International Conference on Artificial Intelligence and Computer Vision (Springer, Berlin, 2020), pp. 50–57
S. Singh, A. Mahmood, The NLP cookbook: modern recipes for transformer based deep learning architectures. IEEE Access 9, 68675–68702 (2021)
A. Smola, B.Scholkopf, K. Muller, The connection between regularization operators and support vector kernels. Neur. Netw. 11, 637–649 (1998)
G. Suman, D. Prajapati, Control chart applications in healthcare: a literature review. Int. J. Metrol. Quality Eng. 9, 5 (2018)
A. Tang, P. Castagliola, X. Hu, F. Xie, An assessment for the conditional performance of an support vector data description (SVDD)-based chart. Qual. Reliabil. Eng. Int. 38, 1–17 (2022)
D.M.J. Tax, R.P.W. Duin, Support vector data description. Mach. Learn. 54(1), 45–66 (2004)
H.T. Truong, B.P. Ta, Q.A. Le, D.M. Nguyen, C.T. Le, H.X. Nguyen, H.T. Do, H.T. Nguyen, K.P. Tran, Light-weight federated learning-based anomaly detection for time-series data in industrial control systems. Comput. Ind. 140, 103692 (2022)
T. Truong, B. Ta, M. Dao, D. Tran, M. Nguyen, D.T. Bui, K.P. Tran, et al., Detecting cyberattacks using anomaly detection in industrial control systems: a federated learning approach. Comput. Ind. 132, 103509 (2021)
V.N. Vapnik, Statistical Learning Theory (Wiley, Hoboken, 1998)
A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A.N. Gomez, L. Kaiser, I. Polosukhin, Attention is all you need, in Advances in Neural Information Processing Systems, vol. 30 (Curran Associates, Red Hook, 2017)
T. Wolf, L. Debut, V. Sanh, J. Chaumond, C. Delangue, A. Moi, P. Cistac, T. Rault, R. Louf, M. Funtowicz, et al., Transformers: State-of-the-art natural language processing, in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations (2020), pp. 38–45
Z. Zhang, X. Deng, Anomaly detection using improved deep svdd model with data structure preservation. Pattern Recogn. Lett. 148, 1–6 (2021)
H. Zhou, C. Kan, Tensor-based ECG anomaly detection toward cardiac monitoring in the internet of health things. Sensors 21(12), 4173 (2021)