
FOLLOWUS
School of Cyber Science and Engineering, Ningbo University of Technology, Ningbo 315211, China
E-mail: sunjie@nbut.edu.cn
收稿:2021-11-03,
修回:2022-07-21,
纸质出版:2023-01
Scan QR Code
孙洁. 融入领域知识的深度学习在心律失常分类中的应用[J]. 信息与电子工程前沿(英文版), 2023,24(1):59-72.
Jie SUN. Domain knowledge enhanced deep learning for electrocardiogram arrhythmia classification[J]. Frontiers of Information Technology & Electronic Engineering, 2023, 24(1): 59-72.
孙洁. 融入领域知识的深度学习在心律失常分类中的应用[J]. 信息与电子工程前沿(英文版), 2023,24(1):59-72. DOI: 10.1631/FITEE.2100519.
Jie SUN. Domain knowledge enhanced deep learning for electrocardiogram arrhythmia classification[J]. Frontiers of Information Technology & Electronic Engineering, 2023, 24(1): 59-72. DOI: 10.1631/FITEE.2100519.
深度学习为心律失常的自动分类提供了一种有效的方法,但在临床决策中,纯数据驱动的方法以黑盒形式运行,可能会导致不良预测结果。将领域知识与深度学习相结合是一种很有前景的解决方案。本文开发了一个灵活且可扩展的框架,用于集成领域知识与深度神经网络。该模型由深度神经网络和知识推理模块组成,深度神经网络用于捕捉输入数据的统计模式,知识模块用于确保与领域知识的一致性。这两个组成部分经过交互训练,以实现两种机制的最佳效果。实验表明,领域知识可以较好地改善神经网络的预测结果,从而提高预测精度。
Deep learning provides an effective way for automatic classification of cardiac arrhythmias
but in clinical decision-making
pure data-driven methods working as black-boxes may lead to unsatisfactory results. A promising solution is combining domain knowledge with deep learning. This paper develops a flexible and extensible framework for integrating domain knowledge with a deep neural network. The model consists of a deep neural network to capture the statistical pattern between input data and the ground-truth label
and a knowledge module to guarantee consistency with the domain knowledge. These two components are trained interactively to bring the best of both worlds. The experiments show that the domain knowledge is valuable in refining the neural network prediction and thus improves accuracy.
Abadi M , Barham P , Chen JM , et al. , 2016 . TensorFlow: a system for large-scale machine learning . 12 th SENIX Conf on Operating Systems Design and Implementation , p. 265 - 283 .
Acharya UR , Fujita H , Oh SL , et al. , 2019 . Deep convolutional neural network for the automated diagnosis of congestive heart failure using ECG signals . Appl Intell , 49 ( 1 ): 16 - 27 . https://doi.org/10.1007/s10489-018-1179-1 https://doi.org/10.1007/s10489-018-1179-1
Baloglu UB , Talo M , Yildirim Ö , et al. , 2019 . Classification of myocardial infarction with multi-lead ECG signals and deep CNN . Patt Recogn Lett , 122 : 23 - 30 . https://doi.org/10.1016/j.patrec.2019.02.016 https://doi.org/10.1016/j.patrec.2019.02.016
Chen B , Guo W , Li B , et al. , 2018 . A study of deep feature fusion based methods for classifying multi-lead ECG . https://arxiv.org/abs/1808.01721 https://arxiv.org/abs/1808.01721
Chen TM , Huang CH , Shih ESC , et al. , 2020 . Detection and classification of cardiac arrhythmias by a challenge-best deep learning neural network model . iScience , 23 ( 3 ): 100886 . https://doi.org/10.1016/j.isci.2020.100886 https://doi.org/10.1016/j.isci.2020.100886
Crawford MH , Bernstein SJ , Deedwania PĆ , et al. , 1999 . ACC/AHA guidelines for ambulatory electrocardiography: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines (Committee to revise the guidelines for ambulatory electrocardiography) developed in collaboration with the North American Society for Pacing and Electrophysiology . J Am Coll Cardiol , 34 ( 3 ): 912 - 948 . https://doi.org/10.1016/S0735-1097(99)00354-X https://doi.org/10.1016/S0735-1097(99)00354-X
Dai WZ , Xu QL , Yu Y , et al. , 2019 . Bridging machine learning and logical reasoning by abductive learning . 33 rd Conf on Neural Information Processing Systems , p. 2811 - 2822 .
Diligenti M , Gori M , Sacca C , 2017 . Semantic-based regularization for learning and inference . Artif Intell , 244 : 143 - 165 . https://doi.org/10.1016/j.artint.2015.08.011 https://doi.org/10.1016/j.artint.2015.08.011
Fawaz HI , Lucas B , Forestier G , et al. , 2020 . InceptionTime: finding AlexNet for time series classification . Data Min Knowl Disc , 34 ( 6 ): 1936 - 1962 . https://doi.org/10.1007/s10618-020-00710-y https://doi.org/10.1007/s10618-020-00710-y
Giannini F , Diligenti M , Gori M , et al. , 2019 . On a convex logic fragment for learning and reasoning . IEEE Trans Fuzzy Syst , 27 ( 7 ): 1407 - 1416 . https://doi.org/10.1109/TFUZZ.2018.2879627 https://doi.org/10.1109/TFUZZ.2018.2879627
Goldberger AL , Goldberger ZD , Shvilkin A , 2017 . Goldberger's Clinical Electrocardiography (9 th Ed.) . Elsevier , Armstrong, the Netherlands .
Gorgels APM , Engelen DJM , Wellens HJJ , 2001 . Lead aVR, a mostly ignored but very valuable lead in clinical electrocardiography . J Am Coll Cardiol , 38 ( 5 ): 1355 - 1356 . https://doi.org/10.1016/S0735-1097(01)01564-9 https://doi.org/10.1016/S0735-1097(01)01564-9
Gupta A , Huerta EA , Zhao ZZ , et al. , 2020 . Deep learning for cardiologist-level myocardial infarction detection in electrocardiograms . Proc 8 th European Medical and Biological Engineering Conf , p. 341 - 355 . https://doi.org/10.1007/978-3-030-64610-3_40 https://doi.org/10.1007/978-3-030-64610-3_40
Hamad T , 2018 . ABC of Clinical Electrocardiography (2 nd Ed .). BMJ Books , Massachusetts, USA .
Hanna EB , Glancy DL , 2015 . ST-segment elevation: differential diagnosis, caveats . Cleveland Clin J Med , 82 ( 6 ): 373 - 384 . https://doi.org/10.3949/ccjm.82a.14026 https://doi.org/10.3949/ccjm.82a.14026
Hannun AY , Rajpurkar P , Haghpanahi M , et al. , 2019 . Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network . Nat Med , 25 ( 1 ): 65 - 69 . https://doi.org/10.1038/s41591-018-0268-3 https://doi.org/10.1038/s41591-018-0268-3
He KM , Zhang XY , Ren SQ , et al. , 2016 . Deep residual learning for image recognition . IEEE Conf on Computer Vision and Pattern Recognition , p. 770 - 778 . https://doi.org/10.1109/CVPR.2016.90 https://doi.org/10.1109/CVPR.2016.90
Hu ZT , Ma XZ , Liu ZZ , et al. , 2016 . Harnessing deep neural networks with logic rules . Proc 54 th Annual Meeting of the Association for Computational Linguistics , p. 2410 - 2420 . https://doi.org/10.18653/v1/P16-1228 https://doi.org/10.18653/v1/P16-1228
Ioffe S , Szegedy C , 2015 . Batch normalization: accelerating deep network training by reducing internal covariate shift . Proc 32 nd Int Conf on Machine Learning , p. 448 - 456 .
Jin LP , Dong J , 2017 . Classification of normal and abnormal ECG records using lead convolutional neural network and rule inference . Sci China Inform Sci , 60 ( 7 ): 078103 . https://doi.org/10.1007/s11432-016-9047-6 https://doi.org/10.1007/s11432-016-9047-6
Kimmig A , Bach SH , Broecheler M , et al. , 2012 . A short introduction to probabilistic soft logic . Proc 11th NIPS Workshop on Probabilistic Programming: Foundations and Applications , p. 1 - 4 .
Kingma DP , Ba LJ , 2015 . Adam: a method for stochastic optimization . Proc 3rd Int Conf on Learning Representations . https://doi.org/10.48550/arXiv.1412.6980 https://doi.org/10.48550/arXiv.1412.6980
Klir GJ , Yuan B , 1995 . Fuzzy sets and fuzzy logic: theory and applications . Prentice Hall , New Jersey, USA .
Liu FF , Liu CY , Zhao LN , et al. , 2018 . An open access database for evaluating the algorithms of electrocardiogram rhythm and morphology abnormality detection . J Med Imag Health Inform , 8 ( 7 ): 1368 - 1373 . https://doi.org/10.1166/jmihi.2018.2442 https://doi.org/10.1166/jmihi.2018.2442
Liu WH , Zhang MX , Zhang YD , et al. , 2018 . Real-time multilead convolutional neural network for myocardial infarction detection . IEEE J Biomed Health Inform , 22 ( 5 ): 1434 - 1444 . https://doi.org/10.1109/JBHI.2017.2771768 https://doi.org/10.1109/JBHI.2017.2771768
Luo CS , Jiang HX , Li QC , et al. , 2019 . Multi-label classification of abnormalities in 12-lead ECG using 1D CNN and LSTM . Proc 8 th Int Workshop on Machine Learning and Medical Engineering for Cardiovascular Healthcare , p. 55 - 63 . https://doi.org/10.1007/978-3-030-33327-0_7 https://doi.org/10.1007/978-3-030-33327-0_7
Mostayed A , Luo JY , Shu XL , et al. , 2018 . Classification of 12-lead ECG signals with bi-directional LSTM network . https://arxiv.org/abs/1811.02090 https://arxiv.org/abs/1811.02090
National Center for Cardiovascular Diseases , 2019 . Report on Cardiovascular Diseases in China 2018 . Encyclopedia of China Publishing House , Beijing, China (in Chinese) .
O'Gara PT , Kushner FG , Ascheim DD , et al. , 2013 . ACCF/AHA guideline for the management of ST-elevation myocardial infarction: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines . Circulation , 127 ( 4 ): e362 - e425 . https://doi.org/10.1161/CIR.0b013e3182742cf6 https://doi.org/10.1161/CIR.0b013e3182742cf6
Pan JP , Tompkins WJ , 1985 . A real-time QRS detection algorithm . IEEE Trans Biomed Eng , BME-32 ( 3 ): 230 - 236 . https://doi.org/10.1109/TBME.1985.325532 https://doi.org/10.1109/TBME.1985.325532
Parvaneh S , Rubin J , Rahman A , et al. , 2018 . Analyzing single-lead short ECG recordings using dense convolutional neural networks and feature-based post-processing to detect atrial fibrillation . Physiol Meas , 39 ( 8 ): 084003 . https://doi.org/10.1088/1361-6579/aad5bd https://doi.org/10.1088/1361-6579/aad5bd
Sankaran PG , Sunoj SM , Nair NU , 2016 . Kullback–Leibler divergence: a quantile approach . Stat Probab Lett , 111 : 72 - 79 . https://doi.org/10.1016/J.SPL.2016.01.007 https://doi.org/10.1016/J.SPL.2016.01.007
Simonyan K , Zisserman A , 2015 . Very deep convolutional networks for large-scale image recognition . Proc 3rd Int Conf on Learning Representations . https://doi.org/10.48550/arXiv.1409.1556 https://doi.org/10.48550/arXiv.1409.1556
Singh BN , Tiwari AK , 2006 . Optimal selection of wavelet basis function applied to ECG signal denoising . Dig Signal Process , 16 ( 3 ): 275 - 287 . https://doi.org/10.1016/j.dsp.2005.12.003 https://doi.org/10.1016/j.dsp.2005.12.003
Singstad BJ , Tronstad C , 2020 . Convolutional neural network and rule-based algorithms for classifying 12-lead ECGs . Computing in Cardiology , p. 1 - 4 . https://doi.org/10.22489/CinC.2020.227 https://doi.org/10.22489/CinC.2020.227
Surawicz B , Knilans TK , 2008 . Chou's Electrocardiography in Clinical Practice: Adult and Pediatric (6 th Ed.) . Saunders Elsevier , Philadelphia, USA .
Wagner P , Strodthoff N , Bousseljot RD , et al. , 2020 . PTB-XL, a large publicly available electrocardiography dataset . Sci Data , 7 ( 1 ): 154 . https://doi.org/10.1038/s41597-020-0495-6 https://doi.org/10.1038/s41597-020-0495-6
Yao QH , Wang RX , Fan XM , et al. , 2020 . Multi-class arrhythmia detection from 12-lead varied-length ECG using attention-based time-incremental convolutional neural network . Inform Fus , 53 : 174 - 182 . https://doi.org/10.1016/J.INFFUS.2019.06.024 https://doi.org/10.1016/J.INFFUS.2019.06.024
Zhou FY , Jin LP , Dong J , 2017 . Premature ventricular contraction detection combining deep neural networks and rules inference . Artif Intell Med , 79 : 42 - 51 . https://doi.org/10.1016/j.artmed.2017.06.004 https://doi.org/10.1016/j.artmed.2017.06.004
关联资源
相关文章
相关作者
相关机构
京公网安备11010802024621