Human-in-the-Loop Approach Based on MRI and ECG for Healthcare Diagnosis

Abstract

The presented study investigates a human-centric approach to implementing human-intheloop models for healthcare diagnostics. The following tasks were considered and addressed in this work: a) identify the features necessary for future healthcare diagnosis based on electrocardiogram signals in the human-in-the-loop model: P, T-peaks, QRScomplex, PQ and ST segments, and b) detect inflammatory processes in the heart muscle (myocardium) based on cardiac magnetic resonance imaging. As a result of our investigation, a novel approach was proposed for embedding (integrating) clinical knowledge about the nature of these phenomena into the electrocardiogram signal and magnetic resonance imaging. Domain knowledge about the sample’s nature is encoded similarly to the input information. Moreover, the convolution operation within our approach serves as an embedding mechanism. The results presented in the article are a starting point for using the models obtained by the proposed approach (human-in-the-loop models) for classification problems using deep learning and convolutional neural networks. Also, visual analysis shows the proposed approaches’ ability to solve practical clinical problems. It also ensures transparent interpretation of the obtained results as the human-in-the-loop model, which, in turn, is built according to the human-centric approach. Overall, our contribution allows the implementation of a scheme for obtaining artificial intelligence solutions based on the principles of trust in them.