Digital twin information technology for biomedical data complex representation and processing

Ivan A Dychka, Yevgeniya S Sulema, Iurii V Bukhtiiarov


The paper presents an information technology of digital twin for implementation in healthcare, in particular in e-health and m-health applications. The primary objective of this research is to develop a concept of digital twin information technology for medical decision support systems. The second objective is to analyse various medical data formats and to develop an approach to synchronization of multimodal medical data. The approach proposed in the paper will enable aggregation of multimodal data sequences obtained from a wide range of medical diagnostic equipment with the purpose of a patient’s digital twin creation. The paper presents an analysis of data synchronization possibility and data representation formats for both single-channel and multi-channel biological signals, results of such investigations as blood tests, ultrasound research, magnetic resonance imaging etc.

Digital twin technology will enable development of a new generation of medical decision support systems. A digital twin of a patient is a synchronized and aggregated multimodal data set obtained from a wide range of diagnostic medical equipment which is continuously updated and based on a personalized semantic modal of a patient. Since data are obtained from different medical devices and tools in various formats which directly do not fit for data synchronization and aggregation, the format of a file-wrapper that enables storing time characteristics of medical investigations (time stamps) in an evident form. It allows us to simplify a procedure of multimodal data aggregation while creating and continuous updating the digital twin of a patient. The process of digital twin forming includes the following stages: receiving of original data files in a device format (sonographic device, MRI scanner, electrocardiograph etc.), analysis of data and their time stamps, transformation of the original file to the format of a file-wrapper, data synchronization and aggregation, representation of multimodal data in a digital twin format for further storing and processing.

Keywords: digital twin, multimodal data, data synchronization.

Повний текст:

PDF 112-119


Michael Grieves, John Vickers. Digital Twin: Mitigating Unpredictable, Undesirable Emergent Behavior in Complex Systems. Transdisciplinary Perspectives on Complex Systems, 2018, pp. 85-113. doi: 10.1007/978-3-319-38756-7_4

Behrang Ashtari Talkhestani, Nasser Jazdi, Wolfgang Schlögl, Michael Weyrich. Consistency check to synchronize the Digital Twin of manufacturing automation based on anchor points. Proceedings of the 51st CIRP Conference on Manufacturing Systems, 2018, pp. 159-164. doi: 10.1016/j.procir.2018.03.166

Azad M. Madni, Carla C. Madni, Scott D. Lucero. Leveraging Digital Twin Technology in Model-Based Systems Engineering. Systems, vol. 7, no. 1, p. 7, Jan. 2019. doi: 10.3390/systems7010007

Liwen Hu, Ngoc-Tu Nguyen, Wenjin Tao, Ming C.Leu, Xiaoqing Frank Liu, Md Rakib Shahriar, S M Nahian AI Sunny. Modeling of Cloud-Based Digital Twins for Smart Manufacturing with MT Connect. Procedia Manufacturing, Vol. 26, 2018, pp. 1193-1203. doi: 10.1016/j.promfg.2018.07.155

D. Iglesias, P. Bunting, S. Esquembri, J. Hollocombe, S. Silburn, L. Vitton-Mea, I. Balboa, A. Huber, G.F. Matthews, V. Riccardo, F. Rimini, D. Valcarcel. Digital twin applications for the JET divertor. Fusion Engineering and Design Journal, Vol. 125, 2017, pp. 71-76. doi: 10.1016/j.fusengdes.2017.10.012

Thomas H.-J. Uhlemann, Christian Lehmann, Rolf Steinhilper. The Digital Twin: Realizing the Cyber-Physical Production System for Industry 4.0. Proceedings of the 24th CIRP Conference on Life Cycle Engineering, 2017, pp. 335-340. doi: 10.1016/j.procir.2016.11.152

M. Ayani, M. Ganebäck, Amos H. C. Ng. Digital Twin: Applying emulation for machine reconditioning. Proceedings of the 51st CIRP Conference on Manufacturing Systems, 2018, pp. 243-248. doi: 10.1016/j.procir.2018.03.139

Gianfranco E. Modoni, Enrico G. Caldarola, Marco Sacco, Walter Terkaj. Synchronizing physical and digital factory: benefits and technical challenges. Proceedings of the 12th CIRP Conference on Intelligent Computation in Manufacturing Engineering, 2018, pp. 472-477. doi: 10.1016/j.procir.2019.02.125

Yi Cai, Binil Starly, Paul Cohen, Yuan-Shin Lee. Sensor data and information fusion to construct digital-twins virtual machine tools for cyber-physical manufacturing. Proceedings of the 45th ME North American Manufacturing Research Conference, 2017, pp. 1031-1042. doi: 10.1016/j.promfg.2017.07.094

Mika Lohtander et al. Micro Manufacturing Unit and Corresponding 3D Model for the Digital Twin. Proceedings of the 8th Swedish Production Symposium, 2018, pp. 55-61. doi: 10.1016/j.promfg.2018.06.057

Värri, A, ENV 14271, File Exchange Format for Vital Signs and its use in digital ECG archiving. Proceedings of 2nd Open ECG Workshop "Integration of the ECG into the EHR & Interoperability of ECG Device Systems", Berlin, Germany, 2004, 2 p.

Which file format does BioSemi use? Available at: (accessed 21 September 2019).

Specification for the HL7 Lab Data Interface, Oracle® Health Sciences LabPas Release 3.1, Part Number: E48677-01, 2013, 39 p.

Olivier Bernard et al. The Ultrasound File Format (UFF) - First draft. Proceedings of 2018 IEEE International Ultrasonics Symposium, 2018. doi: 10.1109/ULTSYM.2018.8579642

The NIFTI file format. Available at: (accessed 21 September 2019).

Data Format Working Group (DFWG), The NIFTI-1 DATA FORMAT, 2004, 30 p. Available at: (accessed 21 September 2019).

Digital Imaging and Communications in Medicine. Available at: (accessed 21 September 2019).

CSV Files. Available at: (accessed 21 September 2019).

I. Dychka, Ye. Sulema, Logical Operations in Algebraic System of Aggregates for Multimodal Data Representation and Processing. Research Bulletin of the National Technical University of Ukraine "Kyiv Polytechnic Institute", Vol. 6, 2018, pp. 44-52. doi: 10.20535/1810-0546.2018.6.151546

I. Dychka, Ye. Sulema. Ordering Operations in Algebraic System of Aggregates for Multi-Image Data Processing. KPI Science News, Vol. 1, 2019. doi: 10.20535/kpi-sn.2019.1.157245

Sulema, Ye. ASAMPL: Programming Language for Mulsemedia Data Processing Based on Algebraic System of Aggregates. Advances in Intelligent Systems and Computing, Springer, Vol. 725, 2018, pp. 431-442. doi: 10.1007/978-3-319-75175-7_43

Yevgeniya Sulema, Etienne Kerre. Multimodal Data Representation and Processing Based on Algebraic System of Aggregates, preprint, 2019, 37 p.

International Classification of Functioning, Disability and Health. Available at: (accessed 21 September 2019).

Yevgeniya Sulema, Ivan Dychka, Olga Sulema. Multimodal Data Representation Models for Virtual, Remote, and Mixed Laboratories Development. Lecture Notes in Networks and Systems, Springer, Vol. 47, 2018, pp. 559-569. doi: 10.1007/978-3-319-95678-7_62


  • Поки немає зовнішніх посилань.