%0 Journal Article
%@ 1929-073X
%I JMIR Publications
%V 12
%N 
%P e44310
%T Normal Workflow and Key Strategies for Data Cleaning Toward Real-World Data: Viewpoint
%A Guo,Manping
%A Wang,Yiming
%A Yang,Qiaoning
%A Li,Rui
%A Zhao,Yang
%A Li,Chenfei
%A Zhu,Mingbo
%A Cui,Yao
%A Jiang,Xin
%A Sheng,Song
%A Li,Qingna
%A Gao,Rui
%+ Xiyuan Hospital, China Academy of Chinese Medical Sciences, GCP, Xiyuan Hospital, 1 Xiyuan Playground, Haidian District, Beijing, 100091, China, 86 010 62835653, ruigao@126.com
%K data cleaning
%K data quality
%K key technologies
%K real-world data
%K viewpoint
%D 2023
%7 21.9.2023
%9 Viewpoint
%J Interact J Med Res
%G English
%X With the rapid development of science, technology, and engineering, large amounts of data have been generated in many fields in the past 20 years. In the process of medical research, data are constantly generated, and large amounts of real-world data form a “data disaster.” Effective data analysis and mining are based on data availability and high data quality. The premise of high data quality is the need to clean the data. Data cleaning is the process of detecting and correcting “dirty data,” which is the basis of data analysis and management. Moreover, data cleaning is a common technology for improving data quality. However, the current literature on real-world research provides little guidance on how to efficiently and ethically set up and perform data cleaning. To address this issue, we proposed a data cleaning framework for real-world research, focusing on the 3 most common types of dirty data (duplicate, missing, and outlier data), and a normal workflow for data cleaning to serve as a reference for the application of such technologies in future studies. We also provided relevant suggestions for common problems in data cleaning.
%M 37733421
%R 10.2196/44310
%U https://www.i-jmr.org/2023/1/e44310
%U https://doi.org/10.2196/44310
%U http://www.ncbi.nlm.nih.gov/pubmed/37733421