The demand for digital reconstruction of the human body, the “human digital twin,” is increasing. Areas where human digital twins can be used include supporting disease diagnoses and predicting various treatment outcomes [, ]. However, accurate digitalization of the structure and function of the human body is required, and a digital twin of the whole skeleton will provide a broader understanding of the human body. The Digital Korean Project, which was conducted from 2003 to 2007, established a database of Korean skeletons that included physical properties [ ] and is being used in various research fields [ , ]. Digital representations of the human skeleton can be constructed at a higher level by including movement. Recently, Hernigou et al [ ] proposed a method to include an ankle motion axis in digital twins. Although this method can be useful, one drawback of this study was that muscle movement was not included. This is because human skeletal movements cannot be evaluated except for the muscles. Therefore, in this study, we aimed to develop a visualization application of human shoulder movements involving bones and muscles.
Computed tomography (CT) images of the shoulders obtained at Ewha Womans University Seoul Hospital were used for 3D modeling. CT images in the DICOM file format were converted to an STL file format and then imported into the Blender program (Blender Institute). The size and volume of each bone and muscle involved in shoulder movement were measured and used for image visualization and 3D modeling. For the virtual reconstruction of shoulder movement, the Controller function was used to crudely model bone and muscle movement, and the Shapekey function was used to further adjust muscle contraction, relaxation, and rotation.
The Unity engine (Unity Technologies, San Francisco, CA) was used to develop a real-time 3D visualization application of shoulder movements. Reconstructed 3D resources and shoulder movement animations were exported from the Blender program in the FilmBoX file format and imported as Unity assets. A separate collision box was generated to avoid slowdown during the real-time selection of bones and muscles in polygonal units. Unity cameras were customized to display 3D structures and animations from different viewpoints. Interactive visibility controls for each bone and muscle were designated, and animation sequences were programmed for each motion.
This study received ethics approval from Ewha Womans University Seoul Hospital (ethics approval No. 2023-02-037).
To build a 3D model of the shoulders, 3 bones (scapula, clavicle, and humerus) were constructed to accommodate 6 shoulder movements (flexion, extension, abduction, adduction, internal rotation, and external rotation), and then, 9 muscles (coracobrachialis, deltoid, infraspinatus, latissimus dorsi, pectoralis majors, subscapularis, supraspinatus, teres major, and teres minor) that are primarily involved in each movement were built . The reconstructed bones and muscles have been anatomically validated and are shown in . These were then used to construct animations of muscle movements ( ). The alignment and rotation angles of bones in the normal range of shoulder movement were implemented in the animation based on a kinesiology textbook [ ].
Next, we developed a visualization application using the digital reconstruction of shoulder movements. The user interface of the application is shown inA. The following functions were programmed in the application: present the name of the structure where the mouse is located; change the visibility of bones and muscles ( B); play/stop shoulder movement animation through the animation bar ( C); and move, rotate, or zoom in/out of the entire structure ( D). Using this application, we demonstrated a 3D real-time visualization of each structure and movement of interest.
The ultimate goal of a human digital twin is the development of a comprehensive whole-body digital twin that includes the body structure and movement. This will enable the modeling of various diseases at the systemic level without limitation to a single organ or stationary postures. In this study, we used CT images to build a 3D digital representation of the shoulders comprising bones and muscles, and developed an application for visualizing shoulder movements. To the best of our knowledge, this is the first report implementing an application for the visualization of shoulder movements involving bones and agonistic muscles.
Future research will lead to the development of an algorithm to import patient-specific CT data and present it in our 3D visualization application. This includes an automated system that can identify normal and abnormal ranges of motion and can be used for the development of medical applications in arthroplasty or rehabilitation. Furthermore, it will be possible to develop an evolving digital twin that can continuously reflect and update changes that occur during the human life cycle.
The authors would like to thank Hyung-Seok Choi and Soo-Hyun Chae, medical illustrators at Ewha Medical Academy, for their work in creating illustration content. This research was funded by the Korea Institute of Science and Technology Information (grant K-22-L01-C03).
KHL, KC, and SHH conceptualized the study. YHK, IP, SBC, SY, and IK curated the data. SHH acquired the funding. YHK and IK conducted the investigation. KHL, KC, IK, and SHH developed the methodology. YHK and SHH were the project administrators. IP and SBC were involved with the resources. SHH and KC supervised the study. IP and SY performed the validation. YHK wrote the original draft. YHK, IP, SBC, SY, and SHH reviewed and edited the paper.
Conflicts of Interest
IK is the founder and chief executive officer of SurgicalMind Inc. The remaining authors have no actual or potential conflicts of interest to declare.
Animation of muscle contraction, relaxation, and rotation.MP4 File (MP4 Video), 180657 KB
- Qin J, Wu J. Realizing the potential of computer-assisted surgery by embedding digital twin technology. JMIR Med Inform 2022 Nov 08;10(11):e35138 [https://medinform.jmir.org/2022/11/e35138/] [CrossRef] [Medline]
- Fagherazzi G. Deep digital phenotyping and digital twins for precision health: time to dig deeper. J Med Internet Res 2020 Mar 03;22(3):e16770 [https://www.jmir.org/2020/3/e16770/] [CrossRef] [Medline]
- Digital Korean. URL: http://dk.kisti.re.kr/ [accessed 2023-09-29]
- Kwak DS, Surendran S, Pengatteeri YH, Park SE, Choi KN, Gopinathan P, et al. Morphometry of the proximal tibia to design the tibial component of total knee arthroplasty for the Korean population. Knee 2007 Aug;14(4):295-300 [CrossRef] [Medline]
- Kim M, Kwak D, Park C, Park S, Oh S, Lee S, et al. Quantitative anatomy of the endplate of the middle and lower cervical vertebrae in Koreans. Spine (Phila Pa 1976) 2007 Jun 15;32(14):E376-E381 [CrossRef] [Medline]
- Hernigou P, Olejnik R, Safar A, Martinov S, Hernigou J, Ferre B. Digital twins, artificial intelligence, and machine learning technology to identify a real personalized motion axis of the tibiotalar joint for robotics in total ankle arthroplasty. Int Orthop 2021 Sep;45(9):2209-2217 [CrossRef] [Medline]
- Bindal VD. Textbook of Kinesiology. First edition. New Delhi, India: Jaypee; 2018.
- Neumann DA. Kinesiology of the Musculoskeletal System: Foundations for Physical Rehabilitation. First edition. St. Louis, MO: Mosby; 2002.
|CT: computed tomography|
Edited by T Leung, T de Azevedo Cardoso; submitted 21.04.23; peer-reviewed by J Wu, M Brown, V Girishan Prabhu; comments to author 16.07.23; revised version received 15.09.23; accepted 26.09.23; published 05.10.23Copyright
©Yu-Hee Kim, In Park, Soo Buem Cho, Seoyon Yang, Il Kim, Kyong-Ha Lee, Kwangnam Choi, Seung-Ho Han. Originally published in the Interactive Journal of Medical Research (https://www.i-jmr.org/), 05.10.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.i-jmr.org/, as well as this copyright and license information must be included.