Published on in Vol 12 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/48381, first published .
Three-Dimensional Virtual Reconstructions of Shoulder Movements Using Computed Tomography Images: Model Development

Three-Dimensional Virtual Reconstructions of Shoulder Movements Using Computed Tomography Images: Model Development

Three-Dimensional Virtual Reconstructions of Shoulder Movements Using Computed Tomography Images: Model Development

Research Letter

1Advanced Biomedical Research Institute, Ewha Womans University Seoul Hospital, Seoul, Republic of Korea

2Department of Orthopedic Surgery, Ewha Womans University College of Medicine, Seoul, Republic of Korea

3Department of Radiology, Ewha Womans University College of Medicine, Seoul, Republic of Korea

4Department of Rehabilitation Medicine, Ewha Womans University College of Medicine, Seoul, Republic of Korea

5SurgicalMind Inc, Gwangju, Republic of Korea

6Division of National S&T Data, Korea Institute of Science and Technology Information, Daejeon, Republic of Korea

7Department of Anatomy, Ewha Womans University College of Medicine, Seoul, Republic of Korea

8Ewha Medical Academy, Ewha Womans University Medical Center, Seoul, Republic of Korea

Corresponding Author:

Seung-Ho Han, MD, PhD

Department of Anatomy

Ewha Womans University College of Medicine

25 Magokdong-ro 2-gil

Gangseo-gu

Seoul, 07804

Republic of Korea

Phone: 82 2 6986 2601

Email: sanford@ewha.ac.kr




The demand for digital reconstruction of the human body, the “human digital twin,” is increasing. Areas where human digital twins can be used include supporting disease diagnoses and predicting various treatment outcomes [1,2]. However, accurate digitalization of the structure and function of the human body is required, and a digital twin of the whole skeleton will provide a broader understanding of the human body. The Digital Korean Project, which was conducted from 2003 to 2007, established a database of Korean skeletons that included physical properties [3] and is being used in various research fields [4,5]. Digital representations of the human skeleton can be constructed at a higher level by including movement. Recently, Hernigou et al [6] proposed a method to include an ankle motion axis in digital twins. Although this method can be useful, one drawback of this study was that muscle movement was not included. This is because human skeletal movements cannot be evaluated except for the muscles. Therefore, in this study, we aimed to develop a visualization application of human shoulder movements involving bones and muscles.


Overview

Computed tomography (CT) images of the shoulders obtained at Ewha Womans University Seoul Hospital were used for 3D modeling. CT images in the DICOM file format were converted to an STL file format and then imported into the Blender program (Blender Institute). The size and volume of each bone and muscle involved in shoulder movement were measured and used for image visualization and 3D modeling. For the virtual reconstruction of shoulder movement, the Controller function was used to crudely model bone and muscle movement, and the Shapekey function was used to further adjust muscle contraction, relaxation, and rotation.

The Unity engine (Unity Technologies, San Francisco, CA) was used to develop a real-time 3D visualization application of shoulder movements. Reconstructed 3D resources and shoulder movement animations were exported from the Blender program in the FilmBoX file format and imported as Unity assets. A separate collision box was generated to avoid slowdown during the real-time selection of bones and muscles in polygonal units. Unity cameras were customized to display 3D structures and animations from different viewpoints. Interactive visibility controls for each bone and muscle were designated, and animation sequences were programmed for each motion.

Ethical Considerations

This study received ethics approval from Ewha Womans University Seoul Hospital (ethics approval No. 2023-02-037).


To build a 3D model of the shoulders, 3 bones (scapula, clavicle, and humerus) were constructed to accommodate 6 shoulder movements (flexion, extension, abduction, adduction, internal rotation, and external rotation), and then, 9 muscles (coracobrachialis, deltoid, infraspinatus, latissimus dorsi, pectoralis majors, subscapularis, supraspinatus, teres major, and teres minor) that are primarily involved in each movement were built [7]. The reconstructed bones and muscles have been anatomically validated and are shown in Figure 1. These were then used to construct animations of muscle movements (Multimedia Appendix 1). The alignment and rotation angles of bones in the normal range of shoulder movement were implemented in the animation based on a kinesiology textbook [8].

Next, we developed a visualization application using the digital reconstruction of shoulder movements. The user interface of the application is shown in Figure 2A. The following functions were programmed in the application: present the name of the structure where the mouse is located; change the visibility of bones and muscles (Figure 2B); play/stop shoulder movement animation through the animation bar (Figure 2C); and move, rotate, or zoom in/out of the entire structure (Figure 2D). Using this application, we demonstrated a 3D real-time visualization of each structure and movement of interest.

Figure 1. Three-dimensional reconstruction of muscles involved in shoulder movement. The muscles involved in shoulder movement, which were manually segmented using computed tomography DICOM files, were reconstructed in 3D and placed on the bones.
Figure 2. Application for visualization of shoulder movement. (A) A visualization application for real-time simulation of shoulder movement was constructed. Functions included in the application are shown. (B) Present the structure name and change the visibility; (C) play the movement animation; and (D) move, rotate, or zoom in/out of the structure.

The ultimate goal of a human digital twin is the development of a comprehensive whole-body digital twin that includes the body structure and movement. This will enable the modeling of various diseases at the systemic level without limitation to a single organ or stationary postures. In this study, we used CT images to build a 3D digital representation of the shoulders comprising bones and muscles, and developed an application for visualizing shoulder movements. To the best of our knowledge, this is the first report implementing an application for the visualization of shoulder movements involving bones and agonistic muscles.

Future research will lead to the development of an algorithm to import patient-specific CT data and present it in our 3D visualization application. This includes an automated system that can identify normal and abnormal ranges of motion and can be used for the development of medical applications in arthroplasty or rehabilitation. Furthermore, it will be possible to develop an evolving digital twin that can continuously reflect and update changes that occur during the human life cycle.

Acknowledgments

The authors would like to thank Hyung-Seok Choi and Soo-Hyun Chae, medical illustrators at Ewha Medical Academy, for their work in creating illustration content. This research was funded by the Korea Institute of Science and Technology Information (grant K-22-L01-C03).

Authors' Contributions

KHL, KC, and SHH conceptualized the study. YHK, IP, SBC, SY, and IK curated the data. SHH acquired the funding. YHK and IK conducted the investigation. KHL, KC, IK, and SHH developed the methodology. YHK and SHH were the project administrators. IP and SBC were involved with the resources. SHH and KC supervised the study. IP and SY performed the validation. YHK wrote the original draft. YHK, IP, SBC, SY, and SHH reviewed and edited the paper.

Conflicts of Interest

IK is the founder and chief executive officer of SurgicalMind Inc. The remaining authors have no actual or potential conflicts of interest to declare.

Multimedia Appendix 1

Animation of muscle contraction, relaxation, and rotation.

MP4 File (MP4 Video), 180657 KB

  1. Qin J, Wu J. Realizing the potential of computer-assisted surgery by embedding digital twin technology. JMIR Med Inform. Nov 08, 2022;10(11):e35138. [FREE Full text] [CrossRef] [Medline]
  2. Fagherazzi G. Deep digital phenotyping and digital twins for precision health: time to dig deeper. J Med Internet Res. Mar 03, 2020;22(3):e16770. [FREE Full text] [CrossRef] [Medline]
  3. Digital Korean. URL: http://dk.kisti.re.kr/ [accessed 2023-09-29]
  4. Kwak DS, Surendran S, Pengatteeri YH, Park SE, Choi KN, Gopinathan P, et al. Morphometry of the proximal tibia to design the tibial component of total knee arthroplasty for the Korean population. Knee. Aug 2007;14(4):295-300. [CrossRef] [Medline]
  5. Kim M, Kwak D, Park C, Park S, Oh S, Lee S, et al. Quantitative anatomy of the endplate of the middle and lower cervical vertebrae in Koreans. Spine (Phila Pa 1976). Jun 15, 2007;32(14):E376-E381. [CrossRef] [Medline]
  6. Hernigou P, Olejnik R, Safar A, Martinov S, Hernigou J, Ferre B. Digital twins, artificial intelligence, and machine learning technology to identify a real personalized motion axis of the tibiotalar joint for robotics in total ankle arthroplasty. Int Orthop. Sep 2021;45(9):2209-2217. [CrossRef] [Medline]
  7. Bindal VD. Textbook of Kinesiology. First edition. New Delhi, India. Jaypee; 2018.
  8. Neumann DA. Kinesiology of the Musculoskeletal System: Foundations for Physical Rehabilitation. First edition. St. Louis, MO. Mosby; 2002.


CT: computed tomography


Edited by T Leung, T de Azevedo Cardoso; submitted 21.04.23; peer-reviewed by J Wu, M Brown, V Girishan Prabhu; comments to author 16.07.23; revised version received 15.09.23; accepted 26.09.23; published 05.10.23.

Copyright

©Yu-Hee Kim, In Park, Soo Buem Cho, Seoyon Yang, Il Kim, Kyong-Ha Lee, Kwangnam Choi, Seung-Ho Han. Originally published in the Interactive Journal of Medical Research (https://www.i-jmr.org/), 05.10.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.i-jmr.org/, as well as this copyright and license information must be included.