Advances in the application of mixed reality in lung nodule surgery

doi:10.3877/cma.j.issn.2095-8773.2024.04.08

Abstract

Abstract:

The precise localization and the reduction of complications resulting from anatomical variations are the primary challenges in pulmonary nodule surgery.As a novel display technology that fuses virtual digital images with the real world，mixed reality has been initially applied in pulmonary nodule surgery，offering a promising new approach to addressing this challenge.Mixed reality technology is poised to become a significant aid in performing accurate and safe pulmonary nodule surgery in the future.It can assist in preoperative nodule localization and adjacent structure assessment and surgical plan development，assist in precise and safe navigation during surgery，facilitate communication between doctors and patients，and promise to shorten the learning curve of pulmonary nodule surgery.This review describes the application and research progress of mixed reality technology in pulmonary nodule surgery and discusses its benefits and drawbacks at current stage.

Key words: Mixed reality, Video-assisted thoracoscopic surgery, Pulmonary nodules

Jiawei Wang, Guangjian Zhang, Haonan Du, Chenao Yu, Jia Zhang. Advances in the application of mixed reality in lung nodule surgery[J]. Chinese Journal of Thoracic Surgery(Electronic Edition), 2024, 11(04): 254-259.

/ / Recommend

Add to citation manager EndNote|Ris|BibTeX

URL: https://zhxbwkdzzz.cma-cmc.com.cn/EN/10.3877/cma.j.issn.2095-8773.2024.04.08

https://zhxbwkdzzz.cma-cmc.com.cn/EN/Y2024/V11/I04/254

References 40

1	GBD 2019 Respiratory Tract Cancers Collaborators. Global，regional， and national burden of respiratory tract cancers and associated risk factors from 1990 to 2019: a systematic analysis for the Global Burden of Disease Study 2019［J］.Lancet Respir Med，2021，9（9）：1030-1049.
2	Cancer Today［EB/OL］. ［2024-07-15］. https://gco.iarc.fr/today/en.
3	Li N，Tan F，Chen W，et al.One-off low-dose CT for lung cancer screening in China: a multicentre， population-based，prospective cohort study［J］.Lancet Respir Med，2022，10（4）：378-391.
4	Aokage K，Suzuki K，Saji H，et al.Segmentectomy for groundglass-dominant lung cancer with a tumour diameter of 3 cm or less including ground-glass opacity （JCOG1211）: a multicentre，single-arm， confirmatory， phase 3 trial［J］.Lancet Respir Med，2023，11（6）：540-549.
5	Saji H，Okada M，Tsuboi M，et al.Segmentectomy versus lobectomy in small-sized peripheral non-small-cell lung cancer（JCOG0802/WJOG4607L）: a multicentre， open-label， phase 3，randomised， controlled， non-inferiority trial［J］.Lancet，2022，399（10335）：1607-1617.
6	Liu C，Yang Z，Li Y，et al.Intentional wedge resection versus segmentectomy for ≤2 cm ground-glass-opacity-dominant nonsmall cell lung cancer: a real-world study using inverse probability of treatment weighting［J］.Int J Surg，2024，110（7）：4231-4239.
7	National Comprehensive Cancer Network. Non-Small Cell Lung Cancer （NSCLC） Guidelines. Version 1.2024［EB/OL］. ［2024-07-15］.https://www.nccn.org/professionals/physician_gls/pdf/nscl.pdf.
8	Polaczek M，Szaro P，Jakubowska L，et al.Pulmonary veins variations with potential impact in thoracic surgery: a computedtomography-based atlas［J］.J Thorac Dis，2020，12（3）：383-393.
9	辛宁.基于混合现实引导的肺结节定位方法的研究［D］.上海：中国人民解放军海军军医大学，2024.
10	Wang Y，Chen E.Advances in the localization of pulmonary nodules: a comprehensive review［J］.J Cardiothorac Surg，2024，19（1）：396.
11	侯建存，张雅敏.混合现实技术在肝胆外科领域中的应用［J］.中华外科杂志，2022，60（1）：17-21.
12	Lungu AJ，Swinkels W，Claesen L，et al.A review on the applications of virtual reality， augmented reality and mixed reality in surgical simulation: an extension to different kinds of surgery［J］.Expert Rev Med Devices，2021，18（1）：47-62.
13	Tan W，Ge W，Hang Y，et al.Computer assisted system for precise lung surgery based on medical image computing and mixed reality［J］.Health Inf Sci Syst，2018，6（1）：10.
14	Perkins SL，Krajancich B，Yang CJ，et al.A Patient-Specific Mixed-Reality Visualization Tool for Thoracic Surgical Planning［J］.Ann Thorac Surg，2020，110（1）：290-295.
15	Xiang N，Liang HN，Yu L，et al.A mixed reality framework for microsurgery simulation with visual-tactile perception.Visual Computer，2023，39（8）：3661-3673.
16	Xin N，Wu X，Chen Z，et al.A new preoperative localization of pulmonary nodules guided by mixed reality: a pilot study of an animal model［J］.Transl Lung Cancer Res，2023，12（1）：150-157.
17	Zhang JT，Zhang T，Qiu ZW，et al.Metal-marked mixed reality technology for pulmonary nodule localization［J］.Interact Cardiovasc Thorac Surg，2019，29（3）：494.
18	Kudo Y，Omori T，Amemiya R，et al.Navigation of tumor location and intersegmental planes utilizing mixed reality in video-assisted thoracic surgery for non-small cell lung cancer: a case report of right S2 segmentectomy［J］.Video-assist Thorac Surg，2024，9：13.
19	Fu R，Zhang C，Zhang T，et al.A three-dimensional printing navigational template combined with mixed reality technique for localizing pulmonary nodules［J］.Interact Cardiovasc Thorac Surg，2021，32（4）：552-559.
20	Song Z. Application of Mixed Reality Technique for Percutaneous Lung Nodule Localization: A Prospective，Randomized， Controlled Trial［EB/OL］. ［2024-08-24］. https://ctv.veeva.com/study/application-of-mixed-reality-technique-forpercutaneous-lung-nodule-localization-a-prospective-ran.
21	Lu K，Marino NE，Russell D，et al.Use of Short Message Service and Smartphone Applications in the Management of Surgical Patients: A Systematic Review［J］.Telemed J E Health，2018，24（6）：406-414.
22	朱佳.泌尿外科医疗纠纷的成因与对策［J］.中医药管理杂志，2019，27（1）：152-153.
23	陈子豪，黄可南，丁新宇，等.混合现实技术在肺结节术前讨论及术中应用的研究［J］.中国胸心血管外科临床杂志，2020，27（7）：797-801.
24	Mortman KD，Mortman R，Sadur A.Three Hundred and Sixty-Degree Virtual Reality Consultation for the Thoracic Surgery Patient［J］.Journal of the American College of Surgeons，2019，229（Supplement 2）：e211.
25	Bala L，Kinross J，Martin G，et al.A remote access mixed reality teaching ward round［J］.Clin Teach，2021，18（4）：386-390.
26	Kim H，Kwon H，Lim W，et al.Quantitative Assessment of the Learning Curve for Robotic Thyroid Surgery［J］.J Clin Med，2019，8（3）：402.
27	高永山，张志杰，付伟，等.单操作孔胸腔镜肺段切除治疗早期非小细胞肺癌的学习曲线［J］.中国微创外科杂志，2021，21（12）：1072-1076.
28	Vervoorn MT，Wulfse M，Van Doormaal TPC，et al.Mixed Reality in Modern Surgical and Interventional Practice:Narrative Review of the Literature［J］.JMIR Serious Games，2023，11：e41297.
29	Mahajan AP，Inniss DA，Benedict MD，et al.The First International Surgical Grand Rounds Using Immersive Mixed Reality Headset Devices［J］.Journal of the American College of Surgeons，2021，233（5）：S116.
30	Casas-Yrurzum S，Gimeno J，Casanova-Salas P，et al.A new mixed reality tool for training in minimally invasive roboticassisted surgery［J］.Health Inf Sci Syst，2023，11（1）：34.
31	彭雷，林庆，吴昊，等.机器人辅助胸腔镜肺段切除日间手术一例［J］.临床外科杂志，2023，31（2）：145-146.
32	秦长娟.达芬奇机器人与胸腔镜辅助肺段切除术近期疗效对比分析［D］.长春：吉林大学，2024.
33	Sánchez-Margallo JA，Plaza de Miguel C，Fernández Anzules RA，et al.Application of Mixed Reality in Medical Training and Surgical Planning Focused on Minimally Invasive Surgery［J］.Front Virtual Real，2021，2：692641.
34	Devoto L，Muscroft S，Chand M.Highly Accurate， Patient-Specific， 3-Dimensional Mixed-Reality Model Creation for Surgical Training and Decision-making［J］.JAMA Surg，2019，154（10）：968-969.
35	Rebenitsch L，Owen C.Review on cybersickness in applications and visual displays［J］.Virtual Reality，2016，20（2）：101-125.
36	Hein O，Rauschnabel P，Hassib M，et al.Sick in the Car，Sick in VR？ Understanding How Real-World Susceptibility to Dizziness， Nausea， and Eye Strain Influences VR Motion Sickness［C］//Abdelnour Nocera J，Kristín Lárusdóttir M，Petrie H，et al.Human-Computer Interaction - INTERACT 2023.Cham：Springer Nature Switzerland，2023：552-573.
37	Hazarika A，Rahmati M.Towards an Evolved Immersive Experience: Exploring 5G- and Beyond-Enabled Ultra-Low-Latency Communications for Augmented and Virtual Reality［J］.Sensors （Basel），2023：23（7）：3682.
38	Cheng S.Metaverse and Immersive Interaction Technology［M］//Cheng S.Metaverse: Concept， Content and Context.Cham：Springer Nature Switzerland，2023：47-81.
39	Attaran M.The impact of 5G on the evolution of intelligent automation and industry digitization［J］.J Ambient Intell Humaniz Comput，2023，14（5）：5977-5993.
40	Deng Z，Xiang N，Pan J.State of the Art in Immersive Interactive Technologies for Surgery Simulation: A Review and Prospective［J］.Bioengineering （Basel），2023，10（12）：1346.

[1]	Jingxin Chen, Mei Li, Jieya Chen. Risk factors related to pulmonary infection after thoracoscopic pulmonary nodules [J]. Chinese Journal of Experimental and Clinical Infectious Diseases(Electronic Edition), 2023, 17(04): 238-243.
[2]	Chengyi You, Heng You, Dongfang Ye, Wen Zhang, Yu Liu, Renyu Wang, Linxi Su, Hui Gan, Zhi Xu. Establishment of a prediction model for benign and malignant pulmonary nodules based on 3D Res UNet-Faster RCNN and CT imaging features [J]. Chinese Journal of Lung Diseases(Electronic Edition), 2024, 17(05): 673-679.
[3]	Liangjie Xie, Jian Wang, Tao Yang. Value analysis of CT image features based on AI in differential diagnosis of benign and malignant Pulmonary nodules [J]. Chinese Journal of Lung Diseases(Electronic Edition), 2024, 17(02): 242-246.
[4]	Li Jiang, Xiaohui Wang, Weiyi Li, Shuangyun Gou, Min Ding, Li Yang. Influence of innovative intelligent health education and follow-up management on anxiety of patients with pulmonary nodules: a randomized control trial [J]. Chinese Journal of Lung Diseases(Electronic Edition), 2023, 16(04): 485-489.
[5]	Huajuan Li, Yingjun Tang, Saini Wang, Wang Xu, Ling Lin, Xi Li, Huaping Huang. Analysis of clinical and CT features of the patients with pulmonary nodules and establishment of prediction model to evaluate the probability of malignancy in pulmonary nodules [J]. Chinese Journal of Lung Diseases(Electronic Edition), 2023, 16(03): 318-323.
[6]	Ji Chen, Caixia Deng, Houli Zhang, Bingjing Zhu, Pan Liu, Jian He, Chunlan Tang, Xiangdong Zhou, Hu Luo. Study on the cognitive and anxiety status of patients with high-risk pulmonary nodules [J]. Chinese Journal of Lung Diseases(Electronic Edition), 2023, 16(02): 164-168.
[7]	Yufang Chen, Kang Wang, Wenhao Wu, Houli Zhang, Xiangdong Zhou. Prognostic analysis of adjuvant targeted therapy for EGFR-positive ⅠA stage invasive lung adenocarcinoma after complete resection [J]. Chinese Journal of Lung Diseases(Electronic Edition), 2022, 15(06): 776-781.
[8]	Tian Zhao, Miao Zhang, Wenbin Wu, Hui Zhang, Xiaojing Wang, Hao Zhang. The learning curve of uniportal video-assisted thoracoscopic segmentectomy and subsegmentectomy [J]. Chinese Journal of Laparoscopic Surgery(Electronic Edition), 2023, 16(03): 158-164.
[9]	Zongming Zhang, Jiahong Dong, Xiaodong He, Qiusheng Wang, Zhi Xu, Limin Liu, Chong Zhang. Controversy and reflection on hot issues of biliary surgery in elderly patients [J]. Chinese Journal of Hepatic Surgery(Electronic Edition), 2024, 13(06): 754-762.
[10]	Ying'an Li, Yun Jin, Xinyun Chu, Pingping Hu, Junfeng Wang. Application of mixed reality technology in navigation of laparoscopic hepatectomy [J]. Chinese Journal of Hepatic Surgery(Electronic Edition), 2023, 12(04): 401-406.
[11]	Yi Wang, Junfeng Wang, Chao Yang. Current application of digital medical technology in liver segmentation and anatomical hepatectomy [J]. Chinese Journal of Hepatic Surgery(Electronic Edition), 2023, 12(01): 16-21.
[12]	Xiaofeng Li, Li Xu, Jiankun Zhu, Feng Jin, Yunzeng Zhang. Application of LungPro bronchoscopic navigation-guided indocyanine green injection for localization in the surgery of multiple lung nodules [J]. Chinese Journal of Thoracic Surgery(Electronic Edition), 2024, 11(04): 231-235.
[13]	Jianqiao Cai, Lei Jiang. Comparison of uniportal video-assisted thoracoscopic and thoracotomy double sleeve lobectomy for the treatment of non-small cell lung cancer [J]. Chinese Journal of Thoracic Surgery(Electronic Edition), 2024, 11(04): 225-230.
[14]	Yu Wang, Zekai Zhang, Mingsheng Wu, Gaoxiang Wang, Xiaohui Sun, Jun Wang, Meiqing Xu, Tian Li, Shibin Xu, Mingran Xie. Clinical characteristics of 323 patients with postoperative pathological diagnosis of benign pulmonary nodules [J]. Chinese Journal of Thoracic Surgery(Electronic Edition), 2024, 11(03): 167-174.
[15]	Wei Luo, Yize Li, Ran Cao, Xugang Zhang, Qing Yin, Kun Wang. Uniportal thoracoscopic right upper lobectomy: a case series of double-stapling technique [J]. Chinese Journal of Thoracic Surgery(Electronic Edition), 2023, 10(04): 200-206.

Please choose a citation manager

Content to export