1
|
Dang Y, Zhang J, Chen J, Jiang T, Han J. YoMo: Yoshimura Continuum Manipulator for MR Environment. Soft Robot 2025; 12:268-279. [PMID: 39388237 DOI: 10.1089/soro.2023.0262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2024] Open
Abstract
Origami robots have garnered attention due to their versatile deformation and potential applications, particularly for medical applications. In this article, we propose a Yoshimura continuum manipulator (YoMo) that can achieve accurate control of the tip position for the magnetic resonance (MR) environment. The YoMo made of a single piece of paper is cable-actuated to generate the bending and shortening deformation. The paper-based YoMo attached to an arc frame can readily function under different orientations in the MR environment. The design and fabrication of YoMo were formulated according to the Yoshimura folding pattern. The kinematics model based on constant curvature assumption was derived as a benchmark method to predict the tip position of the YoMo. The Koopman operator theory was applied to describe the relationship between the tip position and the length change under different orientations. The linear quadratic regulator integrated into the Koopman-based model (K-LQR) was adopted to achieve the trajectory tracking. Comprehensive experiments were carried out to examine the proposed YoMo, its modeling and control methods. The performance of the YoMo including stiffness and workspace was characterized via a customized test setup. The Koopman-based method demonstrates the superiority over the constant curvature-based model to predict the tip position. The K-LQR control method was examined with different trajectories, and the impact of the orientation, speed, and different trajectories were taken into consideration. The results demonstrate the YoMo is capable of achieving trajectory tracking with satisfied accuracy, indicating its potential for medical applications in the MR environment.
Collapse
Affiliation(s)
- Yu Dang
- College of Artificial Intelligence, Nankai University, Tianjin, China
- Engineering Research Center of Trusted Behavior Intelligence, Ministry of Education, Nankai University, Tianjin, China
- Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin, China
- Institute of Intelligence Technology and Robotic Systems, Shenzhen Research Institute of Nankai University, Shenzhen, China
| | - Jingyu Zhang
- College of Artificial Intelligence, Nankai University, Tianjin, China
- Engineering Research Center of Trusted Behavior Intelligence, Ministry of Education, Nankai University, Tianjin, China
- Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin, China
- Institute of Intelligence Technology and Robotic Systems, Shenzhen Research Institute of Nankai University, Shenzhen, China
| | - Jie Chen
- College of Artificial Intelligence, Nankai University, Tianjin, China
- Engineering Research Center of Trusted Behavior Intelligence, Ministry of Education, Nankai University, Tianjin, China
- Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin, China
- Institute of Intelligence Technology and Robotic Systems, Shenzhen Research Institute of Nankai University, Shenzhen, China
| | - Tianyu Jiang
- Department of Rehabilitation Medicine, The Second Medical Center, Chinese PLA General Hospital, Beijing, China
- National Clinical Research Center for Geriatric Diseases, Beijing, China
- National Key Laboratory of Kidney Diseases, Beijing, China
| | - Jianda Han
- College of Artificial Intelligence, Nankai University, Tianjin, China
- Engineering Research Center of Trusted Behavior Intelligence, Ministry of Education, Nankai University, Tianjin, China
- Tianjin Key Laboratory of Intelligent Robotics, Nankai University, Tianjin, China
- Institute of Intelligence Technology and Robotic Systems, Shenzhen Research Institute of Nankai University, Shenzhen, China
| |
Collapse
|
2
|
Huang S, Wang Z, Li M, Song Y, Li Y. Current Status and Future Perspectives of Robot-Assisted Dental Implant Surgery. Int Dent J 2025; 75:1608-1620. [PMID: 40138995 DOI: 10.1016/j.identj.2025.02.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2025] [Revised: 02/15/2025] [Accepted: 02/24/2025] [Indexed: 03/29/2025] Open
Abstract
Dental implant surgery is now a well versed approach for tooth replacement, addressing various limitations of fixed bridges and removable dentures, thereby reinstating both the form and function of missing teeth. However, it is technically sensitive and highly dependent on the clinical experience and the expertise of the dentist. With breakthrough progress in robot-assisted surgery for a variety of systemic diseases, robot-assisted dental implant surgery has emerged as a new way to potentially enhance the efficacy of dental implant procedures. Widely researched by dental researchers, it is progressively revealing advantages in the treatment of dentition defects or edentulism. This article summarizes the current research status of robot-assisted dental implant surgery and provides a perspective grounded in the ongoing research landscape.
Collapse
Affiliation(s)
- Shuang Huang
- Department of Stomatology, The Affiliated Shapingba Hospital of Chongqing University, Chongqing, China
| | - Zhongli Wang
- Department of Stomatology, The Affiliated Shapingba Hospital of Chongqing University, Chongqing, China
| | - Miaomiao Li
- Department of Stomatology, The Affiliated Shapingba Hospital of Chongqing University, Chongqing, China
| | - Yingli Song
- Department of Stomatology, The Affiliated Shapingba Hospital of Chongqing University, Chongqing, China.
| | - Yuezhi Li
- Department of Stomatology, The Affiliated Shapingba Hospital of Chongqing University, Chongqing, China.
| |
Collapse
|
3
|
Heisterberg L, Manfredi L, Wichmann D, Maier T, Pott PP. Design and evaluation of new user control devices for improved ergonomics in flexible robotic endoscopy. Front Robot AI 2025; 12:1559574. [PMID: 40196841 PMCID: PMC11973676 DOI: 10.3389/frobt.2025.1559574] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2025] [Accepted: 03/13/2025] [Indexed: 04/09/2025] Open
Abstract
Background The ergonomics of flexible endoscopes require improvement as the current design carries a high risk of musculoskeletal injury for endoscopists. Robotic systems offer a solution by separating the endoscope from the control handle, allowing a focus on ergonomics and usability. Despite the increasing interest in this field, little attention has been paid towards developing ergonomic human input devices. This study addresses two key questions: How can handheld control devices for flexible robotic endoscopy be designed to prioritize ergonomics and usability? And, how effective are these new devices in a simulated clinical environment? Methods Addressing this gap, the study proposes two handheld input device models for controlling a flexible endoscope in four degrees of freedom (DOFs) and an endoscopic instrument in three DOFs. A two-stage evaluation was conducted with six endoscopists evaluating the physical ergonomics and a final clinical user evaluation with seven endoscopists using a virtual colonoscopy simulator with proportional velocity and position mapping. Results and discussion Both models demonstrated clinical suitability, with the first model scoring 4.8 and the second model scoring 5.2 out of 6 in the final evaluation. In sum, the study presents two designs of ergonomic control devices for robotic colonoscopy, which have the potential to reduce endoscopy-related injuries. Furthermore, the proposed colonoscopy simulator is useful to evaluate the benefits of different mapping modes. This could help to optimize the design and control mechanism of future control devices.
Collapse
Affiliation(s)
- Leander Heisterberg
- Institute of Medical Device Technology, University of Stuttgart, Stuttgart, Germany
- Division of Imaging Science and Technology, Centre of Medical Engineering and Technology (CMET), School of Medicine, University of Dundee, Dundee, United Kingdom
| | - Luigi Manfredi
- Division of Imaging Science and Technology, Centre of Medical Engineering and Technology (CMET), School of Medicine, University of Dundee, Dundee, United Kingdom
| | - Dörte Wichmann
- Central Endoscopic Unit of the University Hospital Tübingen, Tübingen, Germany
| | - Thomas Maier
- Institute for Engineering Design and Industrial Design, University of Stuttgart, Stuttgart, Germany
| | - Peter P. Pott
- Institute of Medical Device Technology, University of Stuttgart, Stuttgart, Germany
| |
Collapse
|
4
|
Wang H, Du J, Mao Y. Cosserat Rod-Based Tendon Friction Modeling, Simulation, and Experiments for Tendon-Driven Continuum Robots. MICROMACHINES 2025; 16:346. [PMID: 40141957 PMCID: PMC11945068 DOI: 10.3390/mi16030346] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/06/2025] [Accepted: 03/17/2025] [Indexed: 03/28/2025]
Abstract
Traditional tendon-driven continuum robot (TDCR) models based on Cosserat rod theory often assume that tendon tension is a continuous wrench along the backbone. However, this assumption overlooks critical factors, including the discrete arrangement of disks, the segmented configuration of tensioned tendons, and the friction between tendons and guide holes. Additionally, tendon forces are not continuous but discrete, concentrated wrenches, with the frictional force magnitude and direction varying based on the TDCR's bending configuration. We propose a TDCR modeling method that integrates Cosserat rod theory with a finite element approach to address these limitations. We construct a Cosserat rod model for the robot's backbone, discretize the tendon geometry using the finite element method (FEM), and incorporate friction modeling between tendons and guide holes. Furthermore, we introduce an algorithm to determine the direction of friction forces, enhancing modeling accuracy. This approach results in a more realistic and comprehensive mathematical representation of TDCR behavior. Numerical simulations under various tendon-routing scenarios are conducted and compared with classical TDCR models. The results indicate that our friction-inclusive model improves accuracy, yielding an average configuration deviation of only 0.3% across different tendon routings. Experimental validation further confirms the model's accuracy and robustness.
Collapse
Affiliation(s)
- Honghong Wang
- School of Mechano-Electronic Engineering, Xidian University, Xi’an 710071, China
| | - Jingli Du
- School of Mechano-Electronic Engineering, Xidian University, Xi’an 710071, China
| | - Yi Mao
- School of Chemical and Material Engineering, Jiangnan University, Wuxi 214122, China;
| |
Collapse
|
5
|
Bouzari N, Nasseri R, Huang J, Ganguly S, Tang XS, Mekonnen TH, Aghakhani A, Shahsavan H. Hybrid Zwitterionic Hydrogels with Encoded Differential Swelling and Programmed Deformation for Small-Scale Robotics. SMALL METHODS 2025; 9:e2400812. [PMID: 39044713 PMCID: PMC11926519 DOI: 10.1002/smtd.202400812] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/08/2024] [Indexed: 07/25/2024]
Abstract
Stimuli-responsive shape-morphing hydrogels with self-healing and tunable physiochemical properties are excellent candidates for functional building blocks of untethered small-scale soft robots. With mechanical properties similar to soft organs and tissues, such robots enable minimally invasive medical procedures, such as cargo/cell transportation. In this work, responsive hydrogels based on zwitterionic/acrylate chemistry with self-healing and stimuli-responsiveness are synthesized. Such hydrogels are then judiciously cut and pasted to form hybrid constructs with predetermined swelling and elastic anisotropy. This method is used to program hydrogel constructs with predetermined 2D-to-3D deformation upon exposure to different environmental ionic strengths. Untethered soft robotic functionalities are demonstrated, such as actuation, magnetic locomotion, and targeted transport of soft and light cargo in flooded media. The proposed hydrogel expands the repertoire of functional materials for fabricating small-scale soft robots.
Collapse
Affiliation(s)
- Negin Bouzari
- Department of Chemical Engineering, Waterloo Institute for Nanotechnology, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
| | - Rasool Nasseri
- Department of Chemical Engineering, Waterloo Institute for Nanotechnology, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
| | - Junting Huang
- Department of Chemical Engineering, Waterloo Institute for Nanotechnology, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
| | - Sayan Ganguly
- Department of Chemistry, Waterloo Institute for Nanotechnology, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
| | - Xiaowu Shirley Tang
- Department of Chemistry, Waterloo Institute for Nanotechnology, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
| | - Tizazu H Mekonnen
- Department of Chemical Engineering, Waterloo Institute for Nanotechnology, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
- Institute of Polymer Research, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
| | - Amirreza Aghakhani
- Institute of Biomaterials and Biomolecular Systems (IBBS), University of Stuttgart, Pfaffenwaldring 57, 70569, Stuttgart, Germany
| | - Hamed Shahsavan
- Department of Chemical Engineering, Waterloo Institute for Nanotechnology, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
- Center for Bioengineering and Biotechnology, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
| |
Collapse
|
6
|
Heemeyer F, Boehler Q, Kim M, Bendok BR, Turcotte EL, Batjer HH, Madder RD, Pereira VM, Nelson BJ. Telesurgery and the importance of context. Sci Robot 2025; 10:eadq0192. [PMID: 40009655 DOI: 10.1126/scirobotics.adq0192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Accepted: 01/28/2025] [Indexed: 02/28/2025]
Abstract
Telesurgery has the potential to overcome geographical barriers in surgical care, encouraging its deployment in areas with sparse surgical expertise. Despite successful in-human experiments and substantial technological progress, the adoption of telesurgery remains slow. In this Review, we analyze the reasons for this slow adoption. First, we identify various contexts for telesurgery and highlight the vastly different requirements for their realization. We then discuss why procedures with high urgency and skill sparsity are particularly suitable for telesurgery. Last, we summarize key research areas essential for further progress. The goal of this Review is to provide the reader with a comprehensive analysis of the current state of telesurgery research and to provide guidance for faster adoption of this exciting technology.
Collapse
Affiliation(s)
| | | | - Minsoo Kim
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| | - Bernard R Bendok
- Department of Neurological Surgery, Mayo Clinic, Phoenix, AZ, USA
- Mayo Clinic College of Medicine and Science, Phoenix, AZ, USA
- Department of Radiology, Mayo Clinic, Phoenix, AZ, USA
- Department of Otolaryngology Head and Neck Surgery/Audiology, Mayo Clinic, Phoenix, AZ, USA
| | - Evelyn L Turcotte
- Mayo Clinic Alix School of Medicine, Mayo Clinic, Scottsdale, AZ, USA
| | - H Hunt Batjer
- Department of Neurological Surgery, Mayo Clinic, Phoenix, AZ, USA
- University of Texas Southwestern Medical Center, Dallas, TX, USA
- University of Texas at Tyler School of Medicine, Tyler, TX, USA
| | - Ryan D Madder
- Frederik Meijer Heart and Vascular Institute, Corewell Health West, Grand Rapids, MI, USA
| | - Vitor M Pereira
- Division of Neurosurgery, Department of Surgery, St. Michael's Hospital, University of Toronto, Toronto, ON, Canada
- RADIS Lab, Li Ka Shing Knowledge Institute, St. Michael's Hospital, University of Toronto, Toronto, ON, Canada
| | | |
Collapse
|
7
|
Gao H, Liu H, Jia H, Lin Z, Zou Y, Xu Z, Huang S, Tan H, Wu H, Chen W, Gao A. Multi-axis robotic forceps with decoupled pneumatic actuation and force sensing for cochlear implantation. Nat Commun 2025; 16:1648. [PMID: 39952944 PMCID: PMC11828907 DOI: 10.1038/s41467-025-56958-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Accepted: 02/03/2025] [Indexed: 02/17/2025] Open
Abstract
Delicate manual microsurgeries rely on sufficient hands-on experience for safe manipulations. Automated surgical devices can enhance the effectiveness, but developing high-resolution, multi-axis force-sensing devices for micro operations remains challenging. In this study, a 6-axis force-sensing pneumatic forceps with a serial-parallel robotic platform for cochlear implantation is developed. The forceps features a curved body shape embedded with parallel and inclined fiber Bragg grating sensors for 6-axis force sensing, and a pneumatic gripper with decoupled actuation is located at its end for actively grasping and releasing the electrode array. The robotic platform comprises a customized spherical parallel mechanism and a robotic arm, which can provide independent 3-DOF rotations and 3-DOF translations. The feasibility of the developed robotic forceps is validated through cadaveric studies on a temporal bone and a human cadaveric head. In summary, the robotic forceps provides a decoupled mechanism for pneumatic actuation and force sensing, further demonstrating its potential for force interaction and stable operation during robotic microsurgery.
Collapse
Affiliation(s)
- Hongyan Gao
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China
| | - Huanghua Liu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China
| | - Huan Jia
- Department of Otorhinolaryngology Head and Neck Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China
| | - Zecai Lin
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China
| | - Yun Zou
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, PR China
| | - Zheng Xu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China
| | - Shaoping Huang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, PR China
| | - Haoyue Tan
- Department of Otorhinolaryngology Head and Neck Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China
| | - Hao Wu
- Department of Otorhinolaryngology Head and Neck Surgery, Shanghai Ninth People's Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, PR China.
| | - Weidong Chen
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China.
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China.
| | - Anzhu Gao
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, PR China.
- Department of Automation, Shanghai Jiao Tong University, and the Key Laboratory of System Control and Information Processing, Ministry of Education, Shanghai, PR China.
| |
Collapse
|
8
|
Dogra A, Jones D, Hernandez Serrano AI, Chakraborty S, Young JJ, Page BG, Hardwicke J, Valdastri P, Pickwell-MacPherson E. Towards autonomous robotic THz-based in vivo skin sensing: the PicoBot. Sci Rep 2025; 15:4568. [PMID: 39915605 PMCID: PMC11803113 DOI: 10.1038/s41598-025-88718-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2024] [Accepted: 01/30/2025] [Indexed: 02/09/2025] Open
Abstract
Terahertz (THz) light has the unique properties of being very sensitive to water, non-ionizing, and having sub-millimeter depth resolution, making it suitable for medical imaging. Skin conditions including eczema, psoriasis and skin cancer affect a high percentage of the population and we have been developing a THz probe to help with their diagnosis, treatment and management. Our in vivo studies have been using a handheld THz probe, but this has been prone to positional errors through sensorimotor perturbations and tremors, giving spatially imprecise measurements and significant variations in contact pressure. As the operator tires through extended device use, these errors are further exacerbated. A robotic system is therefore needed to tune the critical parameters and achieve accurate and repeatable measurements of skin. This paper proposes an autonomous robotic THz acquisition system, the PicoBot, designed for non-invasive diagnosis of healthy and diseased skin conditions, based on hydration levels in the skin. The PicoBot can 3D scan and segment out the region of interest on the skin's surface, precisely position (± 0.5/1 mm/degrees) the probe normal to the surface, and apply a desired amount of force (± 0.1N) to maintain firm contact for the required 60 s during THz data acquisition. The robotic automation improves the stability of the acquired THz signals, reducing the standard deviation of amplitude fluctuations by over a factor of four at 1 THz compared to hand-held mode. We show THz results for skin measurements of volunteers with healthy and dry skin conditions on various parts of the body such as the volar forearm, forehead, cheeks, and hands. The tests conducted validate the preclinical feasibility of the concept along with the robustness and advantages of using the PicoBot, compared to a manual measurement setup.
Collapse
Affiliation(s)
- Anubhav Dogra
- Department of Physics, University of Warwick, Coventry, UK.
| | | | | | - Shruti Chakraborty
- Department of Physics, University of Warwick, Coventry, UK
- CEA LIST, Université Paris Saclay, Palaiseu, France
| | | | | | - Joseph Hardwicke
- Warwick Medical School, University of Warwick, Coventry, UK
- Institute of Applied and Translational Technologies in Surgery, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK
| | | | | |
Collapse
|
9
|
Cipolato O, Leuthold T, Zäch M, Männel G, Aegerter S, Sciascia C, Jessernig A, von Salis M, Sarcevic S, Rosendorf J, Liska V, Kundrat D, Quidant R, Herrmann IK. Robotic Laser Tissue Soldering for Atraumatic Soft Tissue Fusion Guided by Fluorescent Nanothermometry. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2025; 12:e2406671. [PMID: 39569684 PMCID: PMC11831491 DOI: 10.1002/advs.202406671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/16/2024] [Revised: 10/28/2024] [Indexed: 11/22/2024]
Abstract
Minimally invasive surgical techniques, including endoscopic and robotic procedures, continue to revolutionize patient care, for their ability to minimize surgical trauma, thus promoting faster recovery and reduced hospital stays. Yet, the suturing of soft tissues ensuring damage-free tissue bonding during these procedures remains challenging due to missing haptics and the fulcrum effect. Laser tissue soldering has potential in overcoming these issues, offering atraumatic seamless tissue fusion. To ensure the precision and safety of laser tissue soldering, the study introduces feedback-controlled fluorescent nanothermometry-guided laser tissue soldering using nanoparticle-protein solders within endoscopic and robotic contexts. Temperature-sensitive fluorescent nanoparticles embedded in the solder provide surgeons with immediate feedback on tissue temperatures during laser application, all while within the confines of minimally invasive (robotic) surgical setups. By integrating fluorescent nanothermometry-guided laser tissue surgery into endoscopic and robotic surgery, the study paves the way for a new approach for safe and atraumatic soft tissue joining, especially in regions where traditional suturing is unfeasible.
Collapse
Affiliation(s)
- Oscar Cipolato
- Nanoparticle Systems Engineering LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
- Particles Biology Interactions LaboratoryDepartment of Materials Meet LifeSwiss Federal Laboratories for Materials Science and Technology (Empa)Lerchenfeldstrasse 5St. Gallen9014Switzerland
- The Ingenuity LabUniversity Hospital BalgristForchstrasse 340Zurich8008Switzerland
- Faculty of MedicineUniversity of ZurichRämistrasse 71Zurich8006Switzerland
| | - Tobias Leuthold
- Nanoparticle Systems Engineering LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
| | - Marius Zäch
- Nanoparticle Systems Engineering LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
| | - Georg Männel
- Fraunhofer Research Institution for Individualized and Cell‐Based Medical Engineering IMTEMönkhoferweg23562LübeckGermany
| | - Sam Aegerter
- Nanoparticle Systems Engineering LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
| | - Calinda Sciascia
- Nanoparticle Systems Engineering LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
| | - Alexander Jessernig
- Nanoparticle Systems Engineering LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
- Particles Biology Interactions LaboratoryDepartment of Materials Meet LifeSwiss Federal Laboratories for Materials Science and Technology (Empa)Lerchenfeldstrasse 5St. Gallen9014Switzerland
- The Ingenuity LabUniversity Hospital BalgristForchstrasse 340Zurich8008Switzerland
- Faculty of MedicineUniversity of ZurichRämistrasse 71Zurich8006Switzerland
| | - Marco von Salis
- Nanoparticle Systems Engineering LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
| | - Sima Sarcevic
- Department of SurgeryFaculty of Medicine in PilsenCharles UniversityAlej Svobody 923/80Pilsen32300Czech Republic
- Biomedical CenterFaculty of Medicine in PilsenCharles UniversityAlej Svobody 1655/76Pilsen32300Czech Republic
| | - Jachym Rosendorf
- Department of SurgeryFaculty of Medicine in PilsenCharles UniversityAlej Svobody 923/80Pilsen32300Czech Republic
- Biomedical CenterFaculty of Medicine in PilsenCharles UniversityAlej Svobody 1655/76Pilsen32300Czech Republic
| | - Vaclav Liska
- Department of SurgeryFaculty of Medicine in PilsenCharles UniversityAlej Svobody 923/80Pilsen32300Czech Republic
- Biomedical CenterFaculty of Medicine in PilsenCharles UniversityAlej Svobody 1655/76Pilsen32300Czech Republic
| | - Dennis Kundrat
- Fraunhofer Research Institution for Individualized and Cell‐Based Medical Engineering IMTEMönkhoferweg23562LübeckGermany
| | - Romain Quidant
- Nanophotonic Systems LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
| | - Inge K. Herrmann
- Nanoparticle Systems Engineering LaboratoryInstitute of Energy and Process Engineering (IEPE)Department of Mechanical and Process Engineering (D‐MAVT)ETH ZurichSonneggstrasse 3Zurich8092Switzerland
- Particles Biology Interactions LaboratoryDepartment of Materials Meet LifeSwiss Federal Laboratories for Materials Science and Technology (Empa)Lerchenfeldstrasse 5St. Gallen9014Switzerland
- The Ingenuity LabUniversity Hospital BalgristForchstrasse 340Zurich8008Switzerland
- Faculty of MedicineUniversity of ZurichRämistrasse 71Zurich8006Switzerland
| |
Collapse
|
10
|
Ma G, McCloud M, Tian Y, Narawane A, Shi H, Trout R, McNabb RP, Kuo AN, Draelos M. Robotics and optical coherence tomography: current works and future perspectives [Invited]. BIOMEDICAL OPTICS EXPRESS 2025; 16:578-602. [PMID: 39958851 PMCID: PMC11828438 DOI: 10.1364/boe.547943] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2024] [Revised: 12/29/2024] [Accepted: 01/01/2025] [Indexed: 02/18/2025]
Abstract
Optical coherence tomography (OCT) is an interferometric technique for micron-level imaging in biological and non-biological contexts. As a non-invasive, non-ionizing, and video-rate imaging modality, OCT is widely used in biomedical and clinical applications, especially ophthalmology, where it functions in many roles, including tissue mapping, disease diagnosis, and intrasurgical visualization. In recent years, the rapid growth of medical robotics has led to new applications for OCT, primarily for 3D free-space scanning, volumetric perception, and novel optical designs for specialized medical applications. This review paper surveys these recent developments at the intersection of OCT and robotics and organizes them by degree of integration and application, with a focus on biomedical and clinical topics. We conclude with perspectives on how these recent innovations may lead to further advances in imaging and medical technology.
Collapse
Affiliation(s)
- Guangshen Ma
- Department of Robotics, University of Michigan Ann Arbor, MI 48105, USA
| | - Morgan McCloud
- Department of Biomedical Engineering, Duke University, Durham, NC 27705, USA
| | - Yuan Tian
- Department of Biomedical Engineering, Duke University, Durham, NC 27705, USA
| | - Amit Narawane
- Department of Biomedical Engineering, Duke University, Durham, NC 27705, USA
| | - Harvey Shi
- Department of Biomedical Engineering, Duke University, Durham, NC 27705, USA
| | - Robert Trout
- Department of Biomedical Engineering, Duke University, Durham, NC 27705, USA
| | - Ryan P McNabb
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27705, USA
| | - Anthony N Kuo
- Department of Biomedical Engineering, Duke University, Durham, NC 27705, USA
- Department of Ophthalmology, Duke University Medical Center, Durham, NC 27705, USA
| | - Mark Draelos
- Department of Robotics, University of Michigan Ann Arbor, MI 48105, USA
- Department of Ophthalmology and Visual Sciences, University of Michigan Medical School, Ann Arbor, MI 48105, USA
| |
Collapse
|
11
|
Wu J, Zou W, Lu Q, Zheng T, Li Y, Ying T, Li Y, Zheng Y, Wang L. Cilia-Mimic Locomotion of Magnetic Colloidal Collectives Enhanced by Low-Intensity Ultrasound for Thrombolytic Drug Penetration. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2025; 12:e2410351. [PMID: 39731361 PMCID: PMC11831500 DOI: 10.1002/advs.202410351] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/27/2024] [Revised: 11/28/2024] [Indexed: 12/29/2024]
Abstract
Rapid thrombolysis is very important to reduce complications caused by vascular blockage. A promising approach for improving thrombolysis efficiency is utilizing the permanent magnetically actuated locomotion of nanorobots. However, the thrombolytic drug transportation efficiency is challenged by in-plane rotating locomotion and the insufficient drug penetration limits further improvement of thrombolysis. Inspired by ciliary movement for cargo transportation in human body, in this study, cilia-mimic locomotion of magnetic colloidal collectives is realized under torque-force vortex magnetic field (TFV-MF) by a designed rotating permanent magnet assembly. This cilia-mimic locomotion mode can generate more disturbances to the fluids to improve thrombolytic drug transportation and the increased height and area of colloidal collectives boosted the imaging capability. In addition, low-intensity ultrasound is applied to enhance colloids infiltration by producing the fiber breakage and inducing erythrocyte deformation. In vitro thrombolytic experiments demonstrate that the thrombolysis efficiency increased by 16.2 times compared with that of pure tissue plasminogen activator (tPA) treatments. Furthermore, in vivo rat models of femoral vein thrombosis confirmed that this approach can achieve blood flow recanalization more quickly. The proposed cilia-mimic locomotion of magnetic colloidal collectives combined with low-intensity ultrasound irradiation mode provides a new insight of therapeutic interventions for vascular thrombus by enhancing drug penetration.
Collapse
Affiliation(s)
- Jingjing Wu
- Department of Ultrasound in MedicineShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
- Shanghai Key Laboratory of Neuro‐Ultrasound for Diagnosis and TreatmentShanghai200233P. R. China
| | - Weijuan Zou
- Department of Ultrasound in MedicineShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
- Shanghai Key Laboratory of Neuro‐Ultrasound for Diagnosis and TreatmentShanghai200233P. R. China
| | - Qijie Lu
- Department of Ultrasound in MedicineShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
- Shanghai Key Laboratory of Neuro‐Ultrasound for Diagnosis and TreatmentShanghai200233P. R. China
| | - Tingjia Zheng
- Department of Ultrasound in MedicineShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
- Shanghai Key Laboratory of Neuro‐Ultrasound for Diagnosis and TreatmentShanghai200233P. R. China
| | - Yanping Li
- Department of Ultrasound in MedicineShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
- Shanghai Key Laboratory of Neuro‐Ultrasound for Diagnosis and TreatmentShanghai200233P. R. China
| | - Tao Ying
- Department of Ultrasound in MedicineShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
- Shanghai Key Laboratory of Neuro‐Ultrasound for Diagnosis and TreatmentShanghai200233P. R. China
| | - Yuehua Li
- Department of RadiologyShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
| | - Yuanyi Zheng
- Department of Ultrasound in MedicineShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
- Shanghai Key Laboratory of Neuro‐Ultrasound for Diagnosis and TreatmentShanghai200233P. R. China
| | - Longchen Wang
- Department of Ultrasound in MedicineShanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of MedicineNo. 600, Yishan RoadShanghai200233P. R. China
- Shanghai Key Laboratory of Neuro‐Ultrasound for Diagnosis and TreatmentShanghai200233P. R. China
| |
Collapse
|
12
|
Krejčí J, Babiuch M, Suder J, Krys V, Bobovský Z. Internet of Robotic Things: Current Technologies, Challenges, Applications, and Future Research Topics. SENSORS (BASEL, SWITZERLAND) 2025; 25:765. [PMID: 39943403 PMCID: PMC11820596 DOI: 10.3390/s25030765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2024] [Revised: 01/08/2025] [Accepted: 01/24/2025] [Indexed: 02/16/2025]
Abstract
This article focuses on the integration of the Internet of Things (IoT) and the Internet of Robotic Things, representing a dynamic research area with significant potential for industrial applications. The Internet of Robotic Things (IoRT) integrates IoT technologies into robotic systems, enhancing their efficiency and autonomy. The article provides an overview of the technologies used in IoRT, including hardware components, communication technologies, and cloud services. It also explores IoRT applications in industries such as healthcare, agriculture, and more. The article discusses challenges and future research directions, including data security, energy efficiency, and ethical issues. The goal is to raise awareness of the importance of IoRT and demonstrate how this technology can bring significant benefits across various sectors.
Collapse
Affiliation(s)
- Jakub Krejčí
- Department of Robotics, VSB—Technical University of Ostrava, 708 00 Ostrava, Czech Republic; (V.K.); (Z.B.)
| | - Marek Babiuch
- Department of Control Systems and Instrumentation, VSB—Technical University of Ostrava, 708 00 Ostrava, Czech Republic
| | - Jiří Suder
- Department of Computer Science, Electrical Engineering and Mathematical Sciences, Western Norway University of Applied Sciences, 6812 Førde, Norway;
| | - Václav Krys
- Department of Robotics, VSB—Technical University of Ostrava, 708 00 Ostrava, Czech Republic; (V.K.); (Z.B.)
| | - Zdenko Bobovský
- Department of Robotics, VSB—Technical University of Ostrava, 708 00 Ostrava, Czech Republic; (V.K.); (Z.B.)
| |
Collapse
|
13
|
Asciak L, Kyeremeh J, Luo X, Kazakidi A, Connolly P, Picard F, O'Neill K, Tsaftaris SA, Stewart GD, Shu W. Digital twin assisted surgery, concept, opportunities, and challenges. NPJ Digit Med 2025; 8:32. [PMID: 39815013 PMCID: PMC11736137 DOI: 10.1038/s41746-024-01413-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2024] [Accepted: 12/22/2024] [Indexed: 01/18/2025] Open
Abstract
Computer-assisted surgery is becoming essential in modern medicine to accurately plan, guide, and perform surgeries. Similarly, Digital Twin technology is expected to be instrumental in the future of surgery, owing to its capacity to virtually replicate patient-specific interventions whilst providing real-time updates to clinicians. This perspective introduces the term Digital Twin-Assisted Surgery and discusses its potential to improve surgical precision and outcome, along with key challenges for successful clinical translation.
Collapse
Affiliation(s)
- Lisa Asciak
- Department of Biomedical Engineering, Wolfson Centre, University of Strathclyde, Glasgow, UK
| | - Justicia Kyeremeh
- Department of Surgery, University of Cambridge, Cambridge Biomedical Campus, Cambridge, UK
- CRUK Cambridge Centre, Cambridge Biomedical Campus, Cambridge, UK
| | - Xichun Luo
- Centre for Precision Manufacturing, DMEM, University of Strathclyde, Glasgow, UK
| | - Asimina Kazakidi
- Department of Biomedical Engineering, Wolfson Centre, University of Strathclyde, Glasgow, UK
| | - Patricia Connolly
- Department of Biomedical Engineering, Wolfson Centre, University of Strathclyde, Glasgow, UK
| | - Frederic Picard
- Department of Biomedical Engineering, Wolfson Centre, University of Strathclyde, Glasgow, UK
- NHS Golden Jubilee University National Hospital, Clydebank, Glasgow, UK
| | - Kevin O'Neill
- Department of Neurosurgery, Division of Surgery and Cancer, Imperial College Healthcare NHS Trust, London, UK
| | - Sotirios A Tsaftaris
- Imaging, Data and Communications, The University of Edinburgh, EH9 3FG, Edinburgh, UK
| | - Grant D Stewart
- Department of Surgery, University of Cambridge, Cambridge Biomedical Campus, Cambridge, UK
- CRUK Cambridge Centre, Cambridge Biomedical Campus, Cambridge, UK
| | - Wenmiao Shu
- Department of Biomedical Engineering, Wolfson Centre, University of Strathclyde, Glasgow, UK.
| |
Collapse
|
14
|
Kawashima K, Ghali S, Nikkhah D, Esmaeili A. Recent Advancements in Robotic-assisted Plastic Surgery Procedures: A Systematic Review. PLASTIC AND RECONSTRUCTIVE SURGERY-GLOBAL OPEN 2025; 13:e6476. [PMID: 39850533 PMCID: PMC11756886 DOI: 10.1097/gox.0000000000006476] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Accepted: 11/25/2024] [Indexed: 01/25/2025]
Abstract
Background There has been a delayed, yet steady uptake of robotic-assisted surgery over the past decade within the field of plastic surgery. In an era of rapidly evolving scientific and technological development, there is a need for an update on the current literature for robotic-assisted plastic surgery procedures. Methods Searches were conducted across major databases, including MEDLINE, Embase, and Central for published literature from March 2023 to December 2024. Only published articles written in English with full texts were considered for the final narrative synthesis. Results Initially, we identified 1200 articles in the database search. Subsequently, 46 articles were included in our final narrative synthesis. Among the selected studies, 4 focused on reconstruction in transoral robotic surgery, 14 on breast surgery, 10 on robotic microsurgery, 5 on abdominal wall reconstruction, 6 on vaginoplasty, and 5 on flap harvest. Conclusions The evidence to support the advantage of robotic plastic surgery procedures over traditional methods is relatively weak. However, there have been some advancements, specifically in transoral robotic surgery, robotic mastectomy, and breast reconstruction. Nevertheless, comprehensive exploration and prospective randomized trials are essential across all procedures to define the role of surgical robots in plastic surgery. The impediments to wider adoption include high costs, disruption to operative flow, and the absence of haptic feedback in robotic-assisted procedures within the specialty.
Collapse
Affiliation(s)
- Kazuho Kawashima
- From the Division of Surgery and Interventional Science, University College of London, London, United Kingdom
- Department of Plastic and Reconstructive Surgery, Royal Free NHS Foundation Trust, London, United Kingdom
| | - Shadi Ghali
- Department of Plastic and Reconstructive Surgery, Royal Free NHS Foundation Trust, London, United Kingdom
- Consultant Plastic Surgeon, London, United Kingdom
- University College London, London, United Kingdom
| | - Dariush Nikkhah
- Department of Plastic and Reconstructive Surgery, Royal Free NHS Foundation Trust, London, United Kingdom
- Consultant Plastic Surgeon, London, United Kingdom
- University College London, London, United Kingdom
| | - Ali Esmaeili
- Department of Plastic and Reconstructive Surgery, Royal Free NHS Foundation Trust, London, United Kingdom
- University College London, London, United Kingdom
| |
Collapse
|
15
|
Qi Z, Cai M, Hao B, Cao Y, Su L, Liu X, Chan KF, Yang C, Zhang L. Robust 3-D Path Following Control Framework for Magnetic Helical Millirobots Subject to Fluid Flow and Input Saturation. IEEE TRANSACTIONS ON CYBERNETICS 2024; 54:7629-7641. [PMID: 39208045 DOI: 10.1109/tcyb.2024.3439708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
Abstract
Precise trajectory control is imperative to ensure the safety and efficacy of in vivo therapy employing the magnetic helical millirobots. However, achieving accurate 3-D path following of helical millirobots under fluid flow conditions remains challenging due to the presence of the lumped disturbances, encompassing complex fluid dynamics and input frequency saturation. This study proposes a robust 3-D path following control framework that combines a disturbance observer for perturbation estimation with an adaptive finite-time sliding mode controller for autonomous navigation along the reference trajectories. First, a magnetic helical millirobot's kinematic model based on the 3-D hand position approach is established. Subsequently, a robust smooth differentiator is implemented as an observer to estimate disturbances within a finite time. We then investigate an adaptive finite-time sliding mode controller incorporating an auxiliary system to mitigate the estimated disturbance and achieve precise 3-D path tracking while respecting the input constraints. The adaptive mechanism of this controller ensures fast convergence of the system while alleviating the chattering effects. Finally, we provide a rigorous theoretical analysis of the finite-time stability of the closed-loop system based on the Lyapunov functions. Utilizing a robotically-actuated magnetic manipulation system, experimental results demonstrate the efficacy of the proposed approach in terms of the control accuracy and convergence time.
Collapse
|
16
|
Birkhoff SS, Merring P, Spence A, Bassett W, Roth SC. Integrating Collaborative Robots into a Complex Hospital Setting: A Qualitative Descriptive Study. Dela J Public Health 2024; 10:20-27. [PMID: 40070377 PMCID: PMC11892717 DOI: 10.32481/djph.2024.12.05] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/14/2025] Open
Abstract
Objective To describe the use, activities, and human interactions of cobots as a delivery system for medications, supplies, and equipment within a complex and multi-level 900-bed hospital setting. Integrating collaborative robots (cobots) into existing hospital workflows as a secure delivery transportation system is an early innovation and emerging area to explore. Methods Guided by the Diffusion of Innovations theory, a qualitative descriptive design was used to build the foundational knowledge required to better understand and describe cobot implementation in the acute care hospital setting. The cobots were observed on all shifts, on different days of the week as they interacted with staff members, clinicians, and visitors while they traveled throughout the hospital completing deliveries. Data were analyzed among the study team members using an inductive coding approach followed by a qualitative content analysis level of interpretation. Results For seven weeks from November 2022 - December 2022, 33 hours were collected from 23 individual cobot observation sessions. These observations included 89 end-to-end cobot deliveries. After analysis, four major themes emerged: 1) humanization of robots, 2) usability of robots, 3) cobots' autonomy, and 4) cobots' functionality within a dynamic hospital environment. Conclusions Implementing cobots as a semi-autonomous delivery transporter is still in the early innovation phase. The cobots used in this study required human support to function adequately in a complicated and unpredictable environment. To sustainably augment current and future workflows exclusively performed by human, the cobots will need to transition toward greater model of autonomy and less human assistance.
Collapse
|
17
|
Zhou C, Xu Z, Lin Z, Qin X, Xia J, Ai X, Lou C, Huang Z, Huang S, Liu H, Zou Y, Chen W, Yang GZ, Gao A. Submillimeter fiber robots capable of decoupled macro-micro motion for endoluminal manipulation. SCIENCE ADVANCES 2024; 10:eadr6428. [PMID: 39576861 PMCID: PMC11584019 DOI: 10.1126/sciadv.adr6428] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/12/2024] [Accepted: 10/22/2024] [Indexed: 11/24/2024]
Abstract
Endoluminal and endocavitary intervention via natural orifices of the body is an emerging trend in medicine, further underpinning the future of early intervention and precision surgery. This motivates the development of small continuum robots to navigate freely in confined and tortuous environment. The trade-off between a large range of motion and high precision with concomitant actuation cross-talk poses a major challenge. Here, we present a submillimeter-scale fiber robot (~1 mm) capable of decoupled macro and micro manipulations for intervention and operation. The thin optical fibers, working both as mechanical tendons and light waveguides, can be pulled/pushed to actuate the macro tendon-driven continuum robot and transmit light to actuate the liquid crystal elastomer-based micro built-in light-driven parallel robot. The combination of the decoupled macro and micro motions can accomplish accurate cross-scale motion from several millimeters down to tens of micrometers. In vivo animal studies are performed to demonstrate its positioning accuracy of precise micro operations in endoluminal or endocavitary intervention.
Collapse
Affiliation(s)
- Cheng Zhou
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Zheng Xu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Zecai Lin
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Xiaotong Qin
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Jingyuan Xia
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Xiaojie Ai
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Chuqian Lou
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Ziyi Huang
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Shaoping Huang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Huanghua Liu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Yun Zou
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Weidong Chen
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Guang-Zhong Yang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Anzhu Gao
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai 200240, China
- Department of Automation, Shanghai Jiao Tong University, Shanghai 200240, China
| |
Collapse
|
18
|
Alabay HH, Le TA, Ceylan H. X-ray fluoroscopy guided localization and steering of miniature robots using virtual reality enhancement. Front Robot AI 2024; 11:1495445. [PMID: 39605865 PMCID: PMC11599259 DOI: 10.3389/frobt.2024.1495445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2024] [Accepted: 10/29/2024] [Indexed: 11/29/2024] Open
Abstract
In developing medical interventions using untethered milli- and microrobots, ensuring safety and effectiveness relies on robust methods for real-time robot detection, tracking, and precise localization within the body. The inherent non-transparency of human tissues significantly challenges these efforts, as traditional imaging systems like fluoroscopy often lack crucial anatomical details, potentially compromising intervention safety and efficacy. To address this technological gap, in this study, we build a virtual reality environment housing an exact digital replica (digital twin) of the operational workspace and a robot avatar. We synchronize the virtual and real workspaces and continuously send the robot position data derived from the image stream into the digital twin with short average delay time around 20-25 ms. This allows the operator to steer the robot by tracking its avatar within the digital twin with near real-time temporal resolution. We demonstrate the feasibility of this approach with millirobots steered in confined phantoms. Our concept demonstration herein can pave the way for not only improved procedural safety by complementing fluoroscopic guidance with virtual reality enhancement, but also provides a platform for incorporating various additional real-time derivative data, e.g., instantaneous robot velocity, intraoperative physiological data obtained from the patient, e.g., blood flow rate, and pre-operative physical simulation models, e.g., periodic body motions, to further refine robot control capacity.
Collapse
Affiliation(s)
- Husnu Halid Alabay
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Scottsdale, AZ, United States
| | - Tuan-Anh Le
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Scottsdale, AZ, United States
| | - Hakan Ceylan
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Scottsdale, AZ, United States
- Max Planck Queensland Centre, Queensland University of Technology, Brisbane, QLD, Australia
| |
Collapse
|
19
|
Li Z, Zhang S, Wang Q, Xu Y, Li Y, Chen X, Chen P, Chen D, Shi Y, Su B. Untethered & Stiffness-Tunable Ferromagnetic Liquid Robots for Cleaning Thrombus in Complex Blood Vessels. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024; 36:e2409142. [PMID: 39308207 DOI: 10.1002/adma.202409142] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Revised: 09/13/2024] [Indexed: 11/16/2024]
Abstract
Thrombosis is a significant threat to human health. However, the existing clinical treatment methods have limitations. Magnetic soft matter is used in the biomedical field for years, and ferromagnetic liquids exhibit tunable stiffness and on-demand movement advantages under magnetic fields. In this study, a ferromagnetic liquid robot (FMLR) is developed and applied it to thrombus removal in complex blood vessels. The FMLR consisted of Fe3O4 magnetic nanoparticles and dimethyl silicone oil. The FMLR can pass through a narrow complex maze through shape deformation by tailoring the intensity and direction of the external magnetic field. Finite element simulation analysis is used to validate the mechanism of controllable FMLR movements. Importantly, the storage modulus of FMLR can be tuned from 0.1 to 2018 Pa by varying the external magnetic intensity, ensuring its effectiveness in removing rigid and stubborn thrombi present on the vascular walls. Toward medical robotic applications, FMLR can be used in telerobotic neurointerventional. Experiments demonstrating the capability of FMLR to remove thrombi in the ear veins of rabbits are conducted. This study introduces an efficient approach for thrombus elimination, broadening the utilization of FMLRs within the realm of clinical medicine.
Collapse
Affiliation(s)
- Zhuofan Li
- State Key Laboratory of Advanced Electromagnetic Engineering and Technology, School of, Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Shanfei Zhang
- State Key Laboratory of Material Processing and Die & Mould Technology, School of Materials, Science and Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Qi Wang
- State Key Laboratory of Advanced Electromagnetic Engineering and Technology, School of, Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Yizhuo Xu
- State Key Laboratory of Material Processing and Die & Mould Technology, School of Materials, Science and Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Yike Li
- State Key Laboratory of Material Processing and Die & Mould Technology, School of Materials, Science and Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Xiaojun Chen
- State Key Laboratory of Material Processing and Die & Mould Technology, School of Materials, Science and Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Peng Chen
- State Key Laboratory of Material Processing and Die & Mould Technology, School of Materials, Science and Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Dezhi Chen
- State Key Laboratory of Advanced Electromagnetic Engineering and Technology, School of, Electrical and Electronic Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| | - Yunsong Shi
- School of Stomatology, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430030, China
| | - Bin Su
- State Key Laboratory of Material Processing and Die & Mould Technology, School of Materials, Science and Engineering, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China
| |
Collapse
|
20
|
Yin S, Yao DR, Song Y, Heng W, Ma X, Han H, Gao W. Wearable and Implantable Soft Robots. Chem Rev 2024; 124:11585-11636. [PMID: 39392765 DOI: 10.1021/acs.chemrev.4c00513] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/13/2024]
Abstract
Soft robotics presents innovative solutions across different scales. The flexibility and mechanical characteristics of soft robots make them particularly appealing for wearable and implantable applications. The scale and level of invasiveness required for soft robots depend on the extent of human interaction. This review provides a comprehensive overview of wearable and implantable soft robots, including applications in rehabilitation, assistance, organ simulation, surgical tools, and therapy. We discuss challenges such as the complexity of fabrication processes, the integration of responsive materials, and the need for robust control strategies, while focusing on advances in materials, actuation and sensing mechanisms, and fabrication techniques. Finally, we discuss the future outlook, highlighting key challenges and proposing potential solutions.
Collapse
Affiliation(s)
- Shukun Yin
- Andrew and Peggy Cherng Department of Medical Engineering, Division of Engineering and Applied Science, California Institute of Technology, Pasadena, California 91125, United States
| | - Dickson R Yao
- Andrew and Peggy Cherng Department of Medical Engineering, Division of Engineering and Applied Science, California Institute of Technology, Pasadena, California 91125, United States
| | - Yu Song
- Andrew and Peggy Cherng Department of Medical Engineering, Division of Engineering and Applied Science, California Institute of Technology, Pasadena, California 91125, United States
| | - Wenzheng Heng
- Andrew and Peggy Cherng Department of Medical Engineering, Division of Engineering and Applied Science, California Institute of Technology, Pasadena, California 91125, United States
| | - Xiaotian Ma
- Andrew and Peggy Cherng Department of Medical Engineering, Division of Engineering and Applied Science, California Institute of Technology, Pasadena, California 91125, United States
| | - Hong Han
- Andrew and Peggy Cherng Department of Medical Engineering, Division of Engineering and Applied Science, California Institute of Technology, Pasadena, California 91125, United States
| | - Wei Gao
- Andrew and Peggy Cherng Department of Medical Engineering, Division of Engineering and Applied Science, California Institute of Technology, Pasadena, California 91125, United States
| |
Collapse
|
21
|
Hou C, Gao H, Yang X, Xue G, Zuo X, Li Y, Li D, Lu B, Ren H, Liu H, Sun L. A piezoresistive-based 3-axial MEMS tactile sensor and integrated surgical forceps for gastrointestinal endoscopic minimally invasive surgery. MICROSYSTEMS & NANOENGINEERING 2024; 10:141. [PMID: 39327456 PMCID: PMC11427553 DOI: 10.1038/s41378-024-00774-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/27/2024] [Revised: 07/06/2024] [Accepted: 07/19/2024] [Indexed: 09/28/2024]
Abstract
In robotic-assisted surgery (RAS), traditional surgical instruments without sensing capability cannot perceive accurate operational forces during the task, and such drawbacks can be largely intensified when sophisticated tasks involving flexible and slender arms with small end-effectors, such as in gastrointestinal endoscopic surgery (GES). In this study, we propose a microelectromechanical system (MEMS) piezoresistive 3-axial tactile sensor for GES forceps, which can intuitively provide surgeons with online force feedback during robotic surgery. The MEMS fabrication process facilitates sensor chips with miniaturized dimensions. The fully encapsulated tactile sensors can be effortlessly integrated into miniature GES forceps, which feature a slender diameter of just 3.5 mm and undergo meticulous calibration procedures via the least squares method. Through experiments, the sensor's ability to accurately measure directional forces up to 1.2 N in the Z axis was validated, demonstrating an average relative error of only 1.18% compared with the full-scale output. The results indicate that this tactile sensor can provide effective 3-axial force sensing during surgical operations, such as grasping and pulling, and in ex vivo testing with a porcine stomach. The compact size, high precision, and integrability of the sensor establish solid foundations for clinical application in the operating theater.
Collapse
Affiliation(s)
- Cheng Hou
- School of Mechanical and Electrical Engineering, Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China
- Faculty of Mechanical and Electrical Engineering, Kunming University of Science and Technology, Jingming South Road, Kunming, China
- Yunnan Key Laboratory of Intelligent Control and Application, Kunming, China
| | - Huxin Gao
- Department of Electronic Engineering, The Chinese University of Hong Kong (CUHK), Hong Kong, China
| | - Xiaoxiao Yang
- Department of Gastroenterology, Qilu Hospital, Shandong University, Jinan, Shandong, China
| | - Guangming Xue
- School of Mechanical and Electrical Engineering, Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China
| | - Xiuli Zuo
- Department of Gastroenterology, Qilu Hospital, Shandong University, Jinan, Shandong, China
| | - Yanqing Li
- Department of Gastroenterology, Qilu Hospital, Shandong University, Jinan, Shandong, China
| | - Dongsheng Li
- School of Mechanical and Electrical Engineering, Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China
| | - Bo Lu
- School of Mechanical and Electrical Engineering, Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China.
| | - Hongliang Ren
- Department of Electronic Engineering, The Chinese University of Hong Kong (CUHK), Hong Kong, China
| | - Huicong Liu
- School of Mechanical and Electrical Engineering, Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China.
| | - Lining Sun
- School of Mechanical and Electrical Engineering, Jiangsu Provincial Key Laboratory of Advanced Robotics, Soochow University, Suzhou, China.
| |
Collapse
|
22
|
Gaeta LT, Albayrak MD, Kinnicutt L, Aufrichtig S, Sultania P, Schlegel H, Ellis TD, Ranzani T. A magnetically controlled soft robotic glove for hand rehabilitation. DEVICE 2024; 2:100512. [PMID: 40018444 PMCID: PMC11864777 DOI: 10.1016/j.device.2024.100512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/01/2025]
Abstract
For individuals with hand motor function losses, rehabilitation is necessary for regaining strength and range of motion to accomplish daily activities. Typically within a clinical setting, repetitive strength-based and task-specific exercises are prescribed. However, these therapies are generally costly and non-portable, limiting patient accessibility and rendering patient compliance impractical. There is thus a clinical need for a system that is low-cost, portable, and accessible to improve patient compliance and outcomes. This work presents a proof-of-concept magnetically-controlled glove to provide targeted resistance-based rehabilitation for patients with hand motor impairments. The glove is inexpensive, customizable, and portable, allowing for use within a clinic and at home. Customizable resistance is achieved by electropermanent magnets (EPMs), which locally control magnetic attraction of the digits and produce rapid stiffness changes from magnetically induced jamming. Various rehabilitative exercises using the glove are demonstrated and the magnetic fields can be customized to provide necessary resistance.
Collapse
Affiliation(s)
- Leah T Gaeta
- Department of Mechanical Engineering, Boston University, Boston, MA 02215 USA
| | - M Deniz Albayrak
- Department of Mechanical Engineering, Boston University, Boston, MA 02215 USA
| | - Lorenzo Kinnicutt
- Department of Mechanical Engineering, Boston University, Boston, MA 02215 USA
| | | | - Pranav Sultania
- Department of Mechanical Engineering, Boston University, Boston, MA 02215 USA
| | - Hanna Schlegel
- Department of Mechanical Engineering, Boston University, Boston, MA 02215 USA
| | - Terry D Ellis
- Boston University Sargent College of Health and Rehabilitation Services, Physical Therapy and Athletic Training, Boston, Massachusetts, USA
| | - Tommaso Ranzani
- Department of Mechanical Engineering, Boston University, Boston, MA 02215 USA
- Department of Biomedical Engineering, Boston University, Boston, MA 02215 USA
- Department of Materials Science and Engineering Division, Boston University, Boston, MA 02215 USA
| |
Collapse
|
23
|
Rosero A, Dula E, Kelly H, Malle BF, Phillips EK. Human perceptions of social robot deception behaviors: an exploratory analysis. Front Robot AI 2024; 11:1409712. [PMID: 39301050 PMCID: PMC11411098 DOI: 10.3389/frobt.2024.1409712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2024] [Accepted: 07/11/2024] [Indexed: 09/22/2024] Open
Abstract
Introduction Robots are being introduced into increasingly social environments. As these robots become more ingrained in social spaces, they will have to abide by the social norms that guide human interactions. At times, however, robots will violate norms and perhaps even deceive their human interaction partners. This study provides some of the first evidence for how people perceive and evaluate robot deception, especially three types of deception behaviors theorized in the technology ethics literature: External state deception (cues that intentionally misrepresent or omit details from the external world: e.g., lying), Hidden state deception (cues designed to conceal or obscure the presence of a capacity or internal state the robot possesses), and Superficial state deception (cues that suggest a robot has some capacity or internal state that it lacks). Methods Participants (N = 498) were assigned to read one of three vignettes, each corresponding to one of the deceptive behavior types. Participants provided responses to qualitative and quantitative measures, which examined to what degree people approved of the behaviors, perceived them to be deceptive, found them to be justified, and believed that other agents were involved in the robots' deceptive behavior. Results Participants rated hidden state deception as the most deceptive and approved of it the least among the three deception types. They considered external state and superficial state deception behaviors to be comparably deceptive; but while external state deception was generally approved, superficial state deception was not. Participants in the hidden state condition often implicated agents other than the robot in the deception. Conclusion This study provides some of the first evidence for how people perceive and evaluate the deceptiveness of robot deception behavior types. This study found that people people distinguish among the three types of deception behaviors and see them as differently deceptive and approve of them differently. They also see at least the hidden state deception as stemming more from the designers than the robot itself.
Collapse
Affiliation(s)
- Andres Rosero
- Applied Psychology and Autonomous Systems Lab, Department of Psychology, College of Humanities and Social Sciences, George Mason University, Fairfax, VA, United States
| | - Elizabeth Dula
- Applied Psychology and Autonomous Systems Lab, Department of Psychology, College of Humanities and Social Sciences, George Mason University, Fairfax, VA, United States
- UVA Department of Psychology, University of Virginia, Charlottesville, VA, United States
| | - Harris Kelly
- Applied Psychology and Autonomous Systems Lab, Department of Psychology, College of Humanities and Social Sciences, George Mason University, Fairfax, VA, United States
| | - Bertram F Malle
- Social Cognitive Science Research Lab, Department of Cognitive and Psychological Sciences, Brown University, Providence, RI, United States
| | - Elizabeth K Phillips
- Applied Psychology and Autonomous Systems Lab, Department of Psychology, College of Humanities and Social Sciences, George Mason University, Fairfax, VA, United States
| |
Collapse
|
24
|
Shushtari M, Foellmer J, Arami A. Human-exoskeleton interaction portrait. J Neuroeng Rehabil 2024; 21:152. [PMID: 39232812 PMCID: PMC11373187 DOI: 10.1186/s12984-024-01447-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2024] [Accepted: 08/14/2024] [Indexed: 09/06/2024] Open
Abstract
Human-robot physical interaction contains crucial information for optimizing user experience, enhancing robot performance, and objectively assessing user adaptation. This study introduces a new method to evaluate human-robot interaction and co-adaptation in lower limb exoskeletons by analyzing muscle activity and interaction torque as a two-dimensional random variable. We introduce the interaction portrait (IP), which visualizes this variable's distribution in polar coordinates. We applied IP to compare a recently developed hybrid torque controller (HTC) based on kinematic state feedback and a novel adaptive model-based torque controller (AMTC) with online learning, proposed herein, against a time-based controller (TBC) during treadmill walking at varying speeds. Compared to TBC, both HTC and AMTC significantly lower users' normalized oxygen uptake, suggesting enhanced user-exoskeleton coordination. IP analysis reveals that this improvement stems from two distinct co-adaptation strategies, unidentifiable by traditional muscle activity or interaction torque analyses alone. HTC encourages users to yield control to the exoskeleton, decreasing overall muscular effort but increasing interaction torque, as the exoskeleton compensates for user dynamics. Conversely, AMTC promotes user engagement through increased muscular effort and reduces interaction torques, aligning it more closely with rehabilitation and gait training applications. IP phase evolution provides insight into each user's interaction strategy formation, showcasing IP analysis's potential in comparing and designing novel controllers to optimize human-robot interaction in wearable robots.
Collapse
Affiliation(s)
- Mohammad Shushtari
- Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, N2L 3G1, Canada
| | - Julia Foellmer
- Mechanics and Ocean Engineering Department, Hamburg University of Technology, 21071, Hamburg, Germany
| | - Arash Arami
- Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON, N2L 3G1, Canada.
- Toronto Rehabilitation Institute (KITE), University Health Network, Toronto, ON, M5G 2A2, Canada.
| |
Collapse
|
25
|
Li C, Zhang G, Zhao B, Xie D, Du H, Duan X, Hu Y, Zhang L. Advances of surgical robotics: image-guided classification and application. Natl Sci Rev 2024; 11:nwae186. [PMID: 39144738 PMCID: PMC11321255 DOI: 10.1093/nsr/nwae186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2023] [Revised: 04/19/2024] [Accepted: 05/07/2024] [Indexed: 08/16/2024] Open
Abstract
Surgical robotics application in the field of minimally invasive surgery has developed rapidly and has been attracting increasingly more research attention in recent years. A common consensus has been reached that surgical procedures are to become less traumatic and with the implementation of more intelligence and higher autonomy, which is a serious challenge faced by the environmental sensing capabilities of robotic systems. One of the main sources of environmental information for robots are images, which are the basis of robot vision. In this review article, we divide clinical image into direct and indirect based on the object of information acquisition, and into continuous, intermittent continuous, and discontinuous according to the target-tracking frequency. The characteristics and applications of the existing surgical robots in each category are introduced based on these two dimensions. Our purpose in conducting this review was to analyze, summarize, and discuss the current evidence on the general rules on the application of image technologies for medical purposes. Our analysis gives insight and provides guidance conducive to the development of more advanced surgical robotics systems in the future.
Collapse
Affiliation(s)
- Changsheng Li
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
| | - Gongzi Zhang
- Department of Orthopedics, Chinese PLA General Hospital, Beijing 100141, China
| | - Baoliang Zhao
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Dongsheng Xie
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China
| | - Hailong Du
- Department of Orthopedics, Chinese PLA General Hospital, Beijing 100141, China
| | - Xingguang Duan
- School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China
- School of Medical Technology, Beijing Institute of Technology, Beijing 100081, China
| | - Ying Hu
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Lihai Zhang
- Department of Orthopedics, Chinese PLA General Hospital, Beijing 100141, China
- Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| |
Collapse
|
26
|
Zhang T, Yuan S, Xu C, Liu P, Chang HC, Ng SHC, Ren H, Yuan W. PneumaOCT: Pneumatic optical coherence tomography endoscopy for targeted distortion-free imaging in tortuous and narrow internal lumens. SCIENCE ADVANCES 2024; 10:eadp3145. [PMID: 39196931 PMCID: PMC11352845 DOI: 10.1126/sciadv.adp3145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2024] [Accepted: 07/23/2024] [Indexed: 08/30/2024]
Abstract
The complex anatomy of internal luminal organs, like bronchioles, poses challenges for endoscopic optical coherence tomography (OCT). These challenges include limited steerability for targeted imaging and nonuniform rotation distortion (NURD) with proximal scanning. Using rotary micromotors for distal scanning could address NURD but raises concerns about electrical safety and costs. We present pneumaOCT, the first pneumatic OCT endoscope, comprising a steerable catheter with a soft pneumatic actuator and an imaging probe with a miniature pneumatic turbine. With a diameter of 2.8 mm, pneumaOCT allows for a bending angle of up to 237°, facilitating navigation through narrow turns. The pneumatic turbine enables adjustable imaging speeds from 51 to 446 revolutions per second. We demonstrate the pneumaOCT in vivo imaging of mouse esophagus and colon, as well as targeted and distortion-free imaging of peripheral bronchioles in a bronchial phantom and a porcine lung. This advancement substantially improves endoscopic OCT for navigational imaging in curved and narrow lumens.
Collapse
Affiliation(s)
- Tinghua Zhang
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Sishen Yuan
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Chao Xu
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Peng Liu
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Hing-Chiu Chang
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Sze Hang Calvin Ng
- Department of Surgery, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Hongliang Ren
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| | - Wu Yuan
- Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China
| |
Collapse
|
27
|
Iskandar M, Albu-Schäffer A, Dietrich A. Intrinsic sense of touch for intuitive physical human-robot interaction. Sci Robot 2024; 9:eadn4008. [PMID: 39167671 DOI: 10.1126/scirobotics.adn4008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 07/23/2024] [Indexed: 08/23/2024]
Abstract
The sense of touch is a property that allows humans to interact delicately with their physical environment. This article reports on a technological advancement in intuitive human-robot interaction that enables an intrinsic robotic sense of touch without the use of artificial skin or tactile instrumentation. On the basis of high-resolution joint-force-torque sensing in a redundant arrangement, we were able to let the robot sensitively feel the surrounding environment and accurately localize touch trajectories in space and time that were applied on its surface by a human. Through an intertwined combination of manifold learning techniques and artificial neural networks, the robot identified and interpreted those touch trajectories as machine-readable letters, symbols, or numbers. This opens up unexplored opportunities in terms of intuitive and flexible interaction between human and robot. Furthermore, we showed that our concept of so-called virtual buttons can be used to straightforwardly implement a tactile communication link, including switches and slider bars, which are complementary to speech, hardware buttons, and control panels. These interaction elements could be freely placed, moved, and configured in arbitrary locations on the robot structure. The intrinsic sense of touch we proposed in this work can serve as the basis for an advanced category of physical human-robot interaction that has not been possible yet, enabling a shift from conventional modalities toward adaptability, flexibility, and intuitive handling.
Collapse
Affiliation(s)
- Maged Iskandar
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Münchener Str. 20, 82234 Wessling, Germany
| | - Alin Albu-Schäffer
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Münchener Str. 20, 82234 Wessling, Germany
- Technical University of Munich (TUM), 80333 München, Germany
| | - Alexander Dietrich
- Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Münchener Str. 20, 82234 Wessling, Germany
| |
Collapse
|
28
|
Zhang R, Zhang C, Fan X, Au Yeung CCK, Li H, Lin H, Shum HC. A droplet robotic system enabled by electret-induced polarization on droplet. Nat Commun 2024; 15:6220. [PMID: 39043732 PMCID: PMC11266649 DOI: 10.1038/s41467-024-50520-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Accepted: 07/12/2024] [Indexed: 07/25/2024] Open
Abstract
Robotics for scientific research are evolving from grasping macro-scale solid materials to directly actuating micro-scale liquid samples. However, current liquid actuation mechanisms often restrict operable liquid types or compromise the activity of biochemical samples by introducing interfering mediums. Here, we propose a robotic liquid handling system enabled by a novel droplet actuation mechanism, termed electret-induced polarization on droplet (EPD). EPD enables all-liquid actuation in principle and experimentally exhibits generality for actuating various inorganic/organic liquids with relative permittivity ranging from 2.25 to 84.2 and volume from 500 nL to 1 mL. Moreover, EPD is capable of actuating various biochemical samples without compromising their activities, including various body fluids, living cells, and proteins. A robotic system is also coupled with the EPD mechanism to enable full automation. EPD's high adaptability with liquid types and biochemical samples thus promotes the automation of liquid-based scientific experiments across multiple disciplines.
Collapse
Affiliation(s)
- Ruotong Zhang
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong SAR, China
| | - Chengzhi Zhang
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong SAR, China
- Department of Materials Science and Engineering, Southern University of Science and Technology, Shenzhen, Guangdong, China
| | - Xiaoxue Fan
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong SAR, China
| | - Christina C K Au Yeung
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong SAR, China
- Advanced Biomedical Instrumentation Centre, Hong Kong Science Park, Hong Kong SAR, China
| | - Huiyanchen Li
- Advanced Biomedical Instrumentation Centre, Hong Kong Science Park, Hong Kong SAR, China
| | - Haisong Lin
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong SAR, China.
- Advanced Biomedical Instrumentation Centre, Hong Kong Science Park, Hong Kong SAR, China.
| | - Ho Cheung Shum
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong SAR, China.
- Advanced Biomedical Instrumentation Centre, Hong Kong Science Park, Hong Kong SAR, China.
| |
Collapse
|
29
|
Jiang A, Liu Y, Cai C, Luo P, Wang L. Urological surgical robots in China: state of the art and future prospects. Int J Surg 2024; 110:4469-4470. [PMID: 38526505 PMCID: PMC11254243 DOI: 10.1097/js9.0000000000001377] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2024] [Accepted: 03/10/2024] [Indexed: 03/26/2024]
Affiliation(s)
- Aimin Jiang
- Department of Urology, Changhai Hospital, Naval Medical University (Second Military Medical University)
| | - Ying Liu
- Department of Urology, Changhai Hospital, Naval Medical University (Second Military Medical University)
| | - Chen Cai
- Departmen of Oncology, Zhujiang Hospital, Southern Medical University, Guangzhou, People’s Republic of China
| | - Peng Luo
- Department of Special Clinic, Changhai Hospital, Naval Medical University (Second Military Medical University), Shanghai
| | - Linhui Wang
- Department of Urology, Changhai Hospital, Naval Medical University (Second Military Medical University)
| |
Collapse
|
30
|
Cao Y, Xu B, Li B, Fu H. Advanced Design of Soft Robots with Artificial Intelligence. NANO-MICRO LETTERS 2024; 16:214. [PMID: 38869734 PMCID: PMC11176285 DOI: 10.1007/s40820-024-01423-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 04/22/2024] [Indexed: 06/14/2024]
Abstract
A comprehensive review focused on the whole systems of the soft robotics with artificial intelligence, which can feel, think, react and interact with humans, is presented. The design strategies concerning about various aspects of the soft robotics, like component materials, device structures, prepared technologies, integrated method, and potential applications, are summarized. A broad outlook on the future considerations for the soft robots is proposed. In recent years, breakthrough has been made in the field of artificial intelligence (AI), which has also revolutionized the industry of robotics. Soft robots featured with high-level safety, less weight, lower power consumption have always been one of the research hotspots. Recently, multifunctional sensors for perception of soft robotics have been rapidly developed, while more algorithms and models of machine learning with high accuracy have been optimized and proposed. Designs of soft robots with AI have also been advanced ranging from multimodal sensing, human–machine interaction to effective actuation in robotic systems. Nonetheless, comprehensive reviews concerning the new developments and strategies for the ingenious design of the soft robotic systems equipped with AI are rare. Here, the new development is systematically reviewed in the field of soft robots with AI. First, background and mechanisms of soft robotic systems are briefed, after which development focused on how to endow the soft robots with AI, including the aspects of feeling, thought and reaction, is illustrated. Next, applications of soft robots with AI are systematically summarized and discussed together with advanced strategies proposed for performance enhancement. Design thoughts for future intelligent soft robotics are pointed out. Finally, some perspectives are put forward.
Collapse
Affiliation(s)
- Ying Cao
- Nanotechnology Center, School of Fashion and Textiles, The Hong Kong Polytechnic University, Hong Kong, 999077, People's Republic of China
| | - Bingang Xu
- Nanotechnology Center, School of Fashion and Textiles, The Hong Kong Polytechnic University, Hong Kong, 999077, People's Republic of China.
| | - Bin Li
- Bioinspired Engineering and Biomechanics Center, Xi'an Jiaotong University, Xi'an, 710049, People's Republic of China
| | - Hong Fu
- Department of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong, 999077, People's Republic of China.
| |
Collapse
|
31
|
Zhang L, Xing S, Yin H, Weisbecker H, Tran HT, Guo Z, Han T, Wang Y, Liu Y, Wu Y, Xie W, Huang C, Luo W, Demaesschalck M, McKinney C, Hankley S, Huang A, Brusseau B, Messenger J, Zou Y, Bai W. Skin-inspired, sensory robots for electronic implants. Nat Commun 2024; 15:4777. [PMID: 38839748 PMCID: PMC11153219 DOI: 10.1038/s41467-024-48903-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Accepted: 05/15/2024] [Indexed: 06/07/2024] Open
Abstract
Drawing inspiration from cohesive integration of skeletal muscles and sensory skins in vertebrate animals, we present a design strategy of soft robots, primarily consisting of an electronic skin (e-skin) and an artificial muscle. These robots integrate multifunctional sensing and on-demand actuation into a biocompatible platform using an in-situ solution-based method. They feature biomimetic designs that enable adaptive motions and stress-free contact with tissues, supported by a battery-free wireless module for untethered operation. Demonstrations range from a robotic cuff for detecting blood pressure, to a robotic gripper for tracking bladder volume, an ingestible robot for pH sensing and on-site drug delivery, and a robotic patch for quantifying cardiac function and delivering electrotherapy, highlighting the application versatilities and potentials of the bio-inspired soft robots. Our designs establish a universal strategy with a broad range of sensing and responsive materials, to form integrated soft robots for medical technology and beyond.
Collapse
Affiliation(s)
- Lin Zhang
- Department of Applied Physical Sciences, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Sicheng Xing
- Department of Biomedical Engineering, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Haifeng Yin
- MCAllister Heart Institute Core, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Hannah Weisbecker
- Department of Biology, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Hiep Thanh Tran
- Department of Biomedical Engineering, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Ziheng Guo
- Department of Chemistry, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Tianhong Han
- Joint Department of Biomedical Engineering, North Carolina State University, Raleigh, NC, 27606, USA
| | - Yihang Wang
- Department of Applied Physical Sciences, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Yihan Liu
- Department of Applied Physical Sciences, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Yizhang Wu
- Department of Applied Physical Sciences, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Wanrong Xie
- Department of Applied Physical Sciences, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Chuqi Huang
- Department of Applied Physical Sciences, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Wei Luo
- Department of Biomedical Engineering, University of North Carolina, Chapel Hill, NC, 27514, USA
| | | | - Collin McKinney
- Department of Chemistry, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Samuel Hankley
- Department of Chemistry, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Amber Huang
- Department of Biology, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Brynn Brusseau
- Department of Biology, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Jett Messenger
- Weldon School of Biomedical Engineering, Purdue University, West Lafayette, IN, 47907, USA
| | - Yici Zou
- Department of Biology, University of North Carolina, Chapel Hill, NC, 27514, USA
| | - Wubin Bai
- Department of Applied Physical Sciences, University of North Carolina, Chapel Hill, NC, 27514, USA.
| |
Collapse
|
32
|
Tang G, Liu S, Sun M, Wang Y, Zhu W, Wang D, Li X, Wu H, Men S, Zhang L, Feng C, Wang Y, Ding Y. High-precision all-in-one dual robotic arm strategy in oral implant surgery. BDJ Open 2024; 10:43. [PMID: 38830840 PMCID: PMC11148145 DOI: 10.1038/s41405-024-00231-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 05/01/2024] [Accepted: 05/01/2024] [Indexed: 06/05/2024] Open
Abstract
INTRODUCTION Dental implantation has emerged as an efficient substitute for missing teeth, which is essential for restoring oral function and aesthetics. Compared to traditional denture repair approaches, dental implants offer better stability and sustainability. The position, angle, and depth of dental implants are crucial factors for their long-term success and necessitate high-precision operation and technical support. METHOD We propose an integrated dual-arm high-precision oral implant surgery navigation positioning system and a corresponding control strategy. Compared with traditional implant robots, the integrated dual-arm design greatly shortens the preparation time before surgery and simplifies the operation process. We propose a novel control flow and module for the proposed structure, including an Occluded Target Tracking Module (OTTM) for occlusion tracking, a Planting Plan Development Module (PPDM) for generating implant plans, and a Path Formulation Module (PFM) for controlling the movement path of the two robot arms. RESULT Under the coordinated control of the aforementioned modules, the robot achieved excellent accuracy in clinical trials. The average angular error and entry point error for five patients who underwent implant surgery using the proposed robot were 2.1° and 0.39 mm, respectively. CONCLUSION In essence, our study introduces an integrated dual-arm high-precision navigation system for oral implant surgery, resolving issues like lengthy preoperative preparation and static surgical planning. Clinical results confirm its efficacy, emphasizing its accuracy and precision in guiding oral implant procedures.
Collapse
Affiliation(s)
- Gang Tang
- Logistics Engineering College, Shanghai Maritime University, St. Haigang, Shanghai, 201306, Shanghai, China
| | - Shibo Liu
- Logistics Engineering College, Shanghai Maritime University, St. Haigang, Shanghai, 201306, Shanghai, China
| | - Meng Sun
- Electronic Information Engineering College, Nanjing University of Aeronautics and Astronautics, Nanjing, 210016, Jiangsu, China.
- Nanjing Panda Electronics Company Limited, Nanjing, 210000, China.
| | - Yide Wang
- Institut d'Electronique et des Technologies du numerique, Polytech Nantes-Site de la Chantrerie, 44306, Nantes, France
| | - Weidong Zhu
- Department of Mechanical Engineering, University of Maryland Baltimore County, Baltimore, MD, 21250, USA
| | - Dongmei Wang
- School of Mechanical Engineering, Shanghai Jiao Tong Univ, Shanghai, 200240, Shanghai, China
| | - Xiang Li
- School of Mechanical Engineering, Shanghai Jiao Tong Univ, Shanghai, 200240, Shanghai, China
| | - Hao Wu
- Department of Gastroenterology, Changhai Hospital, Naval Military Medical University, Shanghai, 200433, China
| | - Shaoyang Men
- School of Medical Information Engineering, Guangzhou University of Chinese Medicine, postcode 510006, Guangzhou, China
| | | | - Changfen Feng
- Emergency Department of Stomatology, Suzhou Stomatology Hospital, Suzhou, Jiangsu, 215031, China
| | - Yingfu Wang
- Logistics Engineering College, Shanghai Maritime University, St. Haigang, Shanghai, 201306, Shanghai, China
| | - Yuehua Ding
- School of Electronic and Information Engineering, South China University of Technology, Guangzhou, 510640, China
| |
Collapse
|
33
|
Bozuyuk U, Wrede P, Yildiz E, Sitti M. Roadmap for Clinical Translation of Mobile Microrobotics. ADVANCED MATERIALS (DEERFIELD BEACH, FLA.) 2024; 36:e2311462. [PMID: 38380776 DOI: 10.1002/adma.202311462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/31/2023] [Revised: 01/24/2024] [Indexed: 02/22/2024]
Abstract
Medical microrobotics is an emerging field to revolutionize clinical applications in diagnostics and therapeutics of various diseases. On the other hand, the mobile microrobotics field has important obstacles to pass before clinical translation. This article focuses on these challenges and provides a roadmap of medical microrobots to enable their clinical use. From the concept of a "magic bullet" to the physicochemical interactions of microrobots in complex biological environments in medical applications, there are several translational steps to consider. Clinical translation of mobile microrobots is only possible with a close collaboration between clinical experts and microrobotics researchers to address the technical challenges in microfabrication, safety, and imaging. The clinical application potential can be materialized by designing microrobots that can solve the current main challenges, such as actuation limitations, material stability, and imaging constraints. The strengths and weaknesses of the current progress in the microrobotics field are discussed and a roadmap for their clinical applications in the near future is outlined.
Collapse
Affiliation(s)
- Ugur Bozuyuk
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, 70569, Stuttgart, Germany
| | - Paul Wrede
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, 70569, Stuttgart, Germany
- Institute for Biomedical Engineering, ETH Zurich, Zurich, 8093, Switzerland
| | - Erdost Yildiz
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, 70569, Stuttgart, Germany
| | - Metin Sitti
- Physical Intelligence Department, Max Planck Institute for Intelligent Systems, 70569, Stuttgart, Germany
- School of Medicine and College of Engineering, Koc University, Istanbul, 34450, Turkey
| |
Collapse
|
34
|
Cao Q, Deng R, Pan Y, Liu R, Chen Y, Gong G, Zou J, Yang H, Han D. Robotic wireless capsule endoscopy: recent advances and upcoming technologies. Nat Commun 2024; 15:4597. [PMID: 38816464 PMCID: PMC11139981 DOI: 10.1038/s41467-024-49019-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Accepted: 05/21/2024] [Indexed: 06/01/2024] Open
Abstract
Wireless capsule endoscopy (WCE) offers a non-invasive evaluation of the digestive system, eliminating the need for sedation and the risks associated with conventional endoscopic procedures. Its significance lies in diagnosing gastrointestinal tissue irregularities, especially in the small intestine. However, existing commercial WCE devices face limitations, such as the absence of autonomous lesion detection and treatment capabilities. Recent advancements in micro-electromechanical fabrication and computational methods have led to extensive research in sophisticated technology integration into commercial capsule endoscopes, intending to supersede wired endoscopes. This Review discusses the future requirements for intelligent capsule robots, providing a comparative evaluation of various methods' merits and disadvantages, and highlighting recent developments in six technologies relevant to WCE. These include near-field wireless power transmission, magnetic field active drive, ultra-wideband/intrabody communication, hybrid localization, AI-based autonomous lesion detection, and magnetic-controlled diagnosis and treatment. Moreover, we explore the feasibility for future "capsule surgeons".
Collapse
Affiliation(s)
- Qing Cao
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Runyi Deng
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Yue Pan
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Ruijie Liu
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Yicheng Chen
- Sir Run-Run Shaw Hospital, College of Medicine, Zhejiang University, Hangzhou, 310016, China
| | - Guofang Gong
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Jun Zou
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Huayong Yang
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Dong Han
- State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou, 310027, China.
- School of Mechanical Engineering, Zhejiang University, Hangzhou, 310027, China.
| |
Collapse
|
35
|
Mao L, Yang P, Tian C, Shen X, Wang F, Zhang H, Meng X, Xie H. Magnetic steering continuum robot for transluminal procedures with programmable shape and functionalities. Nat Commun 2024; 15:3759. [PMID: 38704384 PMCID: PMC11069526 DOI: 10.1038/s41467-024-48058-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2023] [Accepted: 04/16/2024] [Indexed: 05/06/2024] Open
Abstract
Millimeter-scale soft continuum robots offer safety and adaptability in transluminal procedures due to their passive compliance, but this feature necessitates interactions with surrounding lumina, leading to potential medical risks and restricted mobility. Here, we introduce a millimeter-scale continuum robot, enabling apical extension while maintaining structural stability. Utilizing phase transition components, the robot executes cycles of tip-based elongation, steered accurately through programmable magnetic fields. Each motion cycle features a solid-like backbone for stability, and a liquid-like component for advancement, thereby enabling autonomous shaping without reliance on environmental interactions. Together with clinical imaging technologies, we demonstrate the capability of navigating through tortuous and fragile lumina to transport microsurgical tools. Once it reaches larger anatomical spaces such as stomach, it can morph into functional 3D structures that serve as surgical tools or sensing units, overcoming the constraints of initially narrow pathways. By leveraging this design paradigm, we anticipate enhanced safety, multi-functionality, and cooperative capabilities among millimeter-scale continuum robots, opening new avenues for transluminal robotic surgery.
Collapse
Affiliation(s)
- Liyang Mao
- State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, 2 Yikuang, Harbin, 150001, China
| | - Peng Yang
- State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, 2 Yikuang, Harbin, 150001, China
| | - Chenyao Tian
- State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, 2 Yikuang, Harbin, 150001, China
| | - Xingjian Shen
- State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, 2 Yikuang, Harbin, 150001, China
| | - Feihao Wang
- State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, 2 Yikuang, Harbin, 150001, China
| | - Hao Zhang
- State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, 2 Yikuang, Harbin, 150001, China.
| | - Xianghe Meng
- State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, 2 Yikuang, Harbin, 150001, China.
| | - Hui Xie
- State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, 2 Yikuang, Harbin, 150001, China.
| |
Collapse
|
36
|
Kim YG, Lee JH, Shim JW, Rhee W, Kim BS, Yoon D, Kim MJ, Park JW, Jeong CW, Yang HK, Cho M, Kim S. A multimodal virtual vision platform as a next-generation vision system for a surgical robot. Med Biol Eng Comput 2024; 62:1535-1548. [PMID: 38305815 PMCID: PMC11021270 DOI: 10.1007/s11517-024-03030-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2023] [Accepted: 01/19/2024] [Indexed: 02/03/2024]
Abstract
Robot-assisted surgery platforms are utilized globally thanks to their stereoscopic vision systems and enhanced functional assistance. However, the necessity of ergonomic improvement for their use by surgeons has been increased. In surgical robots, issues with chronic fatigue exist owing to the fixed posture of the conventional stereo viewer (SV) vision system. A head-mounted display was adopted to alleviate the inconvenience, and a virtual vision platform (VVP) is proposed in this study. The VVP can provide various critical data, including medical images, vital signs, and patient records, in three-dimensional virtual reality space so that users can access medical information simultaneously. An availability of the VVP was investigated based on various user evaluations by surgeons and novices, who executed the given tasks and answered questionnaires. The performances of the SV and VVP were not significantly different; however, the craniovertebral angle of the VVP was 16.35° higher on average than that of the SV. Survey results regarding the VVP were positive; participants indicated that the optimal number of displays was six, preferring the 2 × 3 array. Reflecting the tendencies, the VVP can be a neoconceptual candidate to be customized for medical use, which opens a new prospect in a next-generation surgical robot.
Collapse
Affiliation(s)
- Young Gyun Kim
- Interdisciplinary Program in Bioengineering, Seoul National University, 1 Gwanak-Ro, Gwanak-Gu, Seoul, 08826, Republic of Korea
| | - Jong Hyeon Lee
- Interdisciplinary Program in Bioengineering, Seoul National University, 1 Gwanak-Ro, Gwanak-Gu, Seoul, 08826, Republic of Korea
| | - Jae Woo Shim
- Interdisciplinary Program in Bioengineering, Seoul National University, 1 Gwanak-Ro, Gwanak-Gu, Seoul, 08826, Republic of Korea
| | - Wounsuk Rhee
- Seoul National University Hospital, 101 Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
| | - Byeong Soo Kim
- Interdisciplinary Program in Bioengineering, Seoul National University, 1 Gwanak-Ro, Gwanak-Gu, Seoul, 08826, Republic of Korea
| | - Dan Yoon
- Interdisciplinary Program in Bioengineering, Seoul National University, 1 Gwanak-Ro, Gwanak-Gu, Seoul, 08826, Republic of Korea
| | - Min Jung Kim
- Department of Surgery, Seoul National University College of Medicine, 103 Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
| | - Ji Won Park
- Department of Surgery, Seoul National University College of Medicine, 103 Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
| | - Chang Wook Jeong
- Department of Urology, Seoul National University College of Medicine, 103 Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
| | - Han-Kwang Yang
- Department of Surgery, Seoul National University College of Medicine, 103 Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea
| | - Minwoo Cho
- Department of Transdisciplinary Medicine, Seoul National University Hospital, 101 Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea.
- Department of Medicine, Seoul National University College of Medicine, 103 Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea.
| | - Sungwan Kim
- Department of Biomedical Engineering, Seoul National University College of Medicine, 103 Daehak-Ro, Jongno-Gu, Seoul, 03080, Republic of Korea.
- Artificial Intelligence Institute, Seoul National University, 1 Gwanak-Ro, Gwanak-Gu, Seoul, 08826, Republic of Korea.
| |
Collapse
|
37
|
Li C, Zhang X, Ren Z, Wang J, Sun S, Fu J, Xu Y, Duan W. Design, Modeling, and Experimental Validation of an Active Microcatheter Driven by Shape Memory Effects. MICROMACHINES 2024; 15:603. [PMID: 38793176 PMCID: PMC11123389 DOI: 10.3390/mi15050603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/02/2024] [Revised: 04/23/2024] [Accepted: 04/28/2024] [Indexed: 05/26/2024]
Abstract
Microcatheters capable of active guidance have been proven to be effective and efficient solutions to interventional surgeries for cardiovascular and cerebrovascular diseases. Herein, a novel microcatheter made of two biocompatible materials, shape memory alloy (SMA) and polyethylene (PE), is proposed. It consists of a reconfigurable distal actuator and a separate polyethylene catheter. The distal actuator is created via embedding U-shape SMA wires into the PE base, and its reconfigurability is mainly dominated by the shape memory effect (SME) of SMA wires, as well as the effect of thermal mismatch between the SMA and PE base. A mathematical model was established to predict the distal actuator's deformation, and the analytical solutions show great agreement with the finite element results. Structural optimization of such microcatheters was carried out using the verified analytical model, followed by fabrication of some typical prototypes. Experimental testing of their mechanical behaviors demonstrates the feasibility of the structural designs, and the reliability and accuracy of the mathematical model. The active microcatheter, together with the prediction model, will lay a solid foundation for rapid development and optimization of active navigation strategies for vascular interventions.
Collapse
Affiliation(s)
- Chengyang Li
- School of Mechanical Engineering, Shandong University, Jinan 250061, China; (C.L.); (X.Z.); (J.W.); (S.S.)
| | - Xu Zhang
- School of Mechanical Engineering, Shandong University, Jinan 250061, China; (C.L.); (X.Z.); (J.W.); (S.S.)
| | - Zhongjing Ren
- School of Mechanical Engineering, Shandong University, Jinan 250061, China; (C.L.); (X.Z.); (J.W.); (S.S.)
- Shenzhen Research Institute of Shandong University, Shenzhen 518057, China
- School of Electrical and Information Engineering, Lanzhou University of Technology, Lanzhou 730050, China
- Zhejiang Julihuang Sawing Machine Group Co., Ltd., Lishui 321404, China
| | - Jingkai Wang
- School of Mechanical Engineering, Shandong University, Jinan 250061, China; (C.L.); (X.Z.); (J.W.); (S.S.)
| | - Shouyu Sun
- School of Mechanical Engineering, Shandong University, Jinan 250061, China; (C.L.); (X.Z.); (J.W.); (S.S.)
- Shandong Ande Healthcare Apparatus Co., Ltd., Zibo 255086, China;
| | - Jian Fu
- Shandong Ande Healthcare Apparatus Co., Ltd., Zibo 255086, China;
| | - Yang Xu
- Department of Mechanical Engineering, Stevens Institute of Technology, Hoboken, NJ 07030, USA;
| | - Wu Duan
- Shenzhen Research Institute of Shandong University, Shenzhen 518057, China
- Department of Endocrinology, Qilu Hospital of Shandong University, Jinan 250012, China
| |
Collapse
|
38
|
Dashtbozorg A, Heidarian E, Sagheb Ray Shirazi M, Movahednia Z, Jafari M, Abedi Azar R. Emerging Technologies in Hand Orthopedic Surgery: Current Trends and Future Directions. Galen Med J 2024; 13:e3325. [PMID: 39224550 PMCID: PMC11368481 DOI: 10.31661/gmj.v13i.3325] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2024] [Revised: 02/10/2024] [Accepted: 02/25/2024] [Indexed: 09/04/2024] Open
Abstract
Emerging technologies are changing hand surgery by improving surgical precision, minimizing tissue disruption, and expediting patient recovery. These advancements have the potential to revolutionize surgical procedures, patient outcomes, and rehabilitation processes. However, there are still challenges that need to be addressed before these technologies can be widely adopted. These challenges include the learning curve for surgeons, high costs, and ethical considerations. Future research should focus on addressing the limitations of these technologies, exploring their long-term effects, and evaluating their cost-effectiveness. To successfully implement them, a collaborative approach involving clinicians, researchers, engineers, and policymakers is necessary. This review provides an overview of current and future trends in emerging technologies for hand orthopedic surgery.
Collapse
Affiliation(s)
- Ahmad Dashtbozorg
- Department of Orthopedic Surgery, School of Medicine, Ahvaz Jundishapur University
of Medical Sciences, Ahvaz, Iran
| | - Elaheh Heidarian
- Klinik für Unfallchirurgie und Orthopädie, Kinderorthopädie, Agaplesion
Diakonieklinik Rotenburg, Rotenburg (Wümme), Germany
| | - Malihe Sagheb Ray Shirazi
- Depertment of Anatomical Sciences, Faculty of Nursing and Midwifery, Hormozgan
University of Medical Sciences, Bandar Abbas, Iran
| | - Zahra Movahednia
- Department of Operating Room, Behbahan Faculty of Medical Sciences, Behbahan, Iran
| | - Maryam Jafari
- Department of General Surgery for Trauma, Shahid Beheshti University of Medical
Sciences, Tehran, Iran
| | - Ramila Abedi Azar
- Laboratory for Robotic Research, Iran University of Science and technology, Tehran,
Iran
| |
Collapse
|
39
|
Liu C, Liu Y, Xie R, Li Z, Bai S, Zhao Y. The evolution of robotics: research and application progress of dental implant robotic systems. Int J Oral Sci 2024; 16:28. [PMID: 38584185 PMCID: PMC10999443 DOI: 10.1038/s41368-024-00296-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Revised: 03/11/2024] [Accepted: 03/13/2024] [Indexed: 04/09/2024] Open
Abstract
The use of robots to augment human capabilities and assist in work has long been an aspiration. Robotics has been developing since the 1960s when the first industrial robot was introduced. As technology has advanced, robotic-assisted surgery has shown numerous advantages, including more precision, efficiency, minimal invasiveness, and safety than is possible with conventional techniques, which are research hotspots and cutting-edge trends. This article reviewed the history of medical robot development and seminal research papers about current research progress. Taking the autonomous dental implant robotic system as an example, the advantages and prospects of medical robotic systems would be discussed which would provide a reference for future research.
Collapse
Affiliation(s)
- Chen Liu
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Xi'an, China
- National Clinical Research Center for Oral Diseases, Xi'an, China
- Shaanxi Key Laboratory of Stomatology, Xi'an, China
- Digital Center, School of Stomatology, The Fourth Military Medical University, Xi'an, China
| | - Yuchen Liu
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Xi'an, China
- National Clinical Research Center for Oral Diseases, Xi'an, China
- Shaanxi Key Laboratory of Stomatology, Xi'an, China
- Digital Center, School of Stomatology, The Fourth Military Medical University, Xi'an, China
| | - Rui Xie
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Xi'an, China
- National Clinical Research Center for Oral Diseases, Xi'an, China
- Shaanxi Key Laboratory of Stomatology, Xi'an, China
- Digital Center, School of Stomatology, The Fourth Military Medical University, Xi'an, China
| | - Zhiwen Li
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Xi'an, China
- National Clinical Research Center for Oral Diseases, Xi'an, China
- Shaanxi Key Laboratory of Stomatology, Xi'an, China
- Digital Center, School of Stomatology, The Fourth Military Medical University, Xi'an, China
| | - Shizhu Bai
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Xi'an, China.
- National Clinical Research Center for Oral Diseases, Xi'an, China.
- Shaanxi Key Laboratory of Stomatology, Xi'an, China.
- Digital Center, School of Stomatology, The Fourth Military Medical University, Xi'an, China.
| | - Yimin Zhao
- State Key Laboratory of Oral & Maxillofacial Reconstruction and Regeneration, Xi'an, China.
- National Clinical Research Center for Oral Diseases, Xi'an, China.
- Shaanxi Key Laboratory of Stomatology, Xi'an, China.
- Digital Center, School of Stomatology, The Fourth Military Medical University, Xi'an, China.
| |
Collapse
|
40
|
Wang L, Zou W, Shen J, Yang S, Wu J, Ying T, Cai X, Zhang L, Wu J, Zheng Y. Dual-Functional Laser-Guided Magnetic Nanorobot Collectives against Gravity for On-Demand Thermo-Chemotherapy of Peritoneal Metastasis. Adv Healthc Mater 2024; 13:e2303361. [PMID: 38115718 DOI: 10.1002/adhm.202303361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 12/13/2023] [Indexed: 12/21/2023]
Abstract
Combining hyperthermic intraperitoneal chemotherapy with cytoreductive surgery is the main treatment modality for peritoneal metastatic (PM) carcinoma despite the off-target effects of chemotherapy drugs and the ineluctable side effects of total abdominal heating. Herein, a laser-integrated magnetic actuation system that actively delivers doxorubicin (DOX)-grafted magnetic nanorobot collectives to the tumor site in model mice for local hyperthermia and chemotherapy is reported. With intraluminal movements controlled by a torque-force hybrid magnetic field, these magnetic nanorobots gather at a fixed point coinciding with the position of the localization laser, moving upward against gravity over a long distance and targeting tumor sites under ultrasound imaging guidance. Because aggregation enhances the photothermal effect, controlled local DOX release is achieved under near-infrared laser irradiation. The targeted on-demand photothermal therapy of multiple PM carcinomas while minimizing off-target tissue damage is demonstrated. Additionally, a localization/treatment dual-functional laser-integrated magnetic actuation system is developed and validated in vivo, offering a potentially clinically feasible drug delivery strategy for targeting PM and other intraluminal tumors.
Collapse
Affiliation(s)
- Longchen Wang
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600, Yishan Road, Shanghai, 200233, P. R. China
| | - Weijuan Zou
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600, Yishan Road, Shanghai, 200233, P. R. China
| | - Jian Shen
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600, Yishan Road, Shanghai, 200233, P. R. China
| | - Shihao Yang
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong, 999077, P. R. China
| | - Jingjing Wu
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600, Yishan Road, Shanghai, 200233, P. R. China
| | - Tao Ying
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600, Yishan Road, Shanghai, 200233, P. R. China
| | - Xiaojun Cai
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600, Yishan Road, Shanghai, 200233, P. R. China
| | - Li Zhang
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong, 999077, P. R. China
| | - Jianrong Wu
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600, Yishan Road, Shanghai, 200233, P. R. China
| | - Yuanyi Zheng
- Department of Ultrasound in Medicine, Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600, Yishan Road, Shanghai, 200233, P. R. China
| |
Collapse
|
41
|
Colton A, Fitzgerald D, Sarker S, Barnes N, Gandhi D, Janowski M, Brown JD, Kanter J, Olivieri L, Fuge M, Krieger A, Sochol RD. Toward "S"-Shaped 3D-Printed Soft Robotic Guidewires for Pediatric Patent Ductus Arteriosus Endovascular Interventions. IEEE INTERNATIONAL CONFERENCE ON SOFT ROBOTICS. IEEE INTERNATIONAL CONFERENCE ON SOFT ROBOTICS 2024; 2024:965-970. [PMID: 40160282 PMCID: PMC11955227 DOI: 10.1109/robosoft60065.2024.10521960] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/02/2025]
Abstract
Patent Ductus Arteriosus (PDA) is a heart condition in which the ductus arteriosus-a blood vessel connecting the pulmonary artery to the aorta in a fetus-fails to undergo closure after birth. A PDA can be an important factor in neonates born with severe congenital heart disease (CHD) or born prematurely. With the advent of new intravascular stent technologies, treatments based on ductus arteriosus stenting can now be completed in many cases; however, difficulties remain in accessing the ductus arteriosus in small babies successfully using current guidewire-catheter systems. Recent developments for soft robotic endovascular instruments that leverage control schemes hold distinctive potential for addressing these access challenges, but such technologies are not yet at the sizes required for navigating neonatal vasculature safely and efficiently. In an effort to meet this clinical need, this work presents an approach for 3D printing 1.5 French (Fr) soft robotic guidewires that transition from straight to "S"-shaped configurations under the application of fluidic (e.g., pneumatic or hydraulic) loading. Two distinct dual-opposing segmented soft actuators, including a symmetric and asymmetric system design (both with heights of 2.5 mm), were 3D printed onto 1.1 Fr capillaries in 35-60 minutes via "Two-Photon Direct Laser Writing (DLW)". Experimental results revealed that both designs not only withstood pressures of up to 550 kPa, but also exhibited increased opposing bending deformations-corresponding to decreased radii of curvature-with increasing applied pressure. In combination, this study serves as a critical foundation for next-generation fluidically actuated soft robotic guidewire-catheter systems for PDA interventions.
Collapse
Affiliation(s)
- Adira Colton
- Department of Mechanical Engineering, University of Maryland, College Park, MD, 20742, USA
| | - Declan Fitzgerald
- Department of Mechanical Engineering, University of Maryland, College Park, MD, 20742, USA
| | - Sunandita Sarker
- Department of Mechanical Engineering, University of Maryland, College Park, MD, 20742, USA
| | - Noah Barnes
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Dheeraj Gandhi
- Program in Image Guided Neurointerventions, Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
| | - Miroslaw Janowski
- Program in Image Guided Neurointerventions, Department of Diagnostic Radiology and Nuclear Medicine, University of Maryland School of Medicine, Baltimore, MD, 21201, USA
| | - Jeremy D Brown
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Joshua Kanter
- Children's National Heart Institute, Children's National Hospital, Washington DC, 20010, USA
| | - Laura Olivieri
- Department of Pediatrics, University of Pittsburgh School of Medicine, Pittsburgh, PA 15224, USA
| | - Mark Fuge
- Department of Mechanical Engineering, University of Maryland, College Park, MD, 20742, USA
- Maryland Robotics Center, University of Maryland, College Park, MD, 20742, USA
| | - Axel Krieger
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, 21218, USA
| | - Ryan D Sochol
- Department of Mechanical Engineering, University of Maryland, College Park, MD, 20742, USA
- Maryland Robotics Center, University of Maryland, College Park, MD, 20742, USA
- Robert E. Fischell Institute for Biomedical Devices, University of Maryland, College Park, MD, 20742, USA
| |
Collapse
|
42
|
Sun Y, Zhang W, Gu J, Xia L, Cao Y, Zhu X, Wen H, Ouyang S, Liu R, Li J, Jiang Z, Cheng D, Lv Y, Han X, Qiu W, Cai K, Song E, Cao Q, Li L. Magnetically driven capsules with multimodal response and multifunctionality for biomedical applications. Nat Commun 2024; 15:1839. [PMID: 38424039 PMCID: PMC10904804 DOI: 10.1038/s41467-024-46046-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 02/12/2024] [Indexed: 03/02/2024] Open
Abstract
Untethered capsules hold clinical potential for the diagnosis and treatment of gastrointestinal diseases. Although considerable progress has been achieved recently in this field, the constraints imposed by the narrow spatial structure of the capsule and complex gastrointestinal tract environment cause many open-ended problems, such as poor active motion and limited medical functions. In this work, we describe the development of small-scale magnetically driven capsules with a distinct magnetic soft valve made of dual-layer ferromagnetic soft composite films. A core technological advancement achieved is the flexible opening and closing of the magnetic soft valve by using the competitive interactions between magnetic gradient force and magnetic torque, laying the foundation for the functional integration of both drug release and sampling. Meanwhile, we propose a magnetic actuation strategy based on multi-frequency response control and demonstrate that it can achieve effective decoupled regulation of the capsule's global motion and local responses. Finally, through a comprehensive approach encompassing ideal models, animal ex vivo models, and in vivo assessment, we demonstrate the versatility of the developed magnetic capsules and their multiple potential applications in the biomedical field, such as targeted drug delivery and sampling, selective dual-drug release, and light/thermal-assisted therapy.
Collapse
Affiliation(s)
- Yuxuan Sun
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Wang Zhang
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Junnan Gu
- Department of Gastrointestinal Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Liangyu Xia
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Yinghao Cao
- Cancer Center, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Xinhui Zhu
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Hao Wen
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Shaowei Ouyang
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Ruiqi Liu
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Jialong Li
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Zhenxing Jiang
- Department of Gastrointestinal Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Denglong Cheng
- Department of Gastrointestinal Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Yiliang Lv
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Xiaotao Han
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Wu Qiu
- School of Life Science and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Kailin Cai
- Department of Gastrointestinal Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022, China
| | - Enmin Song
- School of Computer and Technology, Huazhong University of Science and Technology, Wuhan, 430074, China
| | - Quanliang Cao
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China.
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China.
| | - Liang Li
- Wuhan National High Magnetic Field Center, Huazhong University of Science and Technology, Wuhan, 430074, China.
- State Key Laboratory of Advanced Electromagnetic Technology, Huazhong University of Science and Technology, Wuhan, 430074, China.
| |
Collapse
|
43
|
Nelson BJ, Bendok BR, Turcotte EL, Batjer HH. Remote magnetic navigation enables precision telesurgery. Sci Robot 2024; 9:eado3187. [PMID: 38416854 DOI: 10.1126/scirobotics.ado3187] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 01/31/2024] [Indexed: 03/01/2024]
Abstract
Medical devices actuated by external magnetic fields can create opportunities for clinical adoption of precision telesurgery.
Collapse
Affiliation(s)
- Bradley J Nelson
- Multi-Scale Robotics Lab, Institute of Robotics and Intelligent Systems, ETH Zürich, Zürich, Switzerland
| | - Bernard R Bendok
- Department of Neurological Surgery, Mayo Clinic, Phoenix, AZ, USA
- Mayo Clinic College of Medicine and Science, Phoenix, AZ, USA
- Department of Radiology, Mayo Clinic, Phoenix, AZ, USA
- Department of Otolaryngology Head and Neck Surgery/Audiology, Mayo Clinic, Phoenix, AZ, USA
| | - Evelyn L Turcotte
- Mayo Clinic Alix School of Medicine, Mayo Clinic, Scottsdale, AZ, USA
| | - H Hunt Batjer
- Department of Neurological Surgery, Mayo Clinic, Phoenix, AZ, USA
- University of Texas Southwestern Medical Center, Dallas, TX, USA
- University of Texas at Tyler School of Medicine, Tyler, TX, USA
| |
Collapse
|
44
|
Zhang X, Sridhar A, Ha XT, Mehdi SZ, Fortuna A, Magro M, Peloso A, Bicchi A, Ourak M, Aliverti A, Votta E, Vander Poorten E, De Momi E. Path tracking control of a steerable catheter in transcatheter cardiology interventions. Int J Comput Assist Radiol Surg 2024:10.1007/s11548-024-03069-3. [PMID: 38386176 DOI: 10.1007/s11548-024-03069-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Accepted: 01/26/2024] [Indexed: 02/23/2024]
Abstract
PURPOSE Intracardiac transcatheter interventions allow for reducing trauma and hospitalization stays as compared to standard surgery. In the treatment of mitral regurgitation, the most widely adopted transcatheter approach consists in deploying a clip on the mitral valve leaflets by means of a catheter that is run through veins from a peripheral access to the left atrium. However, precise manipulation of the catheter from outside the body while copying with the path constraints imposed by the vessels remains challenging. METHODS We proposed a path tracking control framework that provides adequate motion commands to the robotic steerable catheter for autonomous navigation through vascular lumens. The proposed work implements a catheter kinematic model featuring nonholonomic constraints. Relying on the real-time measurements from an electromagnetic sensor and a fiber Bragg grating sensor, a two-level feedback controller was designed to control the catheter. RESULTS The proposed method was tested in a patient-specific vessel phantom. A median position error between the center line of the vessel and the catheter tip trajectory was found to be below 2 mm, with a maximum error below 3 mm. Statistical testing confirmed that the performance of the proposed method exhibited no significant difference in both free space and the contact region. CONCLUSION The preliminary in vitro studies presented in this paper showed promising accuracy in navigating the catheter within the vessel. The proposed approach enables autonomous control of a steerable catheter for transcatheter cardiology interventions without the request of calibrating the intuitive parameters or acquiring a training dataset.
Collapse
Affiliation(s)
- Xiu Zhang
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133, Milan, Italy.
| | - Aditya Sridhar
- Department of Mechanical Engineering, KU Leuven, 3001, Leuven, Belgium
| | - Xuan Thao Ha
- Department of Mechanical Engineering, KU Leuven, 3001, Leuven, Belgium
| | - Syed Zain Mehdi
- Department of Mechanical Engineering, KU Leuven, 3001, Leuven, Belgium
| | - Andrea Fortuna
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133, Milan, Italy
| | - Mattia Magro
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133, Milan, Italy
| | - Angela Peloso
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133, Milan, Italy
| | - Anna Bicchi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133, Milan, Italy
| | - Mouloud Ourak
- Department of Mechanical Engineering, KU Leuven, 3001, Leuven, Belgium
| | - Andrea Aliverti
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133, Milan, Italy
| | - Emiliano Votta
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133, Milan, Italy
| | | | - Elena De Momi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133, Milan, Italy
| |
Collapse
|
45
|
Li N, Fei P, Tous C, Rezaei Adariani M, Hautot ML, Ouedraogo I, Hadjadj A, Dimov IP, Zhang Q, Lessard S, Nosrati Z, Ng CN, Saatchi K, Häfeli UO, Tremblay C, Kadoury S, Tang A, Martel S, Soulez G. Human-scale navigation of magnetic microrobots in hepatic arteries. Sci Robot 2024; 9:eadh8702. [PMID: 38354257 DOI: 10.1126/scirobotics.adh8702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Accepted: 01/17/2024] [Indexed: 02/16/2024]
Abstract
Using external actuation sources to navigate untethered drug-eluting microrobots in the bloodstream offers great promise in improving the selectivity of drug delivery, especially in oncology, but the current field forces are difficult to maintain with enough strength inside the human body (>70-centimeter-diameter range) to achieve this operation. Here, we present an algorithm to predict the optimal patient position with respect to gravity during endovascular microrobot navigation. Magnetic resonance navigation, using magnetic field gradients in clinical magnetic resonance imaging (MRI), is combined with the algorithm to improve the targeting efficiency of magnetic microrobots (MMRs). Using a dedicated microparticle injector, a high-precision MRI-compatible balloon inflation system, and a clinical MRI, MMRs were successfully steered into targeted lobes via the hepatic arteries of living pigs. The distribution ratio of the microrobots (roughly 2000 MMRs per pig) in the right liver lobe increased from 47.7 to 86.4% and increased in the left lobe from 52.2 to 84.1%. After passing through multiple vascular bifurcations, the number of MMRs reaching four different target liver lobes had a 1.7- to 2.6-fold increase in the navigation groups compared with the control group. Performing simulations on 19 patients with hepatocellular carcinoma (HCC) demonstrated that the proposed technique can meet the need for hepatic embolization in patients with HCC. Our technology offers selectable direction for actuator-based navigation of microrobots at the human scale.
Collapse
Affiliation(s)
- Ning Li
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
| | - Phillip Fei
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
| | - Cyril Tous
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
| | - Mahdi Rezaei Adariani
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
- Inria, Palaiseau 91120, France
| | - Marie-Lou Hautot
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
| | - Inès Ouedraogo
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Nantes, Nantes 44035, France
| | - Amina Hadjadj
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
| | - Ivan P Dimov
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
| | - Quan Zhang
- School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China
- School of Artificial Intelligence, Shanghai University, Shanghai 200444, China
| | - Simon Lessard
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
| | - Zeynab Nosrati
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Courtney N Ng
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Katayoun Saatchi
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Urs O Häfeli
- Faculty of Pharmaceutical Sciences, University of British Columbia, Vancouver, British Columbia V6T 1Z3, Canada
| | - Charles Tremblay
- Department of Computer Engineering and Software Engineering, Polytechnique Montréal, Montréal, Québec H3T 1J4, Canada
| | - Samuel Kadoury
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Department of Computer Engineering and Software Engineering, Polytechnique Montréal, Montréal, Québec H3T 1J4, Canada
| | - An Tang
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
- Centre Hospitalier de l'Université de Montréal (CHUM), Montréal, Québec H2X 0C1, Canada
| | - Sylvain Martel
- Department of Computer Engineering and Software Engineering, Polytechnique Montréal, Montréal, Québec H3T 1J4, Canada
- Department of Bioengineering, McGill University, Montréal, Québec H3A 0E9, Canada
| | - Gilles Soulez
- Clinical Laboratory of Image Processing (LCTI), Centre de Recherche du Centre Hospitalier de l'Université de Montréal (CRCHUM), Montréal, Québec H2X 0A9, Canada
- Université de Montréal, Montréal, Québec H3T 1J4, Canada
- Centre Hospitalier de l'Université de Montréal (CHUM), Montréal, Québec H2X 0C1, Canada
| |
Collapse
|
46
|
Dreyfus R, Boehler Q, Lyttle S, Gruber P, Lussi J, Chautems C, Gervasoni S, Berberat J, Seibold D, Ochsenbein-Kölble N, Reinehr M, Weisskopf M, Remonda L, Nelson BJ. Dexterous helical magnetic robot for improved endovascular access. Sci Robot 2024; 9:eadh0298. [PMID: 38354258 DOI: 10.1126/scirobotics.adh0298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 01/17/2024] [Indexed: 02/16/2024]
Abstract
Treating vascular diseases in the brain requires access to the affected region inside the body. This is usually accomplished through a minimally invasive technique that involves the use of long, thin devices, such as wires and tubes, that are manually maneuvered by a clinician within the bloodstream. By pushing, pulling, and twisting, these devices are navigated through the tortuous pathways of the blood vessels. The outcome of the procedure heavily relies on the clinician's skill and the device's ability to navigate to the affected target region in the bloodstream, which is often inhibited by tortuous blood vessels. Sharp turns require high flexibility, but this flexibility inhibits translation of proximal insertion to distal tip advancement. We present a highly dexterous, magnetically steered continuum robot that overcomes pushability limitations through rotation. A helical protrusion on the device's surface engages with the vessel wall and translates rotation to forward motion at every point of contact. An articulating magnetic tip allows for active steerability, enabling navigation from the aortic arch to millimeter-sized arteries of the brain. The effectiveness of the magnetic continuum robot has been demonstrated through successful navigation in models of the human vasculature and in blood vessels of a live pig.
Collapse
Affiliation(s)
- R Dreyfus
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| | - Q Boehler
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| | - S Lyttle
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| | - P Gruber
- Department of Neuroradiology, Cantonal Hospital Aarau, Aarau, Switzerland
| | - J Lussi
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| | - C Chautems
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| | - S Gervasoni
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| | - J Berberat
- Department of Neuroradiology, Cantonal Hospital Aarau, Aarau, Switzerland
| | - D Seibold
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| | - N Ochsenbein-Kölble
- Department of Obstetrics, University Hospital Zurich, Zurich, Switzerland
- Institute of Pathology and Molecular Pathology, University of Zurich, Zurich, Switzerland
| | - M Reinehr
- University of Zurich, Zurich, Switzerland
| | - M Weisskopf
- Center for Surgical Research, University Hospital Zurich, University of Zurich, Zurich, Switzerland
| | - L Remonda
- Department of Neuroradiology, Cantonal Hospital Aarau, Aarau, Switzerland
| | - B J Nelson
- Multi-Scale Robotics Lab, ETH Zurich, Zurich, Switzerland
| |
Collapse
|
47
|
Finocchiaro M, Banfi T, Donaire S, Arezzo A, Guarner-Argente C, Menciassi A, Casals A, Ciuti G, Hernansanz A. A Framework for the Evaluation of Human Machine Interfaces of Robot-Assisted Colonoscopy. IEEE Trans Biomed Eng 2024; 71:410-422. [PMID: 37535479 DOI: 10.1109/tbme.2023.3301741] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/05/2023]
Abstract
The Human Machine Interface (HMI) of intraluminal robots has a crucial impact on the clinician's performance. It increases or decreases the difficulty of the tasks, and is connected to the users' physical and mental stress. OBJECTIVE This article presents a framework to compare and evaluate different HMIs for robotic colonoscopy, with the objective of identifying the optimal HMI that minimises the clinician's effort and maximises the clinical outcomes. METHODS The framework comprises a 1) a virtual simulator (clinically validated), 2) wearable sensors measuring the cognitive load, 3) a data collection unit of metrics correlated to the clinical performance, and 4) questionnaires exploring the users' impressions and perceived stress. The framework was tested with 42 clinicians investigating the optimal device for tele-operated control of robotic colonoscopes. Two control devices were selected and compared: a haptic serial-kinematic device and a standard videogame joypad. RESULTS The haptic device was preferred by the endoscopists, but the joypad enabled better clinical performance and reduced cognitive and physical load. CONCLUSION The framework can be used to evaluate different aspects of a HMI, both hardware and software, and determine the optimal HMI that can reduce the burden on clinicians while improving the clinical outcome. SIGNIFICANCE The findings of this study, and of future studies performed with this framework, can inform the design and development of HMIs for intraluminal robots, leading to improved clinical performance, reduced physical and mental stress for clinicians, and ultimately better patient outcomes.
Collapse
|
48
|
Gavette H, McDonald CL, Kostick-Quenet K, Mullen A, Najafi B, Finco MG. Advances in prosthetic technology: a perspective on ethical considerations for development and clinical translation. FRONTIERS IN REHABILITATION SCIENCES 2024; 4:1335966. [PMID: 38293290 PMCID: PMC10824968 DOI: 10.3389/fresc.2023.1335966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Accepted: 12/29/2023] [Indexed: 02/01/2024]
Abstract
Technological advancements of prostheses in recent years, such as haptic feedback, active power, and machine learning for prosthetic control, have opened new doors for improved functioning, satisfaction, and overall quality of life. However, little attention has been paid to ethical considerations surrounding the development and translation of prosthetic technologies into clinical practice. This article, based on current literature, presents perspectives surrounding ethical considerations from the authors' multidisciplinary views as prosthetists (HG, AM, CLM, MGF), as well as combined research experience working directly with people using prostheses (AM, CLM, MGF), wearable technologies for rehabilitation (MGF, BN), machine learning and artificial intelligence (BN, KKQ), and ethics of advanced technologies (KKQ). The target audience for this article includes developers, manufacturers, and researchers of prosthetic devices and related technology. We present several ethical considerations for current advances in prosthetic technology, as well as topics for future research, that may inform product and policy decisions and positively influence the lives of those who can benefit from advances in prosthetic technology.
Collapse
Affiliation(s)
- Hayden Gavette
- Orthotics and Prosthetics Program, School of Health Professions, Baylor College of Medicine, Houston, TX, United States
| | - Cody L. McDonald
- Department of Rehabilitation Medicine, University of Washington, Seattle, WA, United States
| | - Kristin Kostick-Quenet
- Center for Medical Ethics and Health Policy, Baylor College of Medicine, Houston, TX, United States
| | - Ashley Mullen
- Orthotics and Prosthetics Program, School of Health Professions, Baylor College of Medicine, Houston, TX, United States
| | - Bijan Najafi
- Interdisciplinary Consortium on Advanced Motion Performance Lab (iCAMP), Department of Surgery, Baylor College of Medicine, Houston, TX, United States
| | - M. G. Finco
- Orthotics and Prosthetics Program, School of Health Professions, Baylor College of Medicine, Houston, TX, United States
- Interdisciplinary Consortium on Advanced Motion Performance Lab (iCAMP), Department of Surgery, Baylor College of Medicine, Houston, TX, United States
| |
Collapse
|
49
|
Bo Y, Wang H, Niu H, He X, Xue Q, Li Z, Yang H, Niu F. Advancements in materials, manufacturing, propulsion and localization: propelling soft robotics for medical applications. Front Bioeng Biotechnol 2024; 11:1327441. [PMID: 38260727 PMCID: PMC10800571 DOI: 10.3389/fbioe.2023.1327441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Accepted: 12/04/2023] [Indexed: 01/24/2024] Open
Abstract
Soft robotics is an emerging field showing immense potential for biomedical applications. This review summarizes recent advancements in soft robotics for in vitro and in vivo medical contexts. Their inherent flexibility, adaptability, and biocompatibility enable diverse capabilities from surgical assistance to minimally invasive diagnosis and therapy. Intelligent stimuli-responsive materials and bioinspired designs are enhancing functionality while improving biocompatibility. Additive manufacturing techniques facilitate rapid prototyping and customization. Untethered chemical, biological, and wireless propulsion methods are overcoming previous constraints to access new sites. Meanwhile, advances in tracking modalities like computed tomography, fluorescence and ultrasound imaging enable precision localization and control enable in vivo applications. While still maturing, soft robotics promises more intelligent, less invasive technologies to improve patient care. Continuing research into biocompatibility, power supplies, biomimetics, and seamless localization will help translate soft robots into widespread clinical practice.
Collapse
Affiliation(s)
- Yunwen Bo
- School of Mechanical Engineering, Suzhou University of Science and Technology, Suzhou, China
| | - Haochen Wang
- School of Mechanical Engineering, Suzhou University of Science and Technology, Suzhou, China
| | - Hui Niu
- Department of Pathology, Second Affiliated Hospital of Soochow University, Suzhou, China
| | - Xinyang He
- School of Mechanical Engineering, Suzhou University of Science and Technology, Suzhou, China
| | - Quhao Xue
- School of Mechanical Engineering, Suzhou University of Science and Technology, Suzhou, China
| | - Zexi Li
- School of Mechanical Engineering, Suzhou University of Science and Technology, Suzhou, China
| | - Hao Yang
- Robotics and Microsystems Center, School of Mechanical and Electrical Engineering, Soochow University, Suzhou, China
| | - Fuzhou Niu
- School of Mechanical Engineering, Suzhou University of Science and Technology, Suzhou, China
| |
Collapse
|
50
|
Zhang J, Liu L, Xiang P, Fang Q, Nie X, Ma H, Hu J, Xiong R, Wang Y, Lu H. AI co-pilot bronchoscope robot. Nat Commun 2024; 15:241. [PMID: 38172095 PMCID: PMC10764930 DOI: 10.1038/s41467-023-44385-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Accepted: 12/12/2023] [Indexed: 01/05/2024] Open
Abstract
The unequal distribution of medical resources and scarcity of experienced practitioners confine access to bronchoscopy primarily to well-equipped hospitals in developed regions, contributing to the unavailability of bronchoscopic services in underdeveloped areas. Here, we present an artificial intelligence (AI) co-pilot bronchoscope robot that empowers novice doctors to conduct lung examinations as safely and adeptly as experienced colleagues. The system features a user-friendly, plug-and-play catheter, devised for robot-assisted steering, facilitating access to bronchi beyond the fifth generation in average adult patients. Drawing upon historical bronchoscopic videos and expert imitation, our AI-human shared control algorithm enables novice doctors to achieve safe steering in the lung, mitigating misoperations. Both in vitro and in vivo results underscore that our system equips novice doctors with the skills to perform lung examinations as expertly as seasoned practitioners. This study offers innovative strategies to address the pressing issue of medical resource disparities through AI assistance.
Collapse
Affiliation(s)
- Jingyu Zhang
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, 310027, Hangzhou, China
- Institute of Cyber-Systems and Control, Department of Control Science and Engineering, Zhejiang University, 310027, Hangzhou, China
| | - Lilu Liu
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, 310027, Hangzhou, China
- Institute of Cyber-Systems and Control, Department of Control Science and Engineering, Zhejiang University, 310027, Hangzhou, China
| | - Pingyu Xiang
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, 310027, Hangzhou, China
- Institute of Cyber-Systems and Control, Department of Control Science and Engineering, Zhejiang University, 310027, Hangzhou, China
| | - Qin Fang
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, 310027, Hangzhou, China
- Institute of Cyber-Systems and Control, Department of Control Science and Engineering, Zhejiang University, 310027, Hangzhou, China
| | - Xiuping Nie
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, 310027, Hangzhou, China
- Institute of Cyber-Systems and Control, Department of Control Science and Engineering, Zhejiang University, 310027, Hangzhou, China
| | - Honghai Ma
- Department of Thoracic Surgery, First Affiliated Hospital, School of Medicine, Zhejiang University, 310009, Hangzhou, China
| | - Jian Hu
- Department of Thoracic Surgery, First Affiliated Hospital, School of Medicine, Zhejiang University, 310009, Hangzhou, China
| | - Rong Xiong
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, 310027, Hangzhou, China.
- Institute of Cyber-Systems and Control, Department of Control Science and Engineering, Zhejiang University, 310027, Hangzhou, China.
| | - Yue Wang
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, 310027, Hangzhou, China.
- Institute of Cyber-Systems and Control, Department of Control Science and Engineering, Zhejiang University, 310027, Hangzhou, China.
| | - Haojian Lu
- State Key Laboratory of Industrial Control and Technology, Zhejiang University, 310027, Hangzhou, China.
- Institute of Cyber-Systems and Control, Department of Control Science and Engineering, Zhejiang University, 310027, Hangzhou, China.
| |
Collapse
|