1
|
Sun H, Liu J, Wang Q. Magnetic Actuation Systems and Magnetic Robots for Gastrointestinal Examination and Treatment. CHINESE JOURNAL OF ELECTRICAL ENGINEERING 2023; 9:3-28. [DOI: 10.23919/cjee.2023.000009] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
Affiliation(s)
- Hongbo Sun
- Institute of Electrical Engineering, Chinese Academy of Sciences,Beijing,China,100190
| | - Jianhua Liu
- Institute of Electrical Engineering, Chinese Academy of Sciences,Beijing,China,100190
| | - Qiuliang Wang
- Institute of Electrical Engineering, Chinese Academy of Sciences,Beijing,China,100190
| |
Collapse
|
2
|
Winters C, Subramanian V, Valdastri P. Robotic, self-propelled, self-steerable, and disposable colonoscopes: Reality or pipe dream? A state of the art review. World J Gastroenterol 2022; 28:5093-5110. [PMID: 36188716 PMCID: PMC9516669 DOI: 10.3748/wjg.v28.i35.5093] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 06/21/2022] [Accepted: 09/01/2022] [Indexed: 02/06/2023] Open
Abstract
Robotic colonoscopes could potentially provide a comfortable, less painful and safer alternative to standard colonoscopy. Recent exciting developments in this field are pushing the boundaries to what is possible in the future. This article provides a comprehensive review of the current work in robotic colonoscopes including self-propelled, steerable and disposable endoscopes that could be alternatives to standard colonoscopy. We discuss the advantages and disadvantages of these systems currently in development and highlight the technical readiness of each system to help the reader understand where and when such systems may be available for routine clinical use and get an idea of where and in which situation they can best be deployed.
Collapse
Affiliation(s)
- Conchubhair Winters
- Leeds Institute of Medical Research, University of Leeds, St. James’s University Hospital, Leeds LS9 7TF, United Kingdom
| | - Venkataraman Subramanian
- Leeds Institute of Medical Research, University of Leeds, St. James’s University Hospital, Leeds LS9 7TF, United Kingdom
| | - Pietro Valdastri
- School of Electronic and Electrical Engineering, University of Leeds, Leeds LS2 9JT, United Kingdom
| |
Collapse
|
3
|
Hanscom M, Cave DR. Endoscopic capsule robot-based diagnosis, navigation and localization in the gastrointestinal tract. Front Robot AI 2022; 9:896028. [PMID: 36119725 PMCID: PMC9479458 DOI: 10.3389/frobt.2022.896028] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 08/08/2022] [Indexed: 01/10/2023] Open
Abstract
The proliferation of video capsule endoscopy (VCE) would not have been possible without continued technological improvements in imaging and locomotion. Advancements in imaging include both software and hardware improvements but perhaps the greatest software advancement in imaging comes in the form of artificial intelligence (AI). Current research into AI in VCE includes the diagnosis of tumors, gastrointestinal bleeding, Crohn’s disease, and celiac disease. Other advancements have focused on the improvement of both camera technologies and alternative forms of imaging. Comparatively, advancements in locomotion have just started to approach clinical use and include onboard controlled locomotion, which involves miniaturizing a motor to incorporate into the video capsule, and externally controlled locomotion, which involves using an outside power source to maneuver the capsule itself. Advancements in locomotion hold promise to remove one of the major disadvantages of VCE, namely, its inability to obtain targeted diagnoses. Active capsule control could in turn unlock additional diagnostic and therapeutic potential, such as the ability to obtain targeted tissue biopsies or drug delivery. With both advancements in imaging and locomotion has come a corresponding need to be better able to process generated images and localize the capsule’s position within the gastrointestinal tract. Technological advancements in computation performance have led to improvements in image compression and transfer, as well as advancements in sensor detection and alternative methods of capsule localization. Together, these advancements have led to the expansion of VCE across a number of indications, including the evaluation of esophageal and colon pathologies including esophagitis, esophageal varices, Crohn’s disease, and polyps after incomplete colonoscopy. Current research has also suggested a role for VCE in acute gastrointestinal bleeding throughout the gastrointestinal tract, as well as in urgent settings such as the emergency department, and in resource-constrained settings, such as during the COVID-19 pandemic. VCE has solidified its role in the evaluation of small bowel bleeding and earned an important place in the practicing gastroenterologist’s armamentarium. In the next few decades, further improvements in imaging and locomotion promise to open up even more clinical roles for the video capsule as a tool for non-invasive diagnosis of lumenal gastrointestinal pathologies.
Collapse
|
4
|
Mahmood S, Schostek S, Schurr MO, Bergsland J, Balasingham I, Fosse E. Robot-assisted magnetic capsule endoscopy; navigating colorectal inclinations. MINIM INVASIV THER 2022; 31:930-938. [DOI: 10.1080/13645706.2022.2032181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
| | | | - Marc O. Schurr
- Ovesco Endoscopy AG, Tuebingen, Germany
- IHCI-Institute, Steinbeis University Berlin, Tuebingen, Germany
| | - Jacob Bergsland
- Intervention Center, Oslo University Hospital, Oslo, Norway
- BH Heart Center, Tuzla, Bosnia and Herzegovina
| | - Ilangko Balasingham
- Intervention Center, Oslo University Hospital, Oslo, Norway
- Department of Electronic Systems, Norwegian University of Science and Technology, Trondheim, Norway
| | - Erik Fosse
- Faculty of Medicine, University of Oslo, Oslo, Norway
- Intervention Center, Oslo University Hospital, Oslo, Norway
| |
Collapse
|
5
|
Digital Twin of a Magnetic Medical Microrobot with Stochastic Model Predictive Controller Boosted by Machine Learning in Cyber-Physical Healthcare Systems. INFORMATION 2022. [DOI: 10.3390/info13070321] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023] Open
Abstract
Recently, emerging technologies have assisted the healthcare system in the treatment of a wide range of diseases so considerably that the development of such methods has been regarded as a practical solution to cure many diseases. Accordingly, underestimating the importance of such cyber environments in the medical and healthcare system is not logical, as a combination of such systems with the Metaverse can lead to tremendous applications, particularly after this pandemic, in which the significance of such technologies has been proven. This is why the digital twin of a medical microrobot, which is controlled via a stochastic model predictive controller (MPC) empowered by a system identification based on machine learning (ML), has been rendered in this research. This robot benefits from the technology of magnetic levitation, and the identification approach helps the controller to identify the dynamic of this robot. Considering the size, control system, and specifications of such micro-magnetic mechanisms, it can play an important role in monitoring, drug-delivery, or even some sensitive internal surgeries. Thus, accuracy, robustness, and reliability have been taken into consideration for the design and simulation of this magnetic mechanism. Finally, a second-order statistic noise is added to the plant while the controller is updated by a Kalman filter to deal with this environment. The results prove that the proposed controller will work effectively.
Collapse
|
6
|
Sekhon Inderjit Singh HK, Armstrong ER, Shah S, Mirnezami R. Application of robotic technologies in lower gastrointestinal tract endoscopy: A systematic review. World J Gastrointest Endosc 2021; 13:673-697. [PMID: 35070028 PMCID: PMC8716978 DOI: 10.4253/wjge.v13.i12.673] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/18/2021] [Revised: 07/31/2021] [Accepted: 12/03/2021] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Conventional optical colonoscopy is considered the gold standard investigation for colorectal tract pathology including colorectal malignancy, polyps and inflammatory bowel disease. Inherent limitations exist with current generation endoscopic technologies, including, but not limited to, patient discomfort, endoscopist fatigue, narrow field of view and missed pathology behind colonic folds. Rapid developments in medical robotics have led to the emergence of a variety of next-generation robotically-augmented technologies that could overcome these limitations.
AIM To provide a comprehensive summary of recent developments in the application of robotics in lower gastrointestinal tract endoscopy.
METHODS A systematic review of the literature was performed from January 1, 2000 to the January 7, 2021 using EMBASE, MEDLINE and Cochrane databases. Studies reporting data on the use of robotic technology in ex vivo or in vivo animal and human experiments were included. In vitro studies (studies using synthetic colon models), studies evaluating non-robotic technology, robotic technology aimed at the upper gastrointestinal tract or paediatric endoscopy were excluded. System ergonomics, safety, visualisation, and diagnostic/therapeutic capabilities were assessed.
RESULTS Initial literature searching identified 814 potentially eligible studies, from which 37 were deemed suitable for inclusion. Included studies were classified according to the actuation modality of the robotic device(s) as electromechanical (EM) (n = 13), pneumatic (n = 11), hydraulic (n = 1), magnetic (n = 10) and hybrid (n = 2) mechanisms. Five devices have been approved by the Food and Drug Administration, however most of the technologies reviewed remain in the early phases of testing and development. Level 1 evidence is lacking at present, but early reports suggest that these technologies may be associated with improved pain and safety. The reviewed devices appear to be ergonomically capable and efficient though to date no reports have convincingly shown diagnostic or therapeutic superiority over conventional colonoscopy.
CONCLUSION Significant progress in robotic colonoscopy has been made over the last couple of decades. Improvements in design together with the integration of semi-autonomous and autonomous systems over the next decade will potentially result in robotic colonoscopy becoming more commonplace.
Collapse
Affiliation(s)
| | - Emily Rose Armstrong
- Colorectal Surgery, The Royal Free Hospital, London NW3 2QG, Hampstead, United Kingdom
| | - Sujay Shah
- Colorectal Surgery, The Royal Free Hospital, London NW3 2QG, Hampstead, United Kingdom
| | - Reza Mirnezami
- Colorectal Surgery, The Royal Free Hospital, London NW3 2QG, Hampstead, United Kingdom
| |
Collapse
|
7
|
Yen SY, Huang HE, Lien GS, Liu CW, Chu CF, Huang WM, Suk FM. Automatic lumen detection and magnetic alignment control for magnetic-assisted capsule colonoscope system optimization. Sci Rep 2021; 11:6460. [PMID: 33742067 PMCID: PMC7979719 DOI: 10.1038/s41598-021-86101-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2020] [Accepted: 03/10/2021] [Indexed: 02/07/2023] Open
Abstract
We developed a magnetic-assisted capsule colonoscope system with integration of computer vision-based object detection and an alignment control scheme. Two convolutional neural network models A and B for lumen identification were trained on an endoscopic dataset of 9080 images. In the lumen alignment experiment, models C and D used a simulated dataset of 8414 images. The models were evaluated using validation indexes for recall (R), precision (P), mean average precision (mAP), and F1 score. Predictive performance was evaluated with the area under the P-R curve. Adjustments of pitch and yaw angles and alignment control time were analyzed in the alignment experiment. Model D had the best predictive performance. Its R, P, mAP, and F1 score were 0.964, 0.961, 0.961, and 0.963, respectively, when the area of overlap/area of union was at 0.3. In the lumen alignment experiment, the mean degrees of adjustment for yaw and pitch in 160 trials were 21.70° and 13.78°, respectively. Mean alignment control time was 0.902 s. Finally, we compared the cecal intubation time between semi-automated and manual navigation in 20 trials. The average cecal intubation time of manual navigation and semi-automated navigation were 9 min 28.41 s and 7 min 23.61 s, respectively. The automatic lumen detection model, which was trained using a deep learning algorithm, demonstrated high performance in each validation index.
Collapse
Affiliation(s)
- Sheng-Yang Yen
- Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan
| | - Hao-En Huang
- Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan
| | - Gi-Shih Lien
- Division of Gastroenterology, Department of Internal Medicine, Taipei Municipal Wan Fang Hospital, Taipei Medical University, No. 111, Section 3, Xing Long Road, Taipei, 116, Taiwan.,Department of Internal Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
| | - Chih-Wen Liu
- Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan
| | - Chia-Feng Chu
- Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan
| | - Wei-Ming Huang
- Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan
| | - Fat-Moon Suk
- Division of Gastroenterology, Department of Internal Medicine, Taipei Municipal Wan Fang Hospital, Taipei Medical University, No. 111, Section 3, Xing Long Road, Taipei, 116, Taiwan. .,Department of Internal Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan.
| |
Collapse
|
8
|
Martin JW, Scaglioni B, Norton JC, Subramanian V, Arezzo A, Obstein KL, Valdastri P. Enabling the future of colonoscopy with intelligent and autonomous magnetic manipulation. NAT MACH INTELL 2020; 2:595-606. [PMID: 33089071 PMCID: PMC7571595 DOI: 10.1038/s42256-020-00231-9] [Citation(s) in RCA: 60] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Accepted: 09/01/2020] [Indexed: 12/24/2022]
Abstract
Early diagnosis of colorectal cancer significantly improves survival. However, over half of cases are diagnosed late due to demand exceeding the capacity for colonoscopy - the "gold standard" for screening. Colonoscopy is limited by the outdated design of conventional endoscopes, associated with high complexity of use, cost and pain. Magnetic endoscopes represent a promising alternative, overcoming drawbacks of pain and cost, but struggle to reach the translational stage as magnetic manipulation is complex and unintuitive. In this work, we use machine vision to develop intelligent and autonomous control of a magnetic endoscope, for the first time enabling non-expert users to effectively perform magnetic colonoscopy in-vivo. We combine the use of robotics, computer vision and advanced control to offer an intuitive and effective endoscopic system. Moreover, we define the characteristics required to achieve autonomy in robotic endoscopy. The paradigm described here can be adopted in a variety of applications where navigation in unstructured environments is required, such as catheters, pancreatic endoscopy, bronchoscopy, and gastroscopy. This work brings alternative endoscopic technologies closer to the translational stage, increasing availability of early-stage cancer treatments.
Collapse
Affiliation(s)
| | | | | | | | - Alberto Arezzo
- Department of Surgical Science, University of Torino, Corso Dogliotti, Turin, Italy
| | - Keith L. Obstein
- STORM Lab USA, Vanderbilt University, Nashville, USA
- Vanderbilt University Medical Centre, Nashville, TN, USA
| | | |
Collapse
|
9
|
Hao Y, Li J, Meng F, Zhang P, Ciuti G, Dario P, Huang Q. Photometric Stereo-Based Depth Map Reconstruction for Monocular Capsule Endoscopy. SENSORS (BASEL, SWITZERLAND) 2020; 20:E5403. [PMID: 32967182 PMCID: PMC7571214 DOI: 10.3390/s20185403] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/25/2020] [Revised: 09/15/2020] [Accepted: 09/16/2020] [Indexed: 11/24/2022]
Abstract
The capsule endoscopy robot can only use monocular vision due to the dimensional limit. To improve the depth perception of the monocular capsule endoscopy robot, this paper proposes a photometric stereo-based depth map reconstruction method. First, based on the characteristics of the capsule endoscopy robot system, a photometric stereo framework is established. Then, by combining the specular property and Lambertian property of the object surface, the depth of the specular highlight point is estimated, and the depth map of the whole object surface is reconstructed by a forward upwind scheme. To evaluate the precision of the depth estimation of the specular highlight region and the depth map reconstruction of the object surface, simulations and experiments are implemented with synthetic images and pig colon tissue, respectively. The results of the simulations and experiments show that the proposed method provides good precision for depth map reconstruction in monocular capsule endoscopy.
Collapse
Affiliation(s)
- Yang Hao
- Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China; (Y.H.); (P.Z.)
| | - Jing Li
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China; (J.L.); (G.C.); (P.D.); (Q.H.)
| | - Fei Meng
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing 100081, China
| | - Peisen Zhang
- Intelligent Robotics Institute, School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China; (Y.H.); (P.Z.)
| | - Gastone Ciuti
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China; (J.L.); (G.C.); (P.D.); (Q.H.)
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
| | - Paolo Dario
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China; (J.L.); (G.C.); (P.D.); (Q.H.)
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
| | - Qiang Huang
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Beijing 100081, China; (J.L.); (G.C.); (P.D.); (Q.H.)
- Key Laboratory of Biomimetic Robots and Systems, Beijing Institute of Technology, Ministry of Education, Beijing 100081, China
| |
Collapse
|
10
|
Verra M, Firrincieli A, Chiurazzi M, Mariani A, Lo Secco G, Forcignanò E, Koulaouzidis A, Menciassi A, Dario P, Ciuti G, Arezzo A. Robotic-Assisted Colonoscopy Platform with a Magnetically-Actuated Soft-Tethered Capsule. Cancers (Basel) 2020; 12:E2485. [PMID: 32887238 PMCID: PMC7565775 DOI: 10.3390/cancers12092485] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 08/28/2020] [Accepted: 08/29/2020] [Indexed: 12/24/2022] Open
Abstract
Background and Aims: Colorectal cancer (CRC) is a major cause of morbidity and mortality worldwide. Despite offering a prime paradigm for screening, CRC screening is often hampered by invasiveness. Endoo is a potentially painless colonoscopy method with an active locomotion tethered capsule offering diagnostic and therapeutic capabilities. Materials and Methods: The Endoo system comprises a soft-tethered capsule, which embeds a permanent magnet controlled by an external robot equipped with a second permanent magnet. Capsule navigation is achieved via closed-loop interaction between the two magnets. Ex-vivo tests were conducted by endoscopy experts and trainees to evaluate the basic key features, usability, and compliance in comparison with conventional colonoscopy (CC) in feasibility and pilot studies. Results: Endoo showed a 100% success rate in operating channel and target approach tests. Progression of the capsule was feasible and repeatable. The magnetic link was lost an average of 1.28 times per complete procedure but was restored in 100% of cases. The peak value of interaction forces was higher in the CC group than the Endoo group (4.12N vs. 1.17N). The cumulative interaction forces over time were higher in the CC group than the Endoo group between the splenic flexure and mid-transverse colon (16.53Ns vs. 1.67Ns, p < 0.001), as well as between the hepatic flexure and cecum (28.77Ns vs. 2.47Ns, p = 0.005). The polyp detection rates were comparable between groups (9.1 ± 0.9% vs. 8.7 ± 0.9%, CC and Endoo respectively, per procedure). Robotic colonoscopies were completed in 67% of the procedures performed with Endoo (53% experts and 100% trainees). Conclusions: Endoo allows smoother navigation than CC and possesses comparable features. Although further research is needed, magnetic capsule colonoscopy demonstrated promising results compared to CC.
Collapse
Affiliation(s)
- Mauro Verra
- Department of Surgical Sciences, University of Torino, 10126 Torino, Italy; (M.V.); (G.L.S.); (E.F.)
| | - Andrea Firrincieli
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (A.F.); (M.C.); (A.M.); (A.M.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
| | - Marcello Chiurazzi
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (A.F.); (M.C.); (A.M.); (A.M.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
| | - Andrea Mariani
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (A.F.); (M.C.); (A.M.); (A.M.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
| | - Giacomo Lo Secco
- Department of Surgical Sciences, University of Torino, 10126 Torino, Italy; (M.V.); (G.L.S.); (E.F.)
| | - Edoardo Forcignanò
- Department of Surgical Sciences, University of Torino, 10126 Torino, Italy; (M.V.); (G.L.S.); (E.F.)
| | | | - Arianna Menciassi
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (A.F.); (M.C.); (A.M.); (A.M.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
| | - Paolo Dario
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (A.F.); (M.C.); (A.M.); (A.M.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
| | - Gastone Ciuti
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (A.F.); (M.C.); (A.M.); (A.M.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56025 Pisa, Italy
| | - Alberto Arezzo
- Department of Surgical Sciences, University of Torino, 10126 Torino, Italy; (M.V.); (G.L.S.); (E.F.)
| |
Collapse
|
11
|
Ciuti G, Skonieczna-Żydecka K, Marlicz W, Iacovacci V, Liu H, Stoyanov D, Arezzo A, Chiurazzi M, Toth E, Thorlacius H, Dario P, Koulaouzidis A. Frontiers of Robotic Colonoscopy: A Comprehensive Review of Robotic Colonoscopes and Technologies. J Clin Med 2020; 9:E1648. [PMID: 32486374 PMCID: PMC7356873 DOI: 10.3390/jcm9061648] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Revised: 05/16/2020] [Accepted: 05/19/2020] [Indexed: 12/15/2022] Open
Abstract
Flexible colonoscopy remains the prime mean of screening for colorectal cancer (CRC) and the gold standard of all population-based screening pathways around the world. Almost 60% of CRC deaths could be prevented with screening. However, colonoscopy attendance rates are affected by discomfort, fear of pain and embarrassment or loss of control during the procedure. Moreover, the emergence and global thread of new communicable diseases might seriously affect the functioning of contemporary centres performing gastrointestinal endoscopy. Innovative solutions are needed: artificial intelligence (AI) and physical robotics will drastically contribute for the future of the healthcare services. The translation of robotic technologies from traditional surgery to minimally invasive endoscopic interventions is an emerging field, mainly challenged by the tough requirements for miniaturization. Pioneering approaches for robotic colonoscopy have been reported in the nineties, with the appearance of inchworm-like devices. Since then, robotic colonoscopes with assistive functionalities have become commercially available. Research prototypes promise enhanced accessibility and flexibility for future therapeutic interventions, even via autonomous or robotic-assisted agents, such as robotic capsules. Furthermore, the pairing of such endoscopic systems with AI-enabled image analysis and recognition methods promises enhanced diagnostic yield. By assembling a multidisciplinary team of engineers and endoscopists, the paper aims to provide a contemporary and highly-pictorial critical review for robotic colonoscopes, hence providing clinicians and researchers with a glimpse of the major changes and challenges that lie ahead.
Collapse
Affiliation(s)
- Gastone Ciuti
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (V.I.); (M.C.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | - Karolina Skonieczna-Żydecka
- Department of Human Nutrition and Metabolomics, Pomeranian Medical University in Szczecin, 71-460 Szczecin, Poland;
| | - Wojciech Marlicz
- Department of Gastroenterology, Pomeranian Medical University in Szczecin, 71-252 Szczecin, Poland;
- Endoklinika sp. z o.o., 70-535 Szczecin, Poland
| | - Veronica Iacovacci
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (V.I.); (M.C.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | - Hongbin Liu
- School of Biomedical Engineering & Imaging Sciences, Faculty of Life Sciences and Medicine, King’s College London, London SE1 7EH, UK;
| | - Danail Stoyanov
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London W1W 7TY, UK;
| | - Alberto Arezzo
- Department of Surgical Sciences, University of Torino, 10126 Torino, Italy;
| | - Marcello Chiurazzi
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (V.I.); (M.C.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | - Ervin Toth
- Department of Gastroenterology, Skåne University Hospital, Lund University, 20502 Malmö, Sweden;
| | - Henrik Thorlacius
- Department of Clinical Sciences, Section of Surgery, Lund University, 20502 Malmö, Sweden;
| | - Paolo Dario
- The BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pisa, Italy; (V.I.); (M.C.); (P.D.)
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, 56127 Pisa, Italy
| | | |
Collapse
|
12
|
Barducci L, Pittiglio G, Norton JC, Obstein KL, Valdastri P. Adaptive Dynamic Control for Magnetically Actuated Medical Robots. IEEE Robot Autom Lett 2019; 4:3633-3640. [PMID: 31406915 PMCID: PMC6690374 DOI: 10.1109/lra.2019.2928761] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
In the present work we discuss a novel dynamic control approach for magnetically actuated robots, by proposing an adaptive control technique, robust towards parametric uncertainties and unknown bounded disturbances. The former generally arise due to partial knowledge of the robots' dynamic parameters, such as inertial factors, the latter are the outcome of unpredictable interaction with unstructured environments. In order to show the application of the proposed approach, we consider controlling the Magnetic Flexible Endoscope (MFE) which is composed of a soft-tethered Internal Permanent Magnet (IPM), actuated with a single External Permanent Magnet (EPM). We provide with experimental analysis to show the possibility of levitating the MFE - one of the most difficult tasks with this platform - in case of partial knowledge of the IPM's dynamics and no knowledge of the tether's behaviour. Experiments in an acrylic tube show a reduction of contact of the 32% compared to non-levitating techniques and 1.75 times faster task completion with respect to previously proposed levitating techniques. More realistic experiments, performed in a colon phantom, show that levitating the capsule achieves faster and smoother exploration and that the minimum time for completing the task is attained by the proposed approach.
Collapse
Affiliation(s)
- Lavinia Barducci
- STORM Lab UK, Institute of Robotics, Autonomous Systems and Sensing, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK
| | - Giovanni Pittiglio
- STORM Lab UK, Institute of Robotics, Autonomous Systems and Sensing, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK
| | - Joseph C Norton
- STORM Lab UK, Institute of Robotics, Autonomous Systems and Sensing, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK
| | - Keith L Obstein
- Division of Gastroenterology, Hepatology, and Nutrition, Vanderbilt University Medical Center, Nashville, TN, USA, and with the STORM Lab, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Pietro Valdastri
- STORM Lab UK, Institute of Robotics, Autonomous Systems and Sensing, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK
| |
Collapse
|
13
|
Manfredi L, Capoccia E, Ciuti G, Cuschieri A. A Soft Pneumatic Inchworm Double balloon (SPID) for colonoscopy. Sci Rep 2019; 9:11109. [PMID: 31367005 PMCID: PMC6668406 DOI: 10.1038/s41598-019-47320-3] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2019] [Accepted: 07/08/2019] [Indexed: 12/24/2022] Open
Abstract
The design of a smart robot for colonoscopy is challenging because of the limited available space, slippery internal surfaces, and tortuous 3D shape of the human colon. Locomotion forces applied by an endoscopic robot may damage the colonic wall and/or cause pain and discomfort to patients. This study reports a Soft Pneumatic Inchworm Double balloon (SPID) mini-robot for colonoscopy consisting of two balloons connected by a 3 degrees of freedom soft pneumatic actuator. SPID has an external diameter of 18 mm, a total length of 60 mm, and weighs 10 g. The balloons provide anchorage into the colonic wall for a bio-inspired inchworm locomotion. The proposed design reduces the pressure applied to the colonic wall and consequently pain and discomfort during the procedure. The mini-robot has been tested in a deformable plastic colon phantom of similar shape and dimensions to the human anatomy, exhibiting efficient locomotion by its ability to deform and negotiate flexures and bends. The mini-robot is made of elastomer and constructed from 3D printed components, hence with low production costs essential for a disposable device.
Collapse
Affiliation(s)
- Luigi Manfredi
- Institute for Medical Science and Technology (IMSaT), Division of Imaging and Technology, School of Medicine, University of Dundee, Dundee, DD2 1FD, UK.
| | - Elisabetta Capoccia
- Institute for Medical Science and Technology (IMSaT), Division of Imaging and Technology, School of Medicine, University of Dundee, Dundee, DD2 1FD, UK
| | - Gastone Ciuti
- The BioRobotics Institute, Scuola Superiore Sant'Anna, 56025, Pisa, Italy
| | - Alfred Cuschieri
- Institute for Medical Science and Technology (IMSaT), Division of Imaging and Technology, School of Medicine, University of Dundee, Dundee, DD2 1FD, UK
| |
Collapse
|
14
|
Bianchi F, Masaracchia A, Shojaei Barjuei E, Menciassi A, Arezzo A, Koulaouzidis A, Stoyanov D, Dario P, Ciuti G. Localization strategies for robotic endoscopic capsules: a review. Expert Rev Med Devices 2019; 16:381-403. [PMID: 31056968 DOI: 10.1080/17434440.2019.1608182] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/09/2023]
Affiliation(s)
- Federico Bianchi
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
| | | | | | | | - Alberto Arezzo
- Department of Surgical Sciences, University of Torino, Torino, Italy
| | | | - Danail Stoyanov
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS), University College London, London, UK
| | - Paolo Dario
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Gastone Ciuti
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
| |
Collapse
|
15
|
Scaglioni B, Previtera L, Martin J, Norton J, Obstein KL, Valdastri P. Explicit Model Predictive Control of a Magnetic Flexible Endoscope. IEEE Robot Autom Lett 2019; 4:716-723. [PMID: 30931392 PMCID: PMC6435294 DOI: 10.1109/lra.2019.2893418] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
In this paper, explicit model predictive control is applied in conjunction with nonlinear optimisation to a magnetically actuated flexible endoscope for the first time. The approach is aimed at computing the motion of the external permanent magnet, given the desired forces and torques. The strategy described here takes advantage of the nonlinear nature of the magnetic actuation and explicitly considers the workspace boundaries, as well as the actuation constraints. Initially, a simplified dynamic model of the tethered capsule, based on the Euler-Lagrange equations is developed. Subsequently, the explicit model predictive control is described and a novel approach for the external magnet positioning, based on a single step, nonlinear optimisation routine, is proposed. Finally, the strategy is implemented on the experimental platform, where bench-top trials are performed on a realistic colon phantom, showing the effectiveness of the technique. The work presented here constitutes an initial exploration for model-based control techniques applied to magnetically manipulated payloads, the techniques described here may be applied to a wide range of devices, including flexible endoscopes and wireless capsules. To our knowledge, this is the first example of advanced closed loop control of magnetic capsules.
Collapse
Affiliation(s)
- Bruno Scaglioni
- Storm Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK,{b.scaglioni,j.norton,p.valdastri}[at]leeds.ac.uk
| | | | - James Martin
- Storm Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK,{b.scaglioni,j.norton,p.valdastri}[at]leeds.ac.uk
| | - Joseph Norton
- Storm Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK,{b.scaglioni,j.norton,p.valdastri}[at]leeds.ac.uk
| | - Keith L Obstein
- Division of Gastroenterology, Vanderbilt University, Nashville TN, USA, keith.obstein[at]vumc.org
| | - Pietro Valdastri
- Storm Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK,{b.scaglioni,j.norton,p.valdastri}[at]leeds.ac.uk
| |
Collapse
|
16
|
Pittiglio G, Barducci L, Martin JW, Norton JC, Avizzano CA, Obstein KL, Valdastri P. Magnetic Levitation for Soft-Tethered Capsule Colonoscopy Actuated With a Single Permanent Magnet: A Dynamic Control Approach. IEEE Robot Autom Lett 2019; 4:1224-1231. [PMID: 31304240 DOI: 10.1109/lra.2019.2894907] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Abstract
The present letter investigates a novel control approach for magnetically driven soft-tethered capsules for colonoscopy-a potentially painless approach for colon inspection. The focus of this work is on a class of devices composed of a magnetic capsule endoscope actuated by a single external permanent magnet. Actuation is achieved by manipulating the external magnet with a serial manipulator, which in turn produces forces and torques on the internal magnetic capsule. We propose a control strategy which, counteracting gravity, achieves levitation of the capsule. This technique, based on a nonlinear backstepping approach, is able to limit contact with the colon walls, reducing friction, avoiding contact with internal folds, and facilitating the inspection of nonplanar cavities. The approach is validated on an experimental setup, which embodies a general scenario faced in colonoscopy. The experiments show that we can attain 19.5% of contact with the colon wall, compared to the almost 100% of previously proposed approaches. Moreover, we show that the control can be used to navigate the capsule through a more realistic environment-a colon phantom-with reasonable completion time.
Collapse
Affiliation(s)
- Giovanni Pittiglio
- STORM Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds LS2 9JT, U.K
| | - Lavinia Barducci
- STORM Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds LS2 9JT, U.K
| | - James W Martin
- STORM Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds LS2 9JT, U.K
| | - Joseph C Norton
- STORM Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds LS2 9JT, U.K
| | - Carlo A Avizzano
- Perceptual Robotics Laboratory, Scuola Superiore SantAnna, Pisa 56100, Italy
| | - Keith L Obstein
- Division of Gastroenterology, Hepatology, and Nutrition, Vanderbilt University Medical Center, Nashville, TN 37232 USA; STORM Lab, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| | - Pietro Valdastri
- STORM Lab UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds LS2 9JT, U.K
| |
Collapse
|
17
|
Steiger C, Abramson A, Nadeau P, Chandrakasan AP, Langer R, Traverso G. Ingestible electronics for diagnostics and therapy. NATURE REVIEWS MATERIALS 2018; 4:83-98. [DOI: 10.1038/s41578-018-0070-3] [Citation(s) in RCA: 86] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
|
18
|
Taddese AZ, Slawinski PR, Pirotta M, De Momi E, Obstein KL, Valdastri P. Enhanced Real-Time Pose Estimation for Closed-Loop Robotic Manipulation of Magnetically Actuated Capsule Endoscopes. Int J Rob Res 2018; 37:890-911. [PMID: 30150847 PMCID: PMC6108552 DOI: 10.1177/0278364918779132] [Citation(s) in RCA: 63] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Pose estimation methods for robotically guided magnetic actuation of capsule endoscopes have recently enabled trajectory following and automation of repetitive endoscopic maneuvers. However, these methods face significant challenges in their path to clinical adoption including the presence of regions of magnetic field singularity, where the accuracy of the system degrades, and the need for accurate initialization of the capsule's pose. In particular, the singularity problem exists for any pose estimation method that utilizes a single source of magnetic field if the method does not rely on the motion of the magnet to obtain multiple measurements from different vantage points. We analyze the workspace of such pose estimation methods with the use of the point-dipole magnetic field model and show that singular regions exist in areas where the capsule is nominally located during magnetic actuation. Since the dipole model can approximate most magnetic field sources, the problem discussed herein pertains to a wider set of pose estimation techniques. We then propose a novel hybrid approach employing static and time-varying magnetic field sources and show that this system has no regions of singularity. The proposed system was experimentally validated for accuracy, workspace size, update rate and performance in regions of magnetic singularity. The system performed as well or better than prior pose estimation methods without requiring accurate initialization and was robust to magnetic singularity. Experimental demonstration of closed-loop control of a tethered magnetic device utilizing the developed pose estimation technique is provided to ascertain its suitability for robotically guided capsule endoscopy. Hence, advances in closed-loop control and intelligent automation of magnetically actuated capsule endoscopes can be further pursued toward clinical realization by employing this pose estimation system.
Collapse
Affiliation(s)
- Addisu Z. Taddese
- Science and Technology of Robotics in Medicine (STORM) Laboratory USA, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Piotr R. Slawinski
- Science and Technology of Robotics in Medicine (STORM) Laboratory USA, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Marco Pirotta
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Elena De Momi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Milan, Italy
| | - Keith L. Obstein
- Science and Technology of Robotics in Medicine (STORM) Laboratory USA, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
- Division of Gastroenterology, Hepatology, and Nutrition, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Pietro Valdastri
- Science and Technology of Robotics in Medicine (STORM) Laboratory UK, School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK
| |
Collapse
|
19
|
Near-lossless energy-efficient image compression algorithm for wireless capsule endoscopy. Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2017.04.006] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
|
20
|
Mapara SS, Patravale VB. Medical capsule robots: A renaissance for diagnostics, drug delivery and surgical treatment. J Control Release 2017; 261:337-351. [PMID: 28694029 DOI: 10.1016/j.jconrel.2017.07.005] [Citation(s) in RCA: 28] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2017] [Revised: 07/04/2017] [Accepted: 07/05/2017] [Indexed: 12/11/2022]
Abstract
The advancements in electronics and the progress in nanotechnology have resulted in path breaking development that will transform the way diagnosis and treatment are carried out currently. This development is Medical Capsule Robots, which has emerged from the science fiction idea of robots travelling inside the body to diagnose and cure disorders. The first marketed capsule robot was a capsule endoscope developed to capture images of the gastrointestinal tract. Today, varieties of capsule endoscopes are available in the market. They are slightly larger than regular oral capsules, made up of a biocompatible case and have electronic circuitry and mechanisms to capture and transmit images. In addition, robots with diagnostic features such as in vivo body temperature detection and pH monitoring have also been launched in the market. However, a multi-functional unit that will diagnose and cure diseases inside the body has not yet been realized. A remote controlled capsule that will undertake drug delivery and surgical treatment has not been successfully launched in the market. High cost, inadequate power supply, lack of control over drug release, limited space for drug storage on the capsule, inadequate safety and no mechanisms for active locomotion and anchoring have prevented their entry in the market. The capsule robots can revolutionize the current way of diagnosis and treatment. This paper discusses in detail the applications of medical capsule robots in diagnostics, drug delivery and surgical treatment. In diagnostics, detailed analysis has been presented on wireless capsule endoscopes, issues associated with the marketed versions and their corresponding solutions in literature. Moreover, an assessment has been made of the existing state of remote controlled capsules for targeted drug delivery and surgical treatment and their future impact is predicted. Besides the need for multi-functional capsule robots and the areas for further research have also been highlighted.
Collapse
Affiliation(s)
- Sanyat S Mapara
- Department of Pharmaceutical Sciences and Technology, Institute of Chemical Technology, Nathalal Parekh Marg, Matunga East, Mumbai 400019, India
| | - Vandana B Patravale
- Department of Pharmaceutical Sciences and Technology, Institute of Chemical Technology, Nathalal Parekh Marg, Matunga East, Mumbai 400019, India.
| |
Collapse
|
21
|
Taddese AZ, Slawinski PR, Obstein KL, Valdastri P. Nonholonomic Closed-loop Velocity Control of a Soft-tethered Magnetic Capsule Endoscope. PROCEEDINGS OF THE ... IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS. IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS 2016; 2016:1139-1144. [PMID: 28316873 DOI: 10.1109/iros.2016.7759192] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
In this paper, we demonstrate velocity-level closed-loop control of a tethered magnetic capsule endoscope that is actuated via serial manipulator with a permanent magnet at its end-effector. Closed-loop control (2 degrees-of-freedom in position, and 2 in orientation) is made possible with the use of a real-time magnetic localization algorithm that utilizes the actuating magnetic field and thus does not require additional hardware. Velocity control is implemented to create smooth motion that is clinically necessary for colorectal cancer diagnostics. Our control algorithm generates a spline that passes through a set of input points that roughly defines the shape of the desired trajectory. The velocity controller acts in the tangential direction to the path, while a secondary position controller enforces a nonholonomic constraint on capsule motion. A soft nonholonomic constraint is naturally imposed by the lumen while we enforce a strict constraint for both more accurate estimation of tether disturbance and hypothesized intuitiveness for a clinician's teleoperation. An integrating disturbance force estimation control term is introduced to predict the disturbance of the tether. This paper presents the theoretical formulations and experimental validation of our methodology. Results show the system's ability to achieve a repeatable velocity step response with low steady-state error as well as ability of the tethered capsule to maneuver around a bend.
Collapse
Affiliation(s)
- Addisu Z Taddese
- Mechanical Engineering Department, Vanderbilt University, Nashville, TN, USA
| | - Piotr R Slawinski
- Mechanical Engineering Department, Vanderbilt University, Nashville, TN, USA
| | - Keith L Obstein
- Mechanical Engineering Department, Vanderbilt University, Nashville, TN, USA; Division of Gastroenterology, Hepatology, and Nutrition, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Pietro Valdastri
- School of Electronic and Electrical Engineering, University of Leeds, Leeds, UK; Mechanical Engineering Department, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
22
|
Yung DE, Rondonotti E, Koulaouzidis A. Review: capsule colonoscopy-a concise clinical overview of current status. ANNALS OF TRANSLATIONAL MEDICINE 2016; 4:398. [PMID: 27867950 DOI: 10.21037/atm.2016.10.71] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
The colon capsule endoscopy (CCE) was first introduced in 2007. Currently, the main clinical indications for CCE are completion of incomplete colonoscopy, polyp detection and investigation of inflammatory bowel disease (IBD). Although conventional colonoscopy is the gold standard in bowel cancer screening, incomplete colonoscopy remains a problem as lesions are missed. CCE compares favourably to computer tomography colonography (CTC) in adenoma detection and has therefore been proposed as a method for completing colonoscopy. However the data on CCE remains sparse and current evidence does not show its superiority over CTC or conventional colonoscopy in bowel cancer screening. CCE also seems to show good correlation with conventional colonoscopy when used to evaluate IBD, but there are not many published studies at present. Other significant limitations include the need for aggressive bowel preparation and the labour-intensiveness of CCE reading. Therefore, much further software and hardware development is required to enable CCE to fulfill its potential as a minimally-invasive and reliable method of colonoscopy.
Collapse
Affiliation(s)
- Diana E Yung
- Endoscopy Unit, the Royal Infirmary of Edinburgh, Edinburgh, UK
| | | | | |
Collapse
|
23
|
Colon Capsule Endoscopy: Review and Perspectives. Gastroenterol Res Pract 2016; 2016:9643162. [PMID: 27698664 PMCID: PMC5028851 DOI: 10.1155/2016/9643162] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2016] [Accepted: 08/16/2016] [Indexed: 02/08/2023] Open
Abstract
Colon capsule endoscopy utilizing PillCam COLON 2 capsule allows for visualization potentially of the entire colon and is currently approved for patients who cannot withstand the rigors of traditional optical colonoscopy (OC) and associated sedation as well as those that had an OC that was incomplete for technical reasons other than a poor preparation. We will then describe the prior experience and current status of colon capsule endoscopy.
Collapse
|
24
|
Ciuti G, Caliò R, Camboni D, Neri L, Bianchi F, Arezzo A, Koulaouzidis A, Schostek S, Stoyanov D, Oddo CM, Magnani B, Menciassi A, Morino M, Schurr MO, Dario P. Frontiers of robotic endoscopic capsules: a review. JOURNAL OF MICRO-BIO ROBOTICS 2016; 11:1-18. [PMID: 29082124 PMCID: PMC5646258 DOI: 10.1007/s12213-016-0087-x] [Citation(s) in RCA: 54] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2016] [Revised: 03/24/2016] [Accepted: 04/07/2016] [Indexed: 12/15/2022]
Abstract
Digestive diseases are a major burden for society and healthcare systems, and with an aging population, the importance of their effective management will become critical. Healthcare systems worldwide already struggle to insure quality and affordability of healthcare delivery and this will be a significant challenge in the midterm future. Wireless capsule endoscopy (WCE), introduced in 2000 by Given Imaging Ltd., is an example of disruptive technology and represents an attractive alternative to traditional diagnostic techniques. WCE overcomes conventional endoscopy enabling inspection of the digestive system without discomfort or the need for sedation. Thus, it has the advantage of encouraging patients to undergo gastrointestinal (GI) tract examinations and of facilitating mass screening programmes. With the integration of further capabilities based on microrobotics, e.g. active locomotion and embedded therapeutic modules, WCE could become the key-technology for GI diagnosis and treatment. This review presents a research update on WCE and describes the state-of-the-art of current endoscopic devices with a focus on research-oriented robotic capsule endoscopes enabled by microsystem technologies. The article also presents a visionary perspective on WCE potential for screening, diagnostic and therapeutic endoscopic procedures.
Collapse
Affiliation(s)
- Gastone Ciuti
- The BioRobotics Institute of Scuola Superiore Sant'Anna, Pontedera, Pisa 56025 Italy
| | - R Caliò
- The BioRobotics Institute of Scuola Superiore Sant'Anna, Pontedera, Pisa 56025 Italy
| | - D Camboni
- The BioRobotics Institute of Scuola Superiore Sant'Anna, Pontedera, Pisa 56025 Italy
| | - L Neri
- The BioRobotics Institute of Scuola Superiore Sant'Anna, Pontedera, Pisa 56025 Italy.,Ekymed S.r.l., Livorno, Italy
| | - F Bianchi
- The BioRobotics Institute of Scuola Superiore Sant'Anna, Pontedera, Pisa 56025 Italy
| | - A Arezzo
- Department of Surgical Disciplines, University of Torino, Torino, Italy
| | - A Koulaouzidis
- Endoscopy Unit, The Royal Infirmary of Edinburgh, Edinburgh, Scotland, UK
| | | | - D Stoyanov
- Centre for Medical Image Computing and the Department of Computer Science, University College London, London, UK
| | - C M Oddo
- The BioRobotics Institute of Scuola Superiore Sant'Anna, Pontedera, Pisa 56025 Italy
| | | | - A Menciassi
- The BioRobotics Institute of Scuola Superiore Sant'Anna, Pontedera, Pisa 56025 Italy
| | - M Morino
- Department of Surgical Disciplines, University of Torino, Torino, Italy
| | - M O Schurr
- Ovesco Endoscopy AG, Tübingen, Germany.,Steinbeis University Berlin, Berlin, Germany
| | - P Dario
- The BioRobotics Institute of Scuola Superiore Sant'Anna, Pontedera, Pisa 56025 Italy
| |
Collapse
|
25
|
Leong F, Garbin N, Natali CD, Mohammadi A, Thiruchelvam D, Oetomo D, Valdastri P. Magnetic Surgical Instruments for Robotic Abdominal Surgery. IEEE Rev Biomed Eng 2016; 9:66-78. [PMID: 26829803 DOI: 10.1109/rbme.2016.2521818] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This review looks at the implementation of magnetic-based approaches in surgical instruments for abdominal surgeries. As abdominal surgical techniques advance toward minimizing surgical trauma, surgical instruments are enhanced to support such an objective through the exploration of magnetic-based systems. With this design approach, surgical devices are given the capabilities to be fully inserted intraabdominally to achieve access to all abdominal quadrants, without the conventional rigid link connection with the external unit. The variety of intraabdominal surgical devices are anchored, guided, and actuated by external units, with power and torque transmitted across the abdominal wall through magnetic linkage. This addresses many constraints encountered by conventional laparoscopic tools, such as loss of triangulation, fulcrum effect, and loss/lack of dexterity for surgical tasks. Design requirements of clinical considerations to aid the successful development of magnetic surgical instruments, are also discussed.
Collapse
|
26
|
Slawinski PR, Obstein KL, Valdastri P. Capsule endoscopy of the future: What's on the horizon? World J Gastroenterol 2015; 21:10528-41. [PMID: 26457013 PMCID: PMC4588075 DOI: 10.3748/wjg.v21.i37.10528] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/27/2015] [Revised: 06/22/2015] [Accepted: 08/31/2015] [Indexed: 02/06/2023] Open
Abstract
Capsule endoscopes have evolved from passively moving diagnostic devices to actively moving systems with potential therapeutic capability. In this review, we will discuss the state of the art, define the current shortcomings of capsule endoscopy, and address research areas that aim to overcome said shortcomings. Developments in capsule mobility schemes are emphasized in this text, with magnetic actuation being the most promising endeavor. Research groups are working to integrate sensor data and fuse it with robotic control to outperform today's standard invasive procedures, but in a less intrusive manner. With recent advances in areas such as mobility, drug delivery, and therapeutics, we foresee a translation of interventional capsule technology from the bench-top to the clinical setting within the next 10 years.
Collapse
|
27
|
Inductive-Based Wireless Power Recharging System for an Innovative Endoscopic Capsule. ENERGIES 2015. [DOI: 10.3390/en80910315] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
28
|
Than TD, Alici G, Harvey S, Zhou H, Li W. Concept and simulation study of a novel localization method for robotic endoscopic capsules using multiple positron emission markers. Med Phys 2015; 41:072501. [PMID: 24989404 DOI: 10.1118/1.4881316] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
PURPOSE Over the last decade, wireless capsule endoscope has been the tool of choice for noninvasive inspection of the gastrointestinal tract, especially in the small intestine. However, the latest clinical products have not been equipped with a sufficiently accurate localization system which makes it difficult to determine the location of intestinal abnormalities, and to apply follow-up interventions such as biopsy or drug delivery. In this paper, the authors present a novel localization method based on tracking three positron emission markers embedded inside an endoscopic capsule. METHODS Three spherical(22)Na markers with diameters of less than 1 mm are embedded in the cover of the capsule. Gamma ray detectors are arranged around a patient body to detect coincidence gamma rays emitted from the three markers. The position of each marker can then be estimated using the collected data by the authors' tracking algorithm which consists of four consecutive steps: a method to remove corrupted data, an initialization method, a clustering method based on the Fuzzy C-means clustering algorithm, and a failure prediction method. RESULTS The tracking algorithm has been implemented inMATLAB utilizing simulation data generated from the Geant4 Application for Emission Tomography toolkit. The results show that this localization method can achieve real-time tracking with an average position error of less than 0.4 mm and an average orientation error of less than 2°. CONCLUSIONS The authors conclude that this study has proven the feasibility and potential of the proposed technique in effectively determining the position and orientation of a robotic endoscopic capsule.
Collapse
Affiliation(s)
- Trung Duc Than
- School of Mechanical, Materials and Mechatronic Engineering, University of Wollongong, New South Wales 2522, Australia
| | - Gursel Alici
- School of Mechanical, Materials and Mechatronic Engineering, University of Wollongong, New South Wales 2522, Australia
| | - Steven Harvey
- Department of Nuclear Medicine, Wollongong Hospital, New South Wales 2500, Australia
| | - Hao Zhou
- School of Mechanical, Materials and Mechatronic Engineering, University of Wollongong, New South Wales 2522, Australia
| | - Weihua Li
- School of Mechanical, Materials and Mechatronic Engineering, University of Wollongong, New South Wales 2522, Australia
| |
Collapse
|
29
|
Mahoney AW, Abbott JJ. Five-degree-of-freedom manipulation of an untethered magnetic device in fluid using a single permanent magnet with application in stomach capsule endoscopy. Int J Rob Res 2015. [DOI: 10.1177/0278364914558006] [Citation(s) in RCA: 134] [Impact Index Per Article: 13.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
Abstract
This paper demonstrates magnetic three-degree-of-freedom (3-DOF) closed-loop position and 2-DOF open-loop orientation control of a mockup magnetic capsule endoscope in fluid with a single permanent magnet positioned by a commercial 6-DOF robotic manipulator, using feedback of only the 3-DOF capsule position measured by a localization system, with application in capsule endoscopy of a fluid-distended stomach. We analyze the kinematics of magnetic manipulation using a single permanent magnet as the end-effector of a serial-link robot manipulator, and we formulate a control method that enables the capsule’s position and direction to be controlled when the robot manipulator is not in a kinematic singularity, and that sacrifices control over the capsule’s direction to maintain control over the capsule’s position when the manipulator enters a singularity. We demonstrate the method’s robustness to a reduced control rate of 25 Hz, reduced localization rates down to 30 Hz, deviation in the applied magnetic field from that expected, and the presence of manipulator singularities. Five-DOF manipulation of an untethered magnetic device has been previously demonstrated by electromagnetic systems only.
Collapse
Affiliation(s)
| | - Jake J. Abbott
- Department of Mechanical Engineering,
University of Utah, USA
| |
Collapse
|
30
|
Slawinski PR, Obstein KL, Valdastri P. Emerging Issues and Future Developments in Capsule Endoscopy. TECHNIQUES IN GASTROINTESTINAL ENDOSCOPY 2015; 17:40-46. [PMID: 26028956 PMCID: PMC4445887 DOI: 10.1016/j.tgie.2015.02.006] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Capsule endoscopy (CE) has transformed from a research venture into a widely used clinical tool and the primary means for diagnosing small bowel pathology. These orally administered capsules traverse passively through the gastrointestinal tract via peristalsis and are used in the esophagus, stomach, small bowel, and colon. The primary focus of CE research in recent years has been enabling active CE manipulation and extension of the technology to therapeutic functionality; thus, widening the scope of the procedure. This review outlines clinical standards of the technology as well as recent advances in CE research. Clinical capsule applications are discussed with respect to each portion of the gastrointestinal tract. Promising research efforts are presented with an emphasis on enabling active capsule locomotion. The presented studies suggest, in particular, that the most viable solution for active capsule manipulation is actuation of a capsule via exterior permanent magnet held by a robot. Developing capsule procedures adhering to current healthcare standards, such as enabling a tool channel or irrigation in a therapeutic device, is a vital phase in the adaptation of CE in the clinical setting.
Collapse
Affiliation(s)
- Piotr R. Slawinski
- STORM Lab, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235-1592, USA
| | - Keith L. Obstein
- STORM Lab, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235-1592, USA
- Division of Gastroenterology, Hepatology, and Nutrition, Vanderbilt University Medical Center, Nashville, TN 37235-1592, USA
| | - Pietro Valdastri
- STORM Lab, Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235-1592, USA
- Division of Gastroenterology, Hepatology, and Nutrition, Vanderbilt University Medical Center, Nashville, TN 37235-1592, USA
| |
Collapse
|
31
|
Abstract
Practitioners of endoscopy often experience musculoskeletal pain and injury (most often in the back, neck, shoulders, hands, wrists, and thumbs) that are associated with the minute and repetitive strain that is placed on these areas during endoscopic procedures. This review of the current documentation of endoscopy-related pain and injuries among practitioners finds that such problems are widespread and specific in kind as well as strongly correlated with high procedure volume and procedure duration. Research on the nature and impact of cumulative trauma and overuse syndromes in other professions such as dentistry, pianists, production labor, and athletics is brought to bear on the work of the endoscopist. A more thorough understanding of the nature and prevalence of work-related pain and injury sustained by endoscopists should inform further development of ergonomic practices and equipment design. This article reviews current recommendations for ergonomic design in the endoscopy procedure space and finds that reported compliance with those recommendations is quite low. Strategies for the management of the risk of musculoskeletal injuries related to the practice of endoscopy include compliance with currently recommended ergonomic practices, education of trainees in ergonomic technique when practicing endoscopy, and research toward the modification and development of more ergonomic endoscopes and procedure spaces.
Collapse
|
32
|
Pourghodrat A, Dehghani H, Nelson CA, Oleynikov D, Dasgupta P, Terry BS. Disposable Fluidic Self-Propelling Robot for Colonoscopy. J Med Device 2014. [DOI: 10.1115/1.4027076] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/16/2023] Open
Affiliation(s)
- Abolfazl Pourghodrat
- Department of Mechanical and Materials Engineering, University of Nebraska-Lincoln, Lincoln, NE 68588
| | - Hossein Dehghani
- Department of Mechanical and Materials Engineering, University of Nebraska-Lincoln, Lincoln, NE 68588
| | - Carl A. Nelson
- Department of Mechanical and Materials Engineering, University of Nebraska-Lincoln, Lincoln, NE 68588
- UNMC Center for Advanced Surgical Technology (CAST), University of Nebraska Medical Center, Omaha, NE 68198
| | - Dmitry Oleynikov
- UNMC Center for Advanced Surgical Technology (CAST), University of Nebraska Medical Center, Omaha, NE 68198
| | - Prithviraj Dasgupta
- Computer Science Department, University of Nebraska at Omaha, Omaha, NE 68182
| | - Benjamin S. Terry
- Department of Mechanical and Materials Engineering, University of Nebraska-Lincoln, Lincoln, NE 68588
- UNMC Center for Advanced Surgical Technology (CAST), University of Nebraska Medical Center, Omaha, NE 68198
| |
Collapse
|
33
|
Valdastri P, Ciuti G, Verbeni A, Menciassi A, Dario P, Arezzo A, Morino M. Magnetic air capsule robotic system: proof of concept of a novel approach for painless colonoscopy. Surg Endosc 2011; 26:1238-46. [PMID: 22179445 DOI: 10.1007/s00464-011-2054-x] [Citation(s) in RCA: 53] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2011] [Accepted: 10/27/2011] [Indexed: 12/11/2022]
Abstract
BACKGROUND Despite being considered the most effective method for colorectal cancer diagnosis, colonoscopy take-up as a mass-screening procedure is limited mainly due to invasiveness, patient discomfort, fear of pain, and the need for sedation. In an effort to mitigate some of the disadvantages associated with colonoscopy, this work provides a preliminary assessment of a novel endoscopic device consisting in a softly tethered capsule for painless colonoscopy under robotic magnetic steering. METHODS The proposed platform consists of the endoscopic device, a robotic unit, and a control box. In contrast to the traditional insertion method (i.e., pushing from behind), a "front-wheel" propulsion approach is proposed. A compliant tether connecting the device to an external box is used to provide insufflation, passing a flexible operative tool, enabling lens cleaning, and operating the vision module. To assess the diagnostic and treatment ability of the platform, 12 users were asked to find and remove artificially implanted beads as polyp surrogates in an ex vivo model. In vivo testing consisted of a qualitative study of the platform in pigs, focusing on active locomotion, diagnostic and therapeutic capabilities, safety, and usability. RESULTS The mean percentage of beads identified by each user during ex vivo trials was 85 ± 11%. All the identified beads were removed successfully using the polypectomy loop. The mean completion time for accomplishing the entire procedure was 678 ± 179 s. No immediate mucosal damage, acute complications such as perforation, or delayed adverse consequences were observed following application of the proposed method in vivo. CONCLUSIONS Use of the proposed platform in ex vivo and preliminary animal studies indicates that it is safe and operates effectively in a manner similar to a standard colonoscope. These studies served to demonstrate the platform's added advantages of reduced size, front-wheel drive strategy, and robotic control over locomotion and orientation.
Collapse
Affiliation(s)
- P Valdastri
- STORM Lab, Mechanical Engineering Department, Vanderbilt University, 2301 Vanderbilt Place PMB 351592, Nashville, TN 37235-1592, USA.
| | | | | | | | | | | | | |
Collapse
|