Skip to content
  • Our Work
    • Fields
      • Cardiology
      • ENT
      • Gastro
      • Orthopedics
      • Ophthalmology
      • Pulmonology
      • Surgical
      • Urology
      • Other
    • Modalities
      • Endoscopy
      • Medical Segmentation
      • Microscopy
      • Ultrasound
  • Success Stories
  • Insights
    • Magazine
    • Upcoming Events
    • Webinars
    • Meetups
    • News
    • Blog
  • The company
    • About us
    • Careers
Menu
  • Our Work
    • Fields
      • Cardiology
      • ENT
      • Gastro
      • Orthopedics
      • Ophthalmology
      • Pulmonology
      • Surgical
      • Urology
      • Other
    • Modalities
      • Endoscopy
      • Medical Segmentation
      • Microscopy
      • Ultrasound
  • Success Stories
  • Insights
    • Magazine
    • Upcoming Events
    • Webinars
    • Meetups
    • News
    • Blog
  • The company
    • About us
    • Careers
Contact

Real time SLAM in Endoscopy Applications

Robotic surgery requires extreme precision due to its small scale and the vulnerable organs such procedures usually target. To be able to get this precision many devices use magnetic or radio based external sensors in order to calculate the endoscope location in the patient’s body.

Healthy gut - 3D Rendering

However, using this approach is prone to errors, hard to introduce to devices that rely solely on internal sensors and can significantly increase the manufacturing price of the devices.

SLAM in Endoscopy Applications

In the past few years there has been a breakthrough in the field of 3D localization using inputs as simple as a video stream. A family of algorithms called simultaneous localization and mapping (SLAM) are able, in real time, to create a 3D map of a scene captured by a camera and calculate with very high accuracy the location of the camera in the scene.
The algorithm workflow is as follows: first it finds the key interest points in the images received from a video stream. Those key points could be calculated on specific parts of the image with unique features using methods like SIFT or ORB.  Then for each new frame the algorithm tries to match each of the new key points to the already detected keypoints. When enough key points are found and matched the algorithm tries to solve the following optimization problem, what arrangement of cameras and key points locations in a 3D space would allow each matched keypoint to appear in the correct location in all the frames it was seen in. Once enough key points get added to the the 3D model, some variations of the algorithm can complete the cloud of keypoints into a 3D mesh depicting with high accuracy the scene the video feed is showing. After the scene is initialized, we can use the key points from new frames to triangulate the location of the new frame in the scene.
That being said, there are variations of the SLAM algorithm. Some try to place each pixel in the 3D model as opposed to only the key points. Other variations use a pre-processed image and not the original one i.e a black and white version of the image, a single channel – in endoscopy usually the red one because you can see the veins more clearly or any pre-process that would assist the feature detector to find better key points.
There are multiple benefits for using these algorithms in endoscopy. For example, one can use the map created by the algorithms together with the location of the device to help surgeons orient themselves in the patient’s body and even assist with navigation. The 3D model can by itself be very useful even without using the localization, a use case might be measuring dimensions of any object that is filmed from enough angles.

Why SLAM in Endoscopy

Most of the SLAM algorithms that are being researched target outdoor scenes which allow to rely heavily on high variation in depth. Another key feature of outdoor scenes is the rigidity of the objects presented in them. Those two traits are lacking in images depicting endoscopic surgeries. To overcome these obstacles, we have tailor-made custom SLAM algorithms that use state of the art deep learning models that extracts additional information on the image and prior knowledge on the real-life topography of the human body.
Adding information about the real depth of the scene and what the topography of the scene really is allow for the optimization problem to converge into a more accurate and reliable 3D model. These algorithms are able to create a precise 3D model of the endoscope environment and calculate the exact location of the endoscope in that model.
Using these types of algorithms allow for both an easy introduction of location tracking in devices that use only internal sensors, or allow for error detection and correction in systems that use external sensors for localization in order to improve accuracy and add additional information about the device surrounding.

Share

Share on linkedin
Share on twitter
Share on facebook

Main Field

Endoscopy

AI in Endoscopy is a new field, utilizing innovative AI technologies to enhance the accuracy of Endoscopy imaging and provide better detection and clinical outcomes. RSIP Vision is a pioneer in the field of artificial intelligence for endoscopy imaging. Thanks to our deep learning solutions, radiologists and physicians obtain much more information than before from endoscopy images for both detection of diseases and measurement of therapy progress effectiveness. We have successfully completed a large number of important R&D projects for all kind of minimally invasive procedures. Contact us and discuss your project with our experts!

View Endoscopy

Categories

  • Endoscopy, RSIP Vision Learns

Related Content

Intravenous OCT

Endoscopic Procedures using Intravenous OCT

Intravenous Ultrasound

Using AI to Analyse Intravenous Ultrasound Images

Surgical Instrument Segmentation

Surgical Workflow Analysis

AI-based Surgical Workflow Analysis, another big step towards the future of robotic surgery

Intravenous OCT

Endoscopic Procedures using Intravenous OCT

Intravenous Ultrasound

Using AI to Analyse Intravenous Ultrasound Images

Surgical Instrument Segmentation

Surgical Workflow Analysis

AI-based Surgical Workflow Analysis, another big step towards the future of robotic surgery

Show all

RSIP Vision

Field-tested software solutions and custom R&D, to power your next medical products with innovative AI and image analysis capabilities.

Read more about us

Get in touch

Please fill the following form and our experts will be happy to reply to you soon

Recent News

IBD Scoring – Clario, GI Reviewers and RSIP Vision Team Up

RSIP Neph Announces a Revolutionary Intra-op Solution for Partial Nephrectomy Surgeries

Announcement – RSIP Vision Presents Successful Preliminary Results from Clinical Study of 2D-to-3D Knee Bones Reconstruction

Announcement – New Urological AI Tool for 3D Reconstruction of the Ureter

All news
Upcoming Events
Stay informed for our next events
Subscribe to Our Magazines

Subscribe now and receive the Computer Vision News Magazine every month to your mailbox

 
Subscribe for free
Follow us
Linkedin Twitter Facebook Youtube

contact@rsipvision.com

Terms of Use

Privacy Policy

© All rights reserved to RSIP Vision 2023

Created by Shmulik

  • Our Work
    • title-1
      • Ophthalmology
      • Uncategorized
      • Ophthalmology
      • Pulmonology
      • Cardiology
      • Orthopedics
    • Title-2
      • Orthopedics
  • Success Stories
  • Insights
  • The company