Skip to content
  • Our Work
    • Fields
      • Cardiology
      • ENT
      • Gastro
      • Orthopedics
      • Ophthalmology
      • Pulmonology
      • Surgical
      • Urology
      • Other
    • Modalities
      • Endoscopy
      • Medical Segmentation
      • Microscopy
      • Ultrasound
  • Success Stories
  • Insights
    • Magazine
    • Events and Webinars
    • News
    • Blog
  • The company
    • About us
    • Careers
Menu
  • Our Work
    • Fields
      • Cardiology
      • ENT
      • Gastro
      • Orthopedics
      • Ophthalmology
      • Pulmonology
      • Surgical
      • Urology
      • Other
    • Modalities
      • Endoscopy
      • Medical Segmentation
      • Microscopy
      • Ultrasound
  • Success Stories
  • Insights
    • Magazine
    • Events and Webinars
    • News
    • Blog
  • The company
    • About us
    • Careers
Contact

Surgical Instrument Segmentation

Using computer vision to identify tools being employed at different stages of a procedure is not only another step toward robotic surgery, it’s a simple, yet very useful tool to streamline and safeguard the surgical process.

Surgical instrument (tool) segmentation and classification is a computer vision algorithm that complements workflow analysis. It automatically detects and identifies tools used during the procedure, and assess whether they are used by the surgeon correctly.

Endoscopy - Instrument Segmentation

For example, it can detect the position of a tool relative to a target tissue, a lesion or growth, and using closed loop instrument control, direct the movement of the instrument. When combined with Surgical Workflow Analysis solutions, it will also alert if a wrong instrument is being used.

Tool segmentation with Deep Learning

In a manner similar to any type of image segmentation problem seen in deep learning, the goal of instrument segmentation is to paint image pixels belonging to surgical instruments. One of the most popular convolutional neural network architectures used for medical image segmentation problems is U-Net, which is also used extensively for instrument segmentation.

Ideally, surgical instrument segmentation will be used in real time, to identify tools being used as a surgery is being performed. In order to achieve this, neural networks need to be supplemented with additional routines optimized for speed.

The other challenge is being able to differentiate one tool from another by classifying and identifying each one. This is usually achieved by adding additional classes to segmentation neural networks, for example U-Net, and training the network accordingly.

While instrument segmentation based on a single frame achieves good results, a more robust solution is to combine instrument segmentations with workflow analysis. Identifying the tools from a given frame may be inaccurate, but by analyzing several consecutive frames, the accuracy improves. A result in one frame, should correlate with what we see in the subsequent one. Recurrent neural networks or Long Short-Term Memory (LSTM) networks can also be used to supplement convolutional neural networks and achieve better results.

Daniel Tomer, Algorithm Team Leader at RSIP Vision adds “A major challenge in tool segmentation, and in tool recognition in general, is finding a way to quickly train the model so it is able to recognize new tools. To tackle this challenge, we at RSIP Vision, develop for our customers advanced augmentations techniques which are able to generate synthetic data of any given tool and re-train the model using that data. In this way, adding a new ability to the model does not involve tedious and time-consuming data labeling.”

Share

Share on linkedin
Share on twitter
Share on facebook

Main Field

Endoscopy

AI in Endoscopy is a new field, utilizing innovative AI technologies to enhance the accuracy of Endoscopy imaging and provide better detection and clinical outcomes. RSIP Vision is a pioneer in the field of artificial intelligence for endoscopy imaging. Thanks to our deep learning solutions, radiologists and physicians obtain much more information than before from endoscopy images for both detection of diseases and measurement of therapy progress effectiveness. We have successfully completed a large number of important R&D projects for all kind of minimally invasive procedures. Contact us and discuss your project with our experts!

View Endoscopy

Categories

  • Endoscopy, RSIP Vision Learns

Related Content

Healthy gut - 3D Rendering

Real time SLAM in Endoscopy Applications

Intravenous OCT

Endoscopic Procedures using Intravenous OCT

Intravenous Ultrasound

Using AI to Analyse Intravenous Ultrasound Images

Surgical Workflow Analysis

AI-based Surgical Workflow Analysis, another big step towards the future of robotic surgery

Healthy gut - 3D Rendering

Real time SLAM in Endoscopy Applications

Intravenous OCT

Endoscopic Procedures using Intravenous OCT

Intravenous Ultrasound

Using AI to Analyse Intravenous Ultrasound Images

Surgical Workflow Analysis

AI-based Surgical Workflow Analysis, another big step towards the future of robotic surgery

Show all

RSIP Vision

Field-tested software solutions and custom R&D, to power your next medical products with innovative AI and image analysis capabilities.

Read more about us

Get in touch

Please fill the following form and our experts will be happy to reply to you soon

Recent News

Announcement – XPlan.ai Confirms Premier Precision in Peer-Reviewed Clinical Study of its 2D-to-3D Knee Reconstruction Solution

IBD Scoring – Clario, GI Reviewers and RSIP Vision Team Up

RSIP Neph Announces a Revolutionary Intra-op Solution for Partial Nephrectomy Surgeries

Announcement – XPlan.ai by RSIP Vision Presents Successful Preliminary Results from Clinical Study of it’s XPlan 2D-to-3D Knee Bones Reconstruction

All news
Upcoming Events
Stay informed for our next events
Subscribe to Our Magazines

Subscribe now and receive the Computer Vision News Magazine every month to your mailbox

 
Subscribe for free
Follow us
Linkedin Twitter Facebook Youtube

contact@rsipvision.com

Terms of Use

Privacy Policy

© All rights reserved to RSIP Vision 2023

Created by Shmulik

  • Our Work
    • title-1
      • Ophthalmology
      • Uncategorized
      • Ophthalmology
      • Pulmonology
      • Cardiology
      • Orthopedics
    • Title-2
      • Orthopedics
  • Success Stories
  • Insights
  • The company