Skip to content
  • Our Work
    • Fields
      • Cardiology
      • ENT
      • Gastro
      • Orthopedics
      • Ophthalmology
      • Pulmonology
      • Surgical
      • Urology
      • Other
    • Modalities
      • Endoscopy
      • Medical Segmentation
      • Microscopy
      • Ultrasound
  • Success Stories
  • Insights
    • Magazine
    • Upcoming Events
    • Webinars
    • Meetups
    • News
    • Blog
  • The company
    • About us
    • Careers
Menu
  • Our Work
    • Fields
      • Cardiology
      • ENT
      • Gastro
      • Orthopedics
      • Ophthalmology
      • Pulmonology
      • Surgical
      • Urology
      • Other
    • Modalities
      • Endoscopy
      • Medical Segmentation
      • Microscopy
      • Ultrasound
  • Success Stories
  • Insights
    • Magazine
    • Upcoming Events
    • Webinars
    • Meetups
    • News
    • Blog
  • The company
    • About us
    • Careers
Contact

3D surface reconstruction from single depth view

The advances in the manufacturing of depth sensors and camera technologies, such as LIDAR and RealSense cameras, have brought three-dimensional (3D) applications to the front stage in nearly all domains of the industry. Reconstructed 3D surfaces from multiple images appear in applications ranging from recreational, such as construction of realistic game avatars, to industrial, such as robotic assisted micro surgery as well as biometric measurements in medicine and security. The recovery of a 3D surface from depth information remains a long standing difficult problem in computer vision, one for which no off-the-shelf solution yet exists for objects found in natural scenes. Difficulties in surface reconstruction stem primarily from missing information caused by self-occlusion of complex, non-convex objects, but also emanate from variation in noise levels and illumination.

Facial recognition with 3D

Hardware for three-dimensional surface reconstruction

Depth cameras are equipped with two or more light sensors placed at a small distance apart, and an optional infrared projector. The depth in a scene is computed by triangulation, incorporating the principles of stereo vision. The output depth image provides the distance of all objects in the scene from the sensors’ axis. Commercial depth cameras now offers depth information ranging from 0.2 to 10 m, and provide a much richer data than that of a simple light camera. For real-time depth acquisition, the sensor can be thought of as a scanner, one for which a reliable acquisition of a surface depends on the user’s ability to scan all of its obscured corners. In contrast, when a single depth image is acquired, the problem of surface hole-filling becomes a difficult one. Self-occlusion in complex, non-convex, 3-dimensional objects cannot be reconstructed with accuracy and the missing information needs to be interpolated by algorithmic means.

 

Solutions for three-dimensional surface reconstruction

Surface reconstruction is a challenging problem, and over the years many solution have been suggested, using methodologies from computer vision and machine learning to complete these missing data. The most straightforward approach utilizes surface interpolation, which gives an inaccurate solution for large gaps in the surface. Other methodologies involve the well-known Poisson surface reconstruction, which requires a dense point cloud of orientation vectors to perform well. Despite this limitation, the Poisson surface reconstruction can be used as a framework to reconstruct surfaces for uniform and non-uniform sampling, a situation which is frequently encountered in natural depth acquisition. In the heart of the algorithm lies a minimization process, which attempts to recover a smooth gradient map from the projected point cloud acquired using the depth sensor.

The ripening domain of machine learning provides alternative means to the Poisson surface reconstruction and it enables to simulate empirical expert knowledge in hole-filling. These methods learn the rules of smooth completion of holes, incorporating knowledge of the observed point cloud. One of the most common pipeline for such learning is one for which the depth image (the so-called 2.5D image) is first encoded using 3D primitives (simple spatial shapes) and it reduces the problem surface completion problem into a lower dimensional space, in which constraints on the smoothness of the reconstructed surface can be fulfilled. The completed space is then decoded back to recover the original scene, only this time with holes filled by a primitive shape, or a combination thereof, to the original scene.

At RSIP Vision we tackle the hard problems in computer vision utilizing state-of-the-art tailor-made solutions for our clients. Our engineers stand in the front line of technology to bring our customers the best, most effective and accurate solution to their projects’ needs. To learn more about RSIP Vision’s activities over the past decades, please visit our projects page. To follow the latest trends in computer vision worldwide, subscribe for free to our monthly magazine, Computer Vision News.

Share

Share on linkedin
Share on twitter
Share on facebook

Related Content

Automated IBD Scoring

IBD Scoring – Clario, GI Reviewers and RSIP Vision Team Up

Soft Tissues Tracking during Brain Surgery

Soft Tissue Tracking during Brain Surgeries

Next Generation Intra-op Navigation

Neph - Partial Nephrectomy surgery

RSIP Neph Announces a Revolutionary Intra-op Solution for Partial Nephrectomy Surgeries

Benign Prostatic Hyperplasia BPH

AI for Benign Prostatic Hyperplasia BPH

Single-port

How Can AI Assist in Single-port Robotic Surgery?

Automated IBD Scoring

IBD Scoring – Clario, GI Reviewers and RSIP Vision Team Up

Soft Tissues Tracking during Brain Surgery

Soft Tissue Tracking during Brain Surgeries

Next Generation Intra-op Navigation

Neph - Partial Nephrectomy surgery

RSIP Neph Announces a Revolutionary Intra-op Solution for Partial Nephrectomy Surgeries

Benign Prostatic Hyperplasia BPH

AI for Benign Prostatic Hyperplasia BPH

Single-port

How Can AI Assist in Single-port Robotic Surgery?

Show all

RSIP Vision

Field-tested software solutions and custom R&D, to power your next medical products with innovative AI and image analysis capabilities.

Read more about us

Get in touch

Please fill the following form and our experts will be happy to reply to you soon

Recent News

IBD Scoring – Clario, GI Reviewers and RSIP Vision Team Up

RSIP Neph Announces a Revolutionary Intra-op Solution for Partial Nephrectomy Surgeries

Announcement – RSIP Vision Presents Successful Preliminary Results from Clinical Study of 2D-to-3D Knee Bones Reconstruction

Announcement – New Urological AI Tool for 3D Reconstruction of the Ureter

All news
Upcoming Events
Stay informed for our next events
Subscribe to Our Magazines

Subscribe now and receive the Computer Vision News Magazine every month to your mailbox

 
Subscribe for free
Follow us
Linkedin Twitter Facebook Youtube

contact@rsipvision.com

Terms of Use

Privacy Policy

© All rights reserved to RSIP Vision 2023

Created by Shmulik

  • Our Work
    • title-1
      • Ophthalmology
      • Uncategorized
      • Ophthalmology
      • Pulmonology
      • Cardiology
      • Orthopedics
    • Title-2
      • Orthopedics
  • Success Stories
  • Insights
  • The company