Computer Vision News - December 2023

39 Computer Vision News In Breamy's AR feature, the surgeon selects photographs that are most likely to represent the patient’s surgical outcome. These are mapped onto a 3D model, allowing patients and surgeons to see treatment options in realtime. We developed 2 ways of using AR: Marker-based method ​where the 3D breast model is projected upon detection of an AR marker (a QR code). We envision this could be used when the patient is wearing clothing for example in the surgeon’s office. Second, we have a markerless method where we detect the patient’s breasts directly by using a “guideview” (an outline of the patient’s breast 3D model). The patient uses the camera of their phone and adjusts their device until the guideline fits their breasts. This initiates body tracking and enables visualization of different projected surgical models on them. Watch here. Breamy - AR Mobile App To assess the perceived usefulness of Breamy, we surveyed 166 people including breast cancer patients, high risk individuals, and average risk women. Around 80% of the respondents expressed their willingness to use Breamy to view different surgical treatment options projected onto their bodies if they had to make a decision about their own breast surgery treatment. These initial findings show that using AR for breast cancer patients can improve understanding and assist in making better decisions. This may result in fewer revision surgeries, less regret, and improved overall patient well-being. Breamy aims to enhance patient education and help survivors feel confident about their bodies.

RkJQdWJsaXNoZXIy NTc3NzU=