Endoscopic surgery requires the highest level of reliability for its instruments, including the camera and the software, but in rare cases, bugs can occur that disrupt the surgeon’s view of the body part in operation. Our team has created an application that can automatically detect and classify when such an error has occurred, video capture the error, and save it for post-procedure viewing. Engineers can then view the error to figure out what might have caused it.


Our application uses specialized image and video processing techniques to classify different categories of errors, such as green screen, lag, or screen tearing. At the moment that an error occurs, it will record the screen that the surgeon is viewing, as well as save the system information at the time of occurrence. The application can process both live and recorded videos, depending on whether it is used during the surgery, or on a video which was recorded during the surgery.