Software Engineer, Biomedical Data Science

Software Engineer (SWE) - SOAR WebApp Iteration II

We are seeking a part-time, remote SWE to develop a web application that can provide surgeons with AI-powered learning and feedback resources to accelerate the training of surgical students and improve outcomes for both student and expert surgeons. We want this application to have two main components: 

1. Video library indexing any given set of surgical videos (maybe hundreds or thousands) to allow retrieval of user-specified case conditions and good or bad examples, and (already completed- might need some more enhancements.
2. Functionality for a user to submit a video and receive AI-based analytics and feedback. 

The role would primarily focus on #1 (the video library) first with the idea that later on this would integrate with #2. Overall, the SWE would own the web application implementation containing at least component #1, working closely with a Product Manager who will communicate a clinical and AI vision.

The role would require ~10-15 hrs of work per week and last until ~Oct 15th, with the opportunity for extension dependent on project needs.

Preferred technical competencies: 

1. AWS cloud integration
2. ML algorithm integration to UI
3. React front-end UI/UX development
4. Familiarity with APIs from labeling companies (like Labelbox)

The new features we are looking to add for Phase 1.0 of the project but are not limited to are listed below: 

1. Upload a new surgical video, enabling the ML algorithm to detect features and present a fully processed video to users.
2. Optimize the video processing time.
3. Display a processing icon in the "My Videos" section while the algorithm processes the video.
4. Design surgical Meta Competencies.
5. Add annotation capabilities to the video player, allowing users to highlight while performing a demo.
6. Implement search and filter options by features and metadata.
7. Enable comments on specific sections of surgical videos, which can be displayed to others and saved on the cloud.
8. Scrub surgical videos for HIPAA information and splice out-of-body scenes.
9. Refine functionalities related to the "surgical errors" feature: Show both errors as highlights if a video contains two or more instances of the same filtered error; Add error mitigation as a filter; Add total time and count for TipOOV errors.