Currently, astronauts onboard the International Space Station (ISS) follow intricate step-by-step instructions and often encounter challenges due to complex procedures, inadequate details, and reliance on training from months prior. While astronauts can call ground personnel for assistance, ground access will become limited in future expeditions due to distance and bandwidth limitations. Thus, we propose an automated solution: a procedure-tracking system that uses an object recognition model and sensors to validate user progress. Our project is a proof of concept to monitor astronauts' progress as they complete procedures. This entails the following:
1) Tracking the completion of steps in the procedure
2) Evaluating if the steps are completed correctly
3) Identifying deviations from the procedure
To simulate the complexity of a space maintenance task, we choose to monitor the procedure of removing the bottom bracket of a bike.