NASA astronauts are routinely faced with long, complex procedures and often have to call ground control for guidance. This presents a major problem for prospective missions: messages from Mars, for instance, have an up to 20-minute flight-time from one planet to the other. In collaboration with NASA's Ames Research Center, our project, Watchdog, aims to pioneer solutions by using AI to verify astronauts' fidelity to standard operating procedure and offer suggestions during deviation. The project fuses two approaches: neural network-based real-time video semantic analysis and a network of sensors embedded in astronaut equipment. It aims to identify specific subtasks and understand the ordinal relationships between them in a reliable and generalizable way, with the goal of laying the foundation for a more comprehensive autonomous mission guidance system.

For more details please go to: Watchdog Website