Satellites typically have limited computing power, in part because they are solar powered and because their rigorous testing schedules and inaccessible operating location demands reliable, time proven technology, often several generations behind current state of the art devices we are familiar with.

Our project aims to automatically produce a deep learning, object detection algorithm, which will be compressed and optimised to run on a space-grade FPGA device qualified to work in space on a satellite. The object detection algorithm will use synthetic aperture radar (SAR) and hyper-spectral image data as input sources and it will be trained using existing archives of satellite SAR and image data. The final deep learning system will be tested by Thales Alenia Space, a prime space contractor for ESA, at their satellite facility in Bristol UK.

Satellites periodically transmit large volumes of collected data to earth based receiving stations for processing and distribution. This cyclic process restricts how much data can be collected during an orbit and requires significant bandwidth to transmit and receive data during the downlink window. By enabling the satellite with on-board object detection, it will identify and respond in real-time to observed events and then be selective about which data to source and keep for later downloads.

These are fundamental problems with current satellite technology. It is relatively easy to attach high resolution scanners and radars to satellites, but much harder to store and transmit the volumes of data that can be gathered during one or more orbits. By finding ways to put smart AI algorithms into the limited, on-board compute devices of satellites we will make more efficient use of their capabilities and in-turn enable satellites and other space vehicles to undertake autonomous activities, when out of communication or too distant from Earth.

This project is highly innovative because it will automate the design and creation of an object detection algorithm on a minimally configured, space-grade FPGA. If space technology is to reliably exploit AI algorithms this capability will be essential. There are no AI processors currently designed for space use.

Although this project is developing an AI solution for a satellite platform, our solution is equally applicable to other space applications on deep space vehicles or on planetary rovers. It would require a different deep learning algorithm, which would need to be re-trained for the specific task, but the same space-grade FPGAs could be used.