TES Science Investigator-led Processing System

The Tropospheric Emission Spectrometer (TES) is one of four instruments onboard the Earth Observing System Aura satellite. The TES Science Investigator-led Processing System (SIPS) Facility performs production processing of all TES science data. When the TES project was proposed in 1988, its science algorithms were still evolving, but it was already understood to be at least two orders of magnitude more complex than its NASA predecessor, the Atmospheric Trace Molecule Spectroscopy (ATMOS) instrument. In addition, the expected data volume of the TES instrument would be more than 1000 times greater than that of ATMOS. Development of the TES SIPS faced a number of technical challenges. It also would have been impractical and prohibitively costly to develop the TES SIPS facility without carefully deploying the computing technologies that have recently become available. This paper describes how the challenges were met in the development of the facility by making use of evolving hardware technology and software refinement. The process revealed that the architecture of the hardware implemented was highly dependent upon the processing algorithm, and a stable algorithm was needed early in the hardware development process for performance analysis and benchmarking.