Data archiving system implementation in ITER's CODAC CORE SYSTEM

A new data archiving implementation developed by the CIEMAT-INDRA-SGENIA-UPM Consortium (in alphabetical order) has been fully integrated into ITER's CODAC CORE SYSTEM at the beginning of year 2015. This software includes components on the client and server sides that are responsible for the distribution and archiving of acquired or process-generated data, with important restrictions. On the one side, ITER's high pulse length requires that any data archiving implementation include a steady state archiving mechanism with continuous storage of the data acquired and processed throughout the experiment. On the other side, all these data must be safely archived and continuously available for read systems on the client side in a short time from their acquisition. On the side of client systems, a new software library has been developed with two main goals. The first one is to provide simple and complete data archiving functionality, while the second pursues to implement a continuous and efficient data distribution engine including different data sources as well as a diversity of potential consumer systems. From the server-based perspective, a complete solution has been implemented using the HDF5 files as the underlying data storage technology, while adapting the metadata structures and data access protocols to meet ITER's CODAC requirements.