SELVEDAS: A Data and Compute as a Service Workflow Demonstrator targeting Supercomputing Ecosystems

Scientists from different communities, especially large-scale experimental facilities, have unique data and compute requirements that cannot be easily realised on a general-purpose supercomputing environment without significant modifications to either the domain requirements or supercomputing operational configurations. One of the crucial customisations required is the orchestration of on-demand and auto-scale workflows on a largely batch-driven supercomputing system. On-demand, auto-scale and resiliency are however features that are typically associated with cloud technologies. In order to empower a wide variety of users, delivery models such as X-as-a-Service have been introduced. The experimental facilities' workflows from PSI that will leverage on Data and Compute as a Service in the supercomputing ecosystem at CSCS will be shared. Three use cases were implemented to demonstrate the feasibility and benefits of applying a clouddriven approach to supercomputing ecosystems.