Establishing Machine Learning Operations for Continual Learning in Computing Clusters: A Framework for Monitoring and Optimizing Cluster Behavior

We focus on building a machine learning (ML) operations continual learning capability to support an ML research and development project at Jefferson Lab. We describe a composable ML workflow, a custom CGroupV2 exporter, and the implementation of Prometheus, MLFlow, and Grafana.