Episodes
Replace these sample episodes with your own tutorial narrative.
Episode 1
Introduction
This tutorial shows how to set up a CMS open data processing workflow using Kubernetes clusters from Infomaniak. NoteTo learn about CMS open data and the different data formats, work through the tutorials in one of our …
Open pageEpisode 2
Storage for the output files
The processing workflow writes the output files to a storage from which they can be downloaded afterwards. For this tutorial, we use Infomaniak Object Storage. Persistent storageStorage resources are separate from the …
Open pageEpisode 3
Kubernetes cluster
Prerequisites You will need the Infomaniak account and a public cloud project. See the Setup instructions. You will need to have the tutorial code in your local working environment and kubectl - the software needed to …
Open pageEpisode 4
Set up a workflow
Prerequisites You will need the Infomaniak account and a public cloud project. See the Setup instructions. You will need to have the tutorial code in your local working environment kubectl installed to interact with …
Open pageEpisode 5
Scaling up
Input data The optimal cluster configuration depends on the input dataset. Datasets consist of files, and the number of files can vary. Files consist of events, and the number of events can vary. In practical terms, the …
Open pageEpisode 6
Discussion
What worked? Setting up resources was straight-forward. The documentation is adequate, very good for starting a project and for storage resources, but a bit less elaborated for Kubernetes services. However, this was not …
Open page