Mol Jan David

Abstract Reference: 30347
Identifier: P3.8
Presentation: Poster presentation
Key Theme: 3 New Trends in HPC and Distributed Computing

Docker in Production: Experiences with Data Processing and Inspection

Authors:
Mol Jan David

We want to share our experiences with using Docker as part of a production system. Docker is a promising container technology that aids software development and deployment in the DevOps environment. In LOFAR, we recently integrated Docker into our work flow for our automated data processing as well as for our manual data inspection. We are now able to leverage many advantages that Docker has to offer. For example, we can deploy and run multiple software versions, each with their own configurations and dependencies, in parallel on the same server. The deployment, testing, and upgrading of both our own and 3rd party software, but also system maintenance of LOFAR is made both easier and more powerful. Finally, Docker allows us to ship our software stack to end users, which are able to run our pipelines and tools from scratch using a single command, provided that they have Docker installed.