Skip to content

A simple Python class to orchestrate cluster nodes within a docker environment.

Notifications You must be signed in to change notification settings

maikelvallinga/docker-cluster-controller

 
 

Repository files navigation

Docker Cluster Controller

This project provides a 'clustercontroller' package which can be used to create a docker-entrypoint.

In complex docker swarm setups the order in which containers are started cannot be controlled (depends_on). When there is a need to have different actions depening on boot order this has to be handled during initialisation of the container.

The clustercontroller package provides a class which can be used in a docker-entrypoint.

In the docker-entrypoint multiprocessing is used through methods provided by the package to start two main processes:

  1. ClusterController process
  2. The actual service the container needs to provide

Both processes are registered and actively monitored. If one of both processes (unexpectedly) terminates the other is gracefully terminated using terminate signals.

The ClusterController registers the instance in ETCD and tries to aquire a master role. Depending on the boot order of containers it will either get the master role or become slave.

Depending on the role methods are executed during initialisation, during it's lifecycle any state transfer will also call appropriate actions for handling these events.

During startup of the controller 'scheduled' jobs can be registered for example to perform hourly actions. It is important to only use multiprocessing task using the 'start_process' method within these time based methods to 'freeze' any other processes.

Installation:

pip install docker-cluster-controller

Usage:

  1. Build a container with a docker-entrypoint using the clustercontroller. See the docker-entrypoint.py as and example implementation.
  2. Start a ETCD Cluster, see docker-service-discovery
  3. In the docker-compose file set environment variables so the clustercontroller knows where and how to register
Environment Variable Description
ETCD_HOST The hostname of the ETCD node
ETCD_PORT The port of the ETCD node
PORTS_WHEN_ACTIVE The port(s) when de service has become active (e.g. 80,443,8443)
ENVIRONMENT: A single ETCD node can be used for multimple environments, therefore the environment has to be specified. E.g. development'
SERVICE: The name of the service

About

A simple Python class to orchestrate cluster nodes within a docker environment.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.2%
  • Makefile 0.8%