concept Helm in category apache airflow

This is an excerpt from Manning's book Data Pipelines with Apache Airflow MEAP V05. Login to get full access to this book.

The most used way to deploy software on Kubernetes is with Helm, a package manager for Kubernetes. Various 3rd party Helm charts for Airflow are available on Helm Hub, the repository for Helm charts. At the time of writing, an “official” Airflow Helm chart is available. It is however not yet available on public Helm repositories at the time of writing. The minimal installation instructions are therefore (assuming a functioning Kubernetes cluster and Helm 3+):

Listing 12.4 Airflow installation on Kubernetes with Helm chart.

$ curl -OL https://github.com/apache/airflow/archive/master.zip #1
$ unzip master.zip
$ kubectl create namespace airflow #2
$ helm dep update ./airflow-master/chart #3
$ helm install airflow ./airflow-master/chart --namespace airflow #4
 
NAME: airflow
LAST DEPLOYED: Wed Jul 22 20:40:44 2020
NAMESPACE: airflow
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES:
Thank you for installing Airflow!
 
Your release is named airflow.
 
You can now access your dashboard(s) by executing the following command(s) and visiting the corresponding port at localhost in your browser:
 
Airflow dashboard:        kubectl port-forward svc/airflow-webserver 8080:8080 --namespace airflow

copy

A more extensive example using Kubernetes and Airflow installed with Helm is given in Chapter 13, Section 4.

On this cluster we will deploy a fully-operational Airflow installation using Helm, a package manager for Kubernetes. At the time of writing, a Helm chart is included in the Airflow repository on GitHub, but not yet released via an official channel. We must therefore download it to install: