liveBook · Manning

Values.yaml file

As explained in Data Pipelines with Apache Airflow, Second Edition

A Helm values file is a configuration file containing values that parameterize a Helm chart deployment.

A values.yaml file parameterizes a Helm chart deployment by overriding selected defaults. Helm applies it during installation or upgrade, letting an Airflow deployment adopt project-specific users, images, databases, secrets, DAG sources, and executors. section 17.2.4 section 17.4

Typical overrides include:

  • Select a custom Docker image by setting images.airflow.repository and images.airflow.tag, then deploy it with helm upgrade. section 17.2.7
  • Choose DAG delivery through a persistent volume or Git synchronization, using dags.persistence or dags.gitSync settings. section 17.2.7
  • Configure multiple executors and task images, including CeleryExecutor and KubernetesExecutor combinations. section 17.2.9

Apply an Airflow override file

Store deployment choices in /etc/helm/values/01-user-values.yaml, then apply them with: helm upgrade --install airflow apache-airflow/airflow --namespace airflow --set apiServer.service.type=LoadBalancer -f /etc/helm/values/01-user-values.yaml. Upgrading changes the configuration without necessarily removing existing resources; an old user can therefore remain after a new initial-user setting is applied. section 17.2.4

How Data Pipelines with Apache Airflow, Second Edition covers it

How deep it goes
Explains override structure through user, image, DAG-source, and executor configurations, stopping short of general YAML semantics.
Examples
Demonstrates initial-user creation, custom DAG images, persistent-volume and Git DAG delivery, and multiple executor images.
What it assumes
Assumes Helm chart and Kubernetes deployment familiarity while demonstrating concrete Airflow settings from working configurations.
What you can do after
Operate/configure Airflow deployments by composing override files and applying them with helm upgrade --install.
How it connects
Connects Helm charts with Kubernetes, Docker images, persistent volumes, Git repositories, external databases, secrets, and Airflow executors.

Also explained in

Compare how 3 books explain values.yaml file →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Data Pipelines with Apache Airflow, Second Edition. The section links point to the parts of the book it draws on.