Persistent volume

Q: How deeply does Data Pipelines with Apache Airflow, Second Edition cover persistent volume?

Defines the storage abstraction and demonstrates YAML, kubectl, and Helm configuration, but defers volume-specific CI/CD implementation.

As explained in Data Pipelines with Apache Airflow, Second Edition

A PersistentVolume is Kubernetes storage provisioned for use by workloads independently of a pod's lifecycle.

A PersistentVolume is Kubernetes storage that lets Airflow mount shared DAG files independently of individual pod images. It hides the underlying storage technology, but teams must still arrange a way to push or pull DAG code onto the volume. section 17.2.7

Mounting DAGs from a local volume

Declare a ReadWriteMany PersistentVolume backed by the host's /data directory, bind it to a 250Mi PersistentVolumeClaim, and apply the manifest with kubectl. Configure the Airflow Helm chart with dags.persistence.enabled: true and existingClaim: local-path-dag-volume-claim, then deploy with helm upgrade.

This approach suits multiple teams sharing an Airflow environment, but its CI/CD design depends on the chosen volume type. Git synchronization is an alternative when DAGs should come from a repository instead. section 17.2.7

How Data Pipelines with Apache Airflow, Second Edition covers it

Cover of Data Pipelines with Apache Airflow, Second Edition

liveBook manning.com

Read Data Pipelines with Apache Airflow, Second Edition on liveBook Get the book at manning.com

Also explained in

liveBook manning.com

Kubernetes in Action, Second EditionA PersistentVolume is a Kubernetes API resource representing storage provisioned for use by workloads independently of a pod's lifetime.
liveBook manning.com

Acing the Certified Kubernetes Administrator Exam, Second EditionA persistent volume is a Kubernetes API object representing storage provisioned for durable workload data.
liveBook manning.com

Kubernetes for DevelopersA persistent volume is a Kubernetes storage resource that provides data storage intended to survive container or Pod replacement.
liveBook manning.com

Google Anthos in ActionA persistent volume is a Kubernetes resource representing storage provisioned for use by workloads independently of a pod's lifecycle.
liveBook manning.com

Distributed Machine Learning PatternsA PersistentVolume is a Kubernetes storage resource representing durable storage that can be provisioned and mounted independently of an individual workload.
liveBook manning.com

Road to KubernetesA persistent volume is a Kubernetes storage resource that provides durable storage independently of an individual container's lifecycle.

Compare how 7 books explain persistent volume →

Related concepts

persistent volume claimused by · A PersistentVolumeClaim is a Kubernetes resource through which a workload requests persistent storage with specified capacity, access modes, and other storage characteristics.
poduses · A Kubernetes Pod is the smallest deployable unit in Kubernetes, grouping one or more co-located containers that share networking and other resources.
StorageClassconfigured by · A StorageClass is a Kubernetes API resource that defines a category of storage and the provisioner and parameters for dynamically creating volumes.
emptydir volumecontrasts with · An emptyDir volume is a Kubernetes volume that starts empty, is available to containers in a Pod, and is deleted when the Pod leaves its node.
static provisioningproduced by · Static provisioning is the administrator-managed creation of persistent storage resources before workloads request or claim them.

This explainer was generated by Manning's knowledge graph from the text of Data Pipelines with Apache Airflow, Second Edition. The section links point to the parts of the book it draws on.