Executor
An executor is a software component or interface that accepts tasks or actions and arranges for their execution by an appropriate runtime or worker.
Data Pipelines with Apache Airflow, Second Edition
An Airflow executor is an execution framework component that determines how workflow tasks are dispatched and run by workers.
- How it is used
- Determines how queued Airflow tasks are dispatched to workers in a production deployment.
- How deep it goes
- Explains the scheduler handoff, compares executor trade-offs, and gives configuration and installation checks without detailing every installation approach.
- Examples
- Uses an executor configuration setting, a task-level BashOperator selection, and a mixed-executor deployment with different task images.
- What you can do after
- Operate/configure it by choosing an executor for the workload, setting its configuration, and checking that a DAG task reaches running.
Read how Data Pipelines with Apache Airflow, Second Edition explains executor →
Rust Servers, Services, and Apps
The Tokio executor is the Tokio runtime component that drives futures toward completion by polling them when they can make progress.
- How it is used
- Drives spawned and awaited Tokio futures by polling them until they produce results.
- How deep it goes
- Works through polling, pending results, waking, and a custom timer; treats pinning as a requirement rather than explaining it fully.
- Examples
- Uses spawned file-reading tasks, a future that stays pending, and an expiration timer that wakes its task.
- What you can do after
- Evaluate/understand it: trace why a Tokio task remains pending, gets polled again, or completes.
Read how Rust Servers, Services, and Apps explains executor →
Fast Python: High performance techniques for large datasets
- How it is used
- Coordinates coroutine scheduling or manages worker threads for concurrent task execution.
- How deep it goes
- Explains cooperative yielding and demonstrates threaded mapping, futures, and callbacks; leaves worker tuning to lower-level threading.
- Examples
- Uses network listening with disk writing and a word-count MapReduce pipeline to illustrate execution.
- What you can do after
- Apply concurrent.futures.ThreadPoolExecutor to run mapping and reduction jobs, inspect futures, and report progress with callbacks.
Read how Fast Python: High performance techniques for large datasets explains executor →
Related concepts
- async runtimepart of · An async runtime is software that schedules asynchronous tasks and drives their suspended computations toward completion.
- concurrent.futurespart of · concurrent.futures is a Python standard-library module providing high-level interfaces for asynchronously executing and coordinating callable tasks with threads or processes.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.