Data flow
Data flow is the movement and transformation of data through the components, operations, or processing stages of a system or program.
100 SQL Server Mistakes and How to Avoid Them
A data flow is an SSIS pipeline that moves rows through source, transformation, buffering, and destination components.
- How it is used
- Moves, imports, exports, and transforms rows within SSIS packages while the control flow orchestrates tasks.
- How deep it goes
- Explains pipeline purpose, component paths, Derived Column expressions, type conversions, and source filtering without detailing buffer internals.
- Examples
- Uses staging impressions, GUID and timestamp conversions, marketing.Impressions loading, and a 30-day aggregate-source filter.
- What you can do after
- Apply it by designing SSIS pipelines that transform rows, expose errors, and reduce source data when performance requires it.
Read how 100 SQL Server Mistakes and How to Avoid Them explains data flow →
High Performance Unity Game Development
The directed movement and transformation of data through the stages of a software system.
- How it is used
- Organizes gameplay features around the data each system reads, transforms, and passes onward instead of enemy inheritance relationships.
- How deep it goes
- Works through movement, tracking, teleporting, and rendering inputs and outputs, with an array-based data listing; does not show complete system implementations.
- Examples
- Uses a moving enemy, player tracking, teleport-on-hit behavior, and GameObject positioning to trace successive data transformations.
- What you can do after
- Apply it by identifying a gameplay feature’s required data, transformation, and output before adding behavior to an enemy system.
Read how High Performance Unity Game Development explains data flow →
Secure APIs
A data flow is a representation of how data moves between components, users, and external systems.
- How it is used
- Maps application data movement so teams can validate sources and identify security threats across API interactions.
- How deep it goes
- Explains major flow types, validation risks, unsafe consumption, and diagram-based threat modeling without detailing implementation internals.
- Examples
- Uses request and response paths, database transfers, order aggregation, book-format validation, and malicious identity-provider data.
- What you can do after
- Apply it via Microsoft Threat Modeling Tool, OWASP Threat Dragon, or pytm to represent flows and generate threat models.
Grokking Software Architecture
Data flow is the movement of information between software layers or components, potentially in multiple directions.
- How it is used
- Distinguishes bidirectional data movement from downward command and dependency flow in a layered architecture.
- How deep it goes
- Explains flow directions through layered examples and a blueprint, without providing code-level implementation.
- Examples
- Uses order retrieval and saving to illustrate commands moving down and results returning up.
- What you can do after
- Understand how data can return across layers without reversing command or dependency direction.
Read how Grokking Software Architecture explains data flow →
Also covered in
- Build an AI Agent (From Scratch)
- Data-Oriented Programming: Reduce software complexity
- Build AI-Enhanced Web Apps
- Functional Programming in C#, Second Edition
- Crack Any Codebase with AIIn early access (MEAP)
- Julia as a Second Language
- Practices of the Python Pro
- DuckDB in Action
What to know first
- SQLSQL is a standardized declarative language for defining, querying, and manipulating data in relational database systems.
- object-oriented programmingObject-oriented programming is a programming paradigm that organizes software around objects combining state and behavior, often using encapsulation, classes, inheritance, or polymorphism.
- logA log is a time-ordered record of events, messages, or activity generated by a system or process.
Related concepts
- control flowcontrasts with · Control flow is the order and branching of execution that determines which operations in a program or process run and when.
- data flow diagramused by · A data flow diagram is a visual model of how data moves among processes, components, data stores, and external sources or destinations in a system.
- data-oriented programmingpart of · Data-oriented programming is an approach to structuring software around data representations and the operations, access patterns, and transformations applied to them.
- React contextaddressed by · React context is a mechanism for making values available to descendant components without explicitly passing them through intermediate components.
Questions about data flow
What is data flow?
Data flow is the movement and transformation of data through the components, operations, or processing stages of a system or program.
Which Manning books explain data flow?
100 SQL Server Mistakes and How to Avoid Them, High Performance Unity Game Development, Secure APIs and Grokking Software Architecture.
What should I know before learning data flow?
Manning books that teach data flow usually introduce SQL, object-oriented programming and log first.
What is the difference between data flow and command flow?
Data flow is the movement and transformation of data through the components, operations, or processing stages of a system or program. The directional movement of control instructions from higher architectural layers to lower architectural layers.
What is data flow part of?
Data flow is part of data-oriented programming. Data-oriented programming is an approach to structuring software around data representations and the operations, access patterns, and transformations applied to them.
These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.



