liveBook · Manning

Data flow

Data flow is the movement and transformation of data through the components, operations, or processing stages of a system or program.

How 4 Manning books explain it

100 SQL Server Mistakes and How to Avoid Them

A data flow is an SSIS pipeline that moves rows through source, transformation, buffering, and destination components.

How it is used
Moves, imports, exports, and transforms rows within SSIS packages while the control flow orchestrates tasks.
How deep it goes
Explains pipeline purpose, component paths, Derived Column expressions, type conversions, and source filtering without detailing buffer internals.
Examples
Uses staging impressions, GUID and timestamp conversions, marketing.Impressions loading, and a 30-day aggregate-source filter.
What you can do after
Apply it by designing SSIS pipelines that transform rows, expose errors, and reduce source data when performance requires it.

Read how 100 SQL Server Mistakes and How to Avoid Them explains data flow →

High Performance Unity Game Development

The directed movement and transformation of data through the stages of a software system.

How it is used
Organizes gameplay features around the data each system reads, transforms, and passes onward instead of enemy inheritance relationships.
How deep it goes
Works through movement, tracking, teleporting, and rendering inputs and outputs, with an array-based data listing; does not show complete system implementations.
Examples
Uses a moving enemy, player tracking, teleport-on-hit behavior, and GameObject positioning to trace successive data transformations.
What you can do after
Apply it by identifying a gameplay feature’s required data, transformation, and output before adding behavior to an enemy system.

Read how High Performance Unity Game Development explains data flow →

Secure APIs

A data flow is a representation of how data moves between components, users, and external systems.

How it is used
Maps application data movement so teams can validate sources and identify security threats across API interactions.
How deep it goes
Explains major flow types, validation risks, unsafe consumption, and diagram-based threat modeling without detailing implementation internals.
Examples
Uses request and response paths, database transfers, order aggregation, book-format validation, and malicious identity-provider data.
What you can do after
Apply it via Microsoft Threat Modeling Tool, OWASP Threat Dragon, or pytm to represent flows and generate threat models.

Read how Secure APIs explains data flow →

Grokking Software Architecture

Data flow is the movement of information between software layers or components, potentially in multiple directions.

How it is used
Distinguishes bidirectional data movement from downward command and dependency flow in a layered architecture.
How deep it goes
Explains flow directions through layered examples and a blueprint, without providing code-level implementation.
Examples
Uses order retrieval and saving to illustrate commands moving down and results returning up.
What you can do after
Understand how data can return across layers without reversing command or dependency direction.

Read how Grokking Software Architecture explains data flow →

Also covered in

What to know first

Related concepts

Questions about data flow

What is data flow?

Data flow is the movement and transformation of data through the components, operations, or processing stages of a system or program.

Which Manning books explain data flow?

100 SQL Server Mistakes and How to Avoid Them, High Performance Unity Game Development, Secure APIs and Grokking Software Architecture.

What should I know before learning data flow?

Manning books that teach data flow usually introduce SQL, object-oriented programming and log first.

What is the difference between data flow and command flow?

Data flow is the movement and transformation of data through the components, operations, or processing stages of a system or program. The directional movement of control instructions from higher architectural layers to lower architectural layers.

What is data flow part of?

Data flow is part of data-oriented programming. Data-oriented programming is an approach to structuring software around data representations and the operations, access patterns, and transformations applied to them.

These guides are generated from the text of Manning books by Manning's knowledge graph and link to the sections they draw on. The full books are available on liveBook and at manning.com.