liveBook · Manning

Model architecture

As explained in Fast Python: High performance techniques for large datasets

The structural organization of a computational system’s components, relationships, and operations that determines how it processes information or behaves.

System architecture for data processing spans CPU, memory, local storage, and networks. Improving performance means considering architecture and implementation, rather than assuming that adding servers is the answer. section 1.1 section 6.1

Changes in data scale can force changes to the system:

  • A single-computer solution may require multiple machines, workload distribution, and correct data partitioning as demand grows. section 1.1
  • Data that no longer fits in memory may need to move to disk, often requiring a substantial code rewrite. section 1.1

How Fast Python: High performance techniques for large datasets covers it

How deep it goes
Surveys CPU, memory, storage, and networking implications for Python performance, while narrowing its focus to directly relevant problems.
Examples
Contrasts scaling from one computer to multiple machines with moving an in-memory workload to disk.
What you can do after
Evaluate performance choices by considering architecture and implementation before increasing infrastructure.
How it connects
Connects system architecture with implementation, data processing, hardware architecture, and Python performance.

Also explained in

Compare how 13 books explain model architecture →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Fast Python: High performance techniques for large datasets. The section links point to the parts of the book it draws on.