liveBook · Manning

Computer cluster

As explained in Effective Data Analysis

A computing cluster is a group of networked computers that jointly execute computational tasks.

A computer cluster is a group of networked computers that jointly processes large datasets. Distributed frameworks divide work across nodes, run tasks in parallel, and combine the results. section 11.2.3

Clusters address practical limits of single-machine and traditional warehouse processing:

  • Reduce processing time by assigning manageable task portions to multiple nodes. section 11.2.3
  • Improve fault tolerance by rerouting a failed node’s task to another node. section 11.2.3
  • Require analysts to learn framework-specific SQL or libraries, such as Spark SQL or PySpark. section 11.2.3
  • Demand cost controls because large-scale processing can consume substantial storage, node, and query resources. section 11.2.3
Figure 11.9 ETL and ELT processes transform the data at different steps, leading to structured data in the warehouse.
figure

Use the parallel-processing figure to trace how a large task is divided across a cluster and recombined into one result. section 11.2.3

How Effective Data Analysis covers it

How deep it goes
Explains task splitting, parallel execution, recombination, fault tolerance, and analyst constraints without detailing cluster internals.
Examples
Uses Spark SQL, PySpark, pandas, scikit-learn, large datasets, and node-failure task rerouting as concrete examples.
What it assumes
Assumes familiarity with data analysis, SQL, statistical modeling, or machine learning while introducing distributed-processing constraints.
What you can do after
Operate/configure distributed analytics by selecting suitable framework tools and managing query, node, and processing costs.
How it connects
Connects distributed computing with parallel processing, data warehouses, SQL, statistical modeling, and machine learning.

Also explained in

Compare how 8 books explain computer cluster →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Effective Data Analysis. The section links point to the parts of the book it draws on.