liveBook · Manning

Vertical scaling

As explained in Elasticsearch in Action, Second Edition

Vertical scaling increases system capacity by increasing the resources of existing machines, such as memory or CPU capacity.

When an Elasticsearch deployment needs more capacity, vertical scaling increases the resources of its existing machines instead of adding machines. Typical upgrades include more memory, CPU, or I/O capacity; the enlarged machines can also host additional nodes. section 3.6.1 section 3.7

Expanding capacity for multiple indexes

Suppose five indexes require about 10 TB of memory. A vertical-scaling design upgrades five existing servers to 2 TB each, providing the needed total capacity. This is technically feasible, but upgrading may require shutting down servers, causing downtime unless a disaster-recovery system serves clients during maintenance. section 14.3.2 section 3.6.1

Account for these operational trade-offs:

  • Treat downtime as a planning concern because scaling up may require taking the cluster or servers offline. section 3.6.1 section 14.3.2
  • Avoid concentrating every data copy on one physical machine: a machine failure can affect primary data and replicas even when they occupy different nodes. section 3.6.1
  • Compare vertical scaling with horizontal scaling, which adds nodes and can increase throughput, redundancy, and fault tolerance. section 3.2.5 section 14.1
Figure 14.8 Exponential memory usage for five indexes on a node

Use the memory comparison to visualize how requirements grow across multiple indexes and why larger machines may be considered. section 14.3.2

How Elasticsearch in Action, Second Edition covers it

How deep it goes
Explains resource increases, same-machine nodes, downtime, and failure concentration, but stops short of a step-by-step upgrade procedure.
Examples
Uses five 2-TB servers to meet a 10-TB requirement across five indexes and discusses additional nodes on one machine.
What it assumes
Assumes familiarity with Elasticsearch nodes, clusters, indexes, shards, and replicas.
What you can do after
Evaluate capacity strategies while anticipating maintenance downtime and the risks of concentrating data on one machine.
How it connects
Connects vertical scaling with horizontal scaling, Elasticsearch clusters, shards, replicas, and disaster recovery.

Also explained in

Compare how 7 books explain vertical scaling →

Related concepts

This explainer was generated by Manning's knowledge graph from the text of Elasticsearch in Action, Second Edition. The section links point to the parts of the book it draws on.