liveBook · Manning

SSTableLoader

As explained in ScyllaDB in Action

SSTableLoader is a Cassandra-compatible command-line utility for bulk-loading SSTables into a database cluster.

SSTableLoader is a command-line utility for bulk-loading SSTables from Cassandra or ScyllaDB into a Scylla cluster. It offers a straightforward migration path when the source data already exists as SSTables. section 12.2.1 section 12.2.2

Use SSTableLoader by preparing the data and destination in this order:

  • Create the destination schema before loading; the tool assumes the schema for the SSTables already exists. section 12.2.2
  • Arrange the files in a directory resembling Scylla's data layout, with keyspace and table subdirectories. section 12.2.2
  • Point SSTableLoader at the directory; it scans the SSTables, converts their contents into CQL statements, and executes them on the destination cluster. section 12.2.2

Restoring a reviews table

After snapshotting the reviews keyspace, move the SSTables for the articles table into reviews/articles. Point SSTableLoader at that directory to load the table into Scylla. section 12.2.2

SSTableLoader is easy to set up but narrow in scope. It cannot load from non-Cassandra or non-Scylla sources, lacks checkpointing, and can be parallelized only per table. During an online migration, pair it with application dual-writing and validate correctness with dual-reading. section 12.2.5 section 12.3

Figure 12.5 The SSTableLoader, as its name suggests, migrates data by reading a set of SSTables and inserting their contents into Scylla.
figure

Shows the loading flow: SSTableLoader reads SSTables and inserts their contents into Scylla. section 12.2.2

How ScyllaDB in Action covers it

How deep it goes
Explains directory preparation, schema requirements, loading behavior, and table-level scalability limits.
Examples
Uses a snapshotted reviews keyspace and articles table as the concrete restoration example.
What it assumes
Assumes existing Cassandra or ScyllaDB SSTables and a precreated matching destination schema.
What you can do after
Operate SSTableLoader for a prepared Cassandra or ScyllaDB table migration and recognize when its limits require another migrator.
How it connects
Connects SSTables with schema, CQL statements, dual-writing, dual-reading, and the Spark Migrator.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of ScyllaDB in Action. The section links point to the parts of the book it draws on.