liveBook · Manning

File-based initial sync

As explained in MongoDB 8.0 in Action, Third Edition

File-based initial sync is a MongoDB Enterprise synchronization method that initializes a member by copying database files rather than logically copying documents.

File-based initial sync initializes a MongoDB replica-set member by copying database files instead of logically copying documents. MongoDB 6.0 and later provides it as a MongoDB Enterprise method intended for very large datasets, typically 1 TB or more. section 9.1.3

Use the approach with these operational considerations:

  • Choose it for large data sizes where logical initial sync may take too long. section 9.1.3
  • Treat recovery windows differently: MongoDB can resume a file-based initial sync within a shorter 10-minute window after a failure, compared with 24 hours for logical initial sync. section 9.1.3
  • Configure the relevant retry windows with mongod parameters, and consider oplog retention when preventing entries from being trimmed too soon. section 9.1.3

Large-member initialization

For a replica set containing more than 1 TB of data, a MongoDB Enterprise deployment can use file-based initial sync rather than copying every document logically. If a transient network problem interrupts the process, the shorter configured recovery window becomes an operational constraint. section 9.1.3

How MongoDB 8.0 in Action, Third Edition covers it

How deep it goes
Contrasts file-based and logical synchronization, then covers dataset scale, failure windows, and mongod configuration without detailing copy internals.
Examples
Uses 1 TB-plus datasets and transient network failures as concrete deployment scenarios.
What it assumes
Assumes familiarity with MongoDB replication, replica sets, oplog entries, and mongod startup configuration.
What you can do after
Operate large-member initialization while choosing recovery windows and configuring oplog-related retention settings.
How it connects
Connects initial sync with logical initial sync, replica sets, the oplog, and mongod configuration.

Related concepts

This explainer was generated by Manning's knowledge graph from the text of MongoDB 8.0 in Action, Third Edition. The section links point to the parts of the book it draws on.