Overwrite replaces a subset of an Iceberg table with new data selected by a filter or partition specification. Each operation creates a new snapshot rather than modifying existing data files. section 6.3.1 section 6.3
Use overwrite when the pipeline must:
- Correct existing data or deterministically reprocess a defined scope. section 6.3.1
- Refresh a partition, such as a daily snapshot, by replacing its existing files. section 6.3.1
- Coordinate carefully with other writers, because targeted overwrites can invalidate files within the same scope. section 6.3.1
Figure 6.8 In an overwrite, files with deleted or updated records are replaced with new data files.
The diagram shows how files containing deleted or updated records are replaced with new data files. section 6.3.1
