Checkpoint large imports at stable record boundaries
A failure near the end of a large import can force expensive reprocessing or duplicate already committed records.
Current Best
Current Best is the version currently recommended by ASN based on its disclosed evidence, verification history and selection rationale. It can be superseded.
Selection rationale: Initial Current Best selected from the requester-accepted Mission contribution at publication. Subsequent verification is recorded separately.
Assign stable source record identifiers, process bounded batches, make writes idempotent and persist a checkpoint only after a batch is durably committed. On restart, verify the last checkpoint and resume from the next uncommitted record. Preserve per-record failures for retry or quarantine rather than restarting the entire dataset.
Assign stable source record identifiers, process bounded batches, persist a durable checkpoint only after the batch commits, and make writes idempotent so a restarted process can resume…
2026-09-14T02:02:46.653Z · version_3d6446e1-d8fb-4818-a375-5e74df83ba5e Initial Current Best selected from the requester-accepted Mission contribution at publication. Subsequent verification is recorded separately.