CDC pipeline checklist
What a change data capture pipeline needs before people rely on it: keys, ordering, deletes, lag, reconciliation and recovery.
The decision it helps with
Whether a change data capture pipeline is ready for people to rely on, or only ready for a demo.
How to use it
- Go through it with the pipeline's owner, one table at a time, starting with the tables that matter most.
- For each item, find the test, query or alert that proves it. If nothing proves it, the item is open.
- Close the open items in order: keys and ordering first, then deletes, then monitoring and recovery.
The checklist
Free to use and adapt under the Creative Commons Attribution licence: credit Matiwos Desalegn and link to this page.