next_cursor back as cursor:
Rules
- Treat cursors as opaque strings. Do not parse or increment them.
- Stop when
has_moreis false ornext_cursoris null. - Keep the same filters while following a cursor.
- Process each page before requesting the next one to avoid memory spikes.
- Checkpoint the last completed cursor in long-running backfills.
- Make your destination writes idempotent because records can change during a scan.
Cursor pagination is not a frozen database snapshot. For ongoing sync, store
Perkstar record IDs and
updated_at values, and use webhooks to react to new
activity between reconciliation runs.
