uraCrawlDocs

Core

Collect modes

The collect object is the single knob for "how much." Four modes cover everything from a quick sample to exhausting a feed.

ModeShapeBehaviour
limit{ "mode": "limit", "limit": 500 }Stop after N records. The common default.
all{ "mode": "all" }Exhaust pagination — the whole page, profile, or result set.
since{ "mode": "since", "since": "2026-08-01T00:00:00Z" }Only records newer than a timestamp. Ideal for scheduled refreshes.
page{ "mode": "page", "cursor": "eyJ…", "limit": 50 }Drive pagination yourself with the returned cursor.