Pagination

Most actors return a complete result set in items. Crawlers and large listings support paging.

Limit + offset

curl -X POST ".../v1/actors/website-content-crawler/run-sync-get-dataset-items" \
  -H "X-API-Key: vk_live_..." -H "Content-Type: application/json" \
  -d '{"start_urls":["https://example.com"],"max_pages":50,"limit":20,"offset":0}'

• limit — max items to return (default varies by actor).
• offset — how many to skip. Page N = offset = N * limit.

Caps that matter

• max_pages / max_depth cap how far a crawler travels (politeness + cost control).
• The response stats.items tells you how many you actually got — loop until it's less than your limit.

offset, out = 0, []
while True:
    r = call(limit=100, offset=offset)
    batch = r["items"]; out += batch
    if len(batch) < 100: break
    offset += 100