Crawlers

Website Content Crawler

Crawl a site and extract clean readable text for AI/RAG pipelines.

Input

Field	Type	Required
`start_urls`	string	required
`max_pages`	string	required
`same_domain_only`	string	required

Run it

curl -X POST "https://api.buildwithapi.io/v1/actors/website-content-crawler/run-sync-get-dataset-items" \
  -H "X-API-Key: vk_live_..." -H "Content-Type: application/json" \
  -d '{"start_urls": "value", "max_pages": "value", "same_domain_only": "value"}'

Response

{
  "actor": "website-content-crawler",
  "status": "SUCCEEDED",
  "stats": { "items": 1 },
  "items": [ ... ],
  "brand": "Vector by Phoenix"
}

Try it live → ← All actors Actor docs