Map API
See a site’s useful URLs before you extract them.
Discover links with bounded depth and page limits, then choose the exact pages your product should scrape or crawl.
Mapping returns discovered URLs and crawl metadata without pretending every page is relevant.Discover firstInspect site shape before extraction.
Keep boundariesUse page, depth and path limits.
Reuse the URLsSend selected results directly to Scrape or Crawl.
Cheaper planning
Separate URL discovery from content extraction.
A map is useful when a sitemap is missing, stale or too broad. CrawlVolt returns normalized HTTP and HTTPS links with their discovery depth and response state.
- Choose documentation sections before ingestion
- Audit public route coverage
- Build a focused crawl request from real URLs
POST /v1/map
{
"url": "https://example.com",
"max_pages": 50,
"max_depth": 2
}
200 OK
{ "links": [{ "url": "...", "depth": 1 }] }Map a real public website.
Use Map in the bounded documentation collection guide, then prepare the saved Markdown for retrieval.
Review the discovered links in the live playground before deciding what deserves extraction.