Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.lobstr.io/llms.txt

Use this file to discover all available pages before exploring further.

April 28, 2026

New

  • Crawler chaining — a squid can now automatically feed its results into a second crawler as soon as a run completes. Configure a chain on any squid by setting a chain object with the following fields:
    FieldTypeDescription
    target_crawlerstringSlug of the crawler that will receive the results as inputs
    field_mapobjectMaps a result field from the source to an input param on the target (e.g. {"url": "url"})
    autostartbooleanIf true, the downstream run starts immediately. If false, tasks are queued and the run is left paused for manual review. Defaults to true
    cluster_settingsobjectOptional — pre-configure the downstream squid’s name and concurrency on first creation
  • GET /v1/squids/{id} — response now includes a chain object when a chain is configured on the squid
  • GET /v1/runs — runs triggered by a chain now include "origin": "chain" in the response