Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.lobstr.io/llms.txt

Use this file to discover all available pages before exploring further.

Quick Start

Get your API key and make your first request in minutes.

47 Crawlers

Google Maps, LinkedIn, Twitter, Instagram, and more — ready to use.

Python SDK

Typed models, auto-pagination, sync and async clients.

​
Core Concepts

The lobstr.io API is built around three primitives:
  • Squid — a configured scraper instance tied to a crawler and your settings
  • Task — a URL or keyword the squid will scrape
  • Run — a single execution of a squid against its tasks
A typical workflow:
1

Authenticate

Include Authorization: Token YOUR_API_KEY in every request. Get your key from the dashboard.
2

Create a squid

Pick a crawler (e.g. google-maps-leads-scraper) and create a squid with your settings.
3

Add tasks

Add URLs or keywords as tasks to the squid.
4

Start a run

Trigger a run and poll for completion.
5

Get results

Fetch structured JSON results from GET /v1/results.

​
Developer Tools

Python SDK

pip install lobstrio-sdk

CLI

pip install lobstrio

MCP Server

Connect Claude or Cursor to the docs.