Skip to main content
POST
/
v1
/
squids
/
{squid_hash}
Update Settings
curl --request POST \
  --url https://api.lobstr.io/v1/squids/{squid_hash} \
  --header 'Authorization: <authorization>' \
  --header 'Content-Type: <content-type>'

Documentation Index

Fetch the complete documentation index at: https://docs.lobstr.io/llms.txt

Use this file to discover all available pages before exploring further.

Configure the scraper parameters to control how Google News articles are collected. These settings include language, recency filters, and result limits.

​
Headers

​
Authorization
string
required
Your API authentication token. Value: Token YOUR_API_KEY
​
Content-Type
string
required
Request body format. Value: application/json

​
Scraper Parameters

Set these parameters in the params object:
ParameterTypeDescription
languagestringCountry edition and UI language for Google News (e.g., English (United States))
time_rangestringFilter by recency: Any time, Past hour, Past 24h, Past week, Past year
max_resultsintegerMaximum articles to scrape. Leave blank to extract all news since 2005.

​
Max Results Behavior

The max_results setting affects how the scraper operates:
  • ≤ 100: No date filter is applied, fetches recent articles
  • > 100: Scraper breaks the span into daily windows and fetches news day by day
  • Blank: Pulls every article back to 2005-01-01 (when combined with Any time)
Leaving max_results blank with time_range as ‘Any time’ will pull every article back to 2005 - this can be very large.
Use time_range filters like ‘Past week’ for recent news monitoring.

​
Code Examples

curl -X POST "https://api.lobstr.io/v1/squids/YOUR_SQUID_HASH" \
  -H "Authorization: Token YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Google News Search Export",
    "concurrency": 1,
    "export_unique_results": true,
    "to_complete": false,
    "no_line_breaks": true,
    "params": {
      "language": "English (United States)",
      "time_range": "Past week",
      "max_results": 100
    }
  }'

​
Response

201
{
  "name": "Google News Search Export",
  "no_line_breaks": true,
  "params": {
    "language": "English (United States)",
    "time_range": "Past week",
    "max_results": 100
  },
  "to_complete": false,
  "export_unique_results": true
}