Skip to main content
POST
/
v1
/
squids
/
{squid_hash}
Update Settings
curl --request POST \
  --url https://api.lobstr.io/v1/squids/{squid_hash} \
  --header 'Authorization: <authorization>' \
  --header 'Content-Type: <content-type>'
Configure the scraper parameters to control how Google News articles are collected. These settings include language, recency filters, and result limits.

​
Headers

​
Authorization
string
required
Your API authentication token. Value: Token YOUR_API_KEY
​
Content-Type
string
required
Request body format. Value: application/json

​
Scraper Parameters

Set these parameters in the params object:
ParameterTypeDescription
languagestringCountry edition and UI language for Google News (e.g., English (United States))
time_rangestringFilter by recency: Any time, Past hour, Past 24h, Past week, Past year
max_resultsintegerMaximum articles to scrape. Leave blank to extract all news since 2005.

​
Max Results Behavior

The max_results setting affects how the scraper operates:
  • ≤ 100: No date filter is applied, fetches recent articles
  • > 100: Scraper breaks the span into daily windows and fetches news day by day
  • Blank: Pulls every article back to 2005-01-01 (when combined with Any time)
Leaving max_results blank with time_range as ‘Any time’ will pull every article back to 2005 - this can be very large.
Use time_range filters like ‘Past week’ for recent news monitoring.

​
Code Examples

curl -X POST "https://api.lobstr.io/v1/squids/YOUR_SQUID_HASH" \
  -H "Authorization: Token YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "name": "Google News Search Export",
    "concurrency": 1,
    "export_unique_results": true,
    "to_complete": false,
    "no_line_breaks": true,
    "params": {
      "language": "English (United States)",
      "time_range": "Past week",
      "max_results": 100
    }
  }'

​
Response

201
{
  "name": "Google News Search Export",
  "no_line_breaks": true,
  "params": {
    "language": "English (United States)",
    "time_range": "Past week",
    "max_results": 100
  },
  "to_complete": false,
  "export_unique_results": true
}