Google API endpoint
Use Crawlora's Search Google News API to extract supported public Google data as structured JSON. This page includes request parameters, cURL examples, response schema, error behavior, credit cost, and a Playground link for testing before integration.
/google/newsReturns current Google News search results using anonymous HTTP requests with fresh proxy profiles, without browser rendering. Pages slice the finite result snapshot; they do not traverse the Google Search index. Results include title, source, publisher article URL, age, and thumbnail when available. Valid no-results searches and exhausted pages return an empty array. Locale defaults to country=us and lang=en. Returns 503 for blocked or malformed upstream responses. Developers commonly use this endpoint for data enrichment, monitoring, research dashboards, internal automation, and agent-native workflows that need repeatable structured public web data. Authentication uses the documented Crawlora headers, and usage is metered with the credit cost shown on this page.
Request parameters are generated from the active endpoint catalog. Required values must be sent before Crawlora can call the upstream public web data source.
| Parameter | Type | Required | Default | Description | Example |
|---|---|---|---|---|---|
| q | string | Yes | Search query | ||
| page | integer | No | 1 | 1-based page within the current finite result snapshot; defaults to 1 Minimum: 1. | |
| count | integer | No | 10 | Results per page; defaults to 10, clamped to 1..50 Minimum: 1. Maximum: 50. | |
| country | string | No | us | Two-letter country code; defaults to us | |
| lang | string | No | en | Google UI language; defaults to en | |
| x-api-key (header) | string | Yes | API key required |
curl -X GET "https://api.crawlora.net/api/v1/google/news?q=coffee&page=1&count=10&country=us&lang=en" \ -H "x-api-key: $CRAWLORA_API_KEY"
Send your scraping API key in the x-api-key header. Use the console API Keys page to rotate or select the active key.
Endpoint usage is metered in credits. The plan prices, included credits, limits, and overage rates below match the active backend billing configuration.
| Plan | Price | Included credits | Daily cap | Rate limit | Overage |
|---|---|---|---|---|---|
| Free | $0/mo | 2,000 | 500 daily credits | 5/min | No overage |
| Starter | $9/mo | 20,000 | 5,000 daily credits | 15/min | $0.75/1,000 overage credits when enabled |
| Growth | $29/mo | 100,000 | 25,000 daily credits | 45/min | $0.45/1,000 overage credits when enabled |
| Pro | $79/mo | 400,000 | No daily cap | 120/min | $0.30/1,000 overage credits |
| Business | $199/mo | 1,200,000 | No daily cap | 300/min | $0.20/1,000 overage credits |
| Enterprise | $499/mo | 5,000,000 | No daily cap | 1,000/min | $0.12/1,000 overage credits |
This endpoint is executed through Crawlora's managed scraping infrastructure.
Some targets require real browser execution because the data is loaded through JavaScript, dynamic rendering, or interaction-like browser behavior.
For supported endpoints, Crawlora can route requests through a managed browser cluster. This allows Crawlora to execute JavaScript, load dynamic content, apply browser-level request behavior, and normalize the rendered result into JSON.
You do not need to operate your own Playwright, Puppeteer, Chrome, proxy, queue, or retry infrastructure.
- Pagination slices the current finite result snapshot, which typically contains about 100 articles. It does not page through the Google Search index or retrieve a historical archive. Narrow `q` to retrieve a more specific set of stories. - Result contents and ordering can change between requests. Pages are not a persistent snapshot. - Positions are 1-based across the snapshot. `next_page` appears only when another item exists; a full final page does not advertise another page. - Valid no-results searches and pages beyond the end return `results: []` without `next_page`. - Blocked, malformed, or unrecognizable upstream responses return `503`. - `url` links directly to the publisher. `thumbnail` is included when available. Article summaries are not supplied by this source, so `description` is omitted. `age` is relative to publication time. - Requests use an anonymous HTTP source with bounded fresh-proxy retries. No browser rendering or browser fallback is used. Example response: ```json { "code": 200, "msg": "OK", "data": { "results": [ { "position": 1, "title": "Example headline", "url": "https://example.com/news/story", "source": "Example News", "age": "2 hours ago" } ], "pagination": { "page": 1 } } } ```
Crawlora does not silently return bad data when the upstream page cannot be used.
| Status | Common failure case |
|---|---|
| 400 | Invalid input or missing required parameter |
| 429 | Plan or endpoint rate limit exceeded |
| 500 | Internal execution error |
| 502 | Upstream platform failed, returned unusable HTML, or served a challenge page that could not be resolved |
When possible, Crawlora returns structured error context so your integration can retry, back off, or inspect the request.
| Status | Description | Schema |
|---|---|---|
| 400 | Missing or invalid query parameters | #/definitions/app.Response |
| 429 | Rate limit exceeded | #/definitions/app.Response |
| 500 | Internal server error | #/definitions/app.Response |
| 503 | Google upstream request failed | #/definitions/app.Response |
{
"code": 200,
"msg": "OK",
"data": {
"results": [
{
"position": 1,
"title": "Example headline",
"url": "https://example.com/news/story",
"source": "Example News",
"age": "2 hours ago"
}
],
"pagination": {
"page": 1
}
}
}Request schema
No body schema
Response schema
#/definitions/google.newsResponseDoc
| Field | Type | Required | Enum | Bounds | Example | Description |
|---|---|---|---|---|---|---|
| code | integer | No | 200 | |||
| data | google.NewsResponse | No | ||||
| data.pagination | google.VerticalPagination | No | ||||
| data.pagination.next_page | integer | No | 2 | |||
| data.pagination.page | integer | No | 1 | |||
| data.pagination.previous_page | integer | No | 1 | |||
| data.results | array | No | ||||
| data.results[].age | string | No | 2 hours ago | |||
| data.results[].description | string | No | OpenAI announced an update. | |||
| data.results[].position | integer | No | 1 | |||
| data.results[].source | string | No | Example News | |||
| data.results[].thumbnail | string | No | https://example.com/thumb.jpg | |||
| data.results[].title | string | No | OpenAI announces update | |||
| data.results[].url | string | No | https://example.com/openai-news | |||
| msg | string | No | OK |
Use environment variables for secrets and keep Crawlora API keys server-side.
curl -X GET "https://api.crawlora.net/api/v1/google/news?q=coffee&page=1&count=10&country=us&lang=en" \
-H "x-api-key: $CRAWLORA_API_KEY"Crawlora is designed for responsible structured public web data workflows. Customers are responsible for using Crawlora in compliance with applicable laws, third-party rights, target-platform rules, and Crawlora terms.
Read Crawlora terms