Retrieval API endpoint
Returns the registered developer source catalog and each source's exact supported operations, filters, artifact types, and index state. The current catalog contains only `go:docs`, a selected set of 18 parser-verified Go documentation/specification pages. A source is `not_indexed` until a complete generation is promoted. The catalog does not accept a cursor; `limit` may be 1–100.
/developer/sourcesReturns the registered developer source catalog and each source's current index state. The current catalog contains only go:docs: a selected set of 18 parser-verified Go documentation/specification pages. It excludes the 33 navigation candidates that did not pass the cold parser check, all pkg.go.dev pages, and all GitHub artifacts.
limit: optional; 1–100, default 100. The current registry contains one source.cursor: unsupported. The source catalog does not page.source_id is currently go:docs.corpus values are papers and developer; the current source uses developer.state values are ready, refreshing, not_indexed, and degraded. A source stays not_indexed until a complete verified generation is promoted.operations values are search, metadata, read, references, and citers; the current source supports only search.filters values are authors, published_from, published_to, types, and version; the current source supports only types.artifact_types values are doc, readme, issue, and pull_request; the current source supports only doc.| Field | Filled in, of 1 checked | Values in the sample |
|---|---|---|
| source_id | 1 | |
| name | 1 | |
| corpus | 1 | |
| url | 1 | go.dev |
| state | 1 | |
| operations | 1 | median 1 entry |
| filters | 1 | median 1 entry |
| artifact_types | 1 | median 1 entry |
| last_success_at | 1 | 2026-10-09 |
| corpus_revision | 1 |
| Parameter | Type | Required | Default | Description | Example |
|---|---|---|---|---|---|
| Authorization (header) | string | No | Dashboard JWT in the form `Token <jwt>` (use this or x-api-key) | ||
| x-api-key (header) | string | No | API key (alternative to a dashboard JWT) | ||
| limit | integer | No | 100 | Maximum sources to return (1–100; defaults to 100) |
curl -X GET "https://api.crawlora.net/api/v1/developer/sources?limit=10" \ -H "x-api-key: $CRAWLORA_API_KEY"
{
"code": 200,
"msg": "Request successful",
"data": {
"items": [
{
"source_id": "go:docs",
"name": "Selected 18 verified Go documentation and specification pages",
"corpus": "developer",
"url": "https://go.dev/doc/",
"state": "not_indexed",
"operations": [
"search"
],
"filters": [
"types"
],
"artifact_types": [
"doc"
]
}
],
"next_cursor": "",
"has_more": false,
"registry_revision": "<sha256>"
}
}Request schema
No body schema
Response schema
#/definitions/developerretrieval.developerSourcesResponseDoc
| Field | Type | Required | Enum | Bounds | Example | Description |
|---|---|---|---|---|---|---|
| code | integer | No | 200 | |||
| data | developerretrieval.developerSourcesDataDoc | No | ||||
| data.has_more | boolean | No | ||||
| data.items | array | No | ||||
| data.items[].artifact_types | array | No | ||||
| data.items[].corpus | string | No | papers, developer | |||
| data.items[].corpus_revision | string | No | ||||
| data.items[].filters | array | No | ||||
| data.items[].last_success_at | string | No | ||||
| data.items[].name | string | No | ||||
| data.items[].operations | array | No | ||||
| data.items[].source_id | string | No | ||||
| data.items[].state | string | No | ready, refreshing, not_indexed, degraded | |||
| data.items[].url | string | No | ||||
| data.next_cursor | string | No | ||||
| data.registry_revision | string | No | ||||
| msg | string | No | Request successful |
| Status | Description | Schema |
|---|---|---|
| 400 | Invalid catalog query | #/definitions/app.Response |
| 401 | Authentication required | #/definitions/app.Response |
| 503 | Source catalog or index unavailable | #/definitions/app.Response |
Use environment variables for secrets and keep Crawlora API keys server-side.
curl -X GET "https://api.crawlora.net/api/v1/developer/sources?limit=10" \
-H "x-api-key: $CRAWLORA_API_KEY"