Crawlora Changelog

Added the customer referral flow, reward tracking, and review controls needed to run referral campaigns from signup through approval.

• Referral links now carry through signup so customers can invite other teams.
• Console and admin surfaces support reviewing referral activity and reward state.
• Billing and usage views have the referral context needed for account-level follow-up.

Improved the execution path for public pages that need browser rendering or extra challenge handling before structured data can be extracted.

• Expanded browser-backed execution coverage for harder upstream pages.
• Improved fallback behavior so API responses fail more transparently when an upstream page cannot be used.
• Documented the reliability lessons that matter for future endpoint work.

Expanded audio and podcast coverage with more Spotify surfaces and synchronized the public catalog so Docs, Playground, and pricing stay aligned.

• Added more Spotify profile, playlist, podcast, chart, and recommendation coverage.
• Synced the endpoint catalog into public Docs, Playground, pricing, and platform pages.
• Updated monitoring coverage for newly documented API surfaces after rollout.

Polished public API discovery pages so endpoint families, platform groups, and filters are easier to scan on desktop and mobile.

• Improved Docs filtering layout and platform group grids.
• Tightened homepage and product page sections around real endpoint examples.
• Added regression coverage for public page layout and catalog synchronization.

Expanded infrastructure health coverage, recovery guidance, and cleanup automation for service-critical platform components.

• Added alerts for resource pressure that can affect public API availability.
• Improved recovery guidance for service health issues after infrastructure churn.
• Added cleanup automation for long-running observability data so health checks stay responsive.

Consolidated marketing navigation and feature pages around the API capabilities customers evaluate before integration.

• Grouped infrastructure features into a clearer product feature hub.
• Made the homepage endpoint example visible by default.
• Connected feature pages to Docs, pricing, Playground, and supported platforms.

Improved public site quality checks and moved mutable site settings into a safer runtime configuration path.

• Added stronger preview quality checks for public pages.
• Separated runtime settings from the built site where possible.
• Normalized public host references across site pages and examples.

Improved how customers can check Crawlora service status from public pages and subscribe to operational updates.

• Added a public status signal to the site footer.
• Improved the public status page feed experience.
• Kept status checks lightweight for faster public page loads.

Added public build metadata, preview restart shortcuts, and hosted preview support for faster site verification.

• Added a public freshness signal for the running site build.
• Improved preview restart ergonomics for public-page review.
• Allowed hosted preview checks to work cleanly during site development.

Refined public Playground routing and indexing behavior so clean endpoint pages are discoverable while private app routes stay out of search results.

• Improved clean public Playground routes for endpoint-specific testing.
• Kept authenticated app routes separate from public discovery.
• Added coverage for public indexing rules and endpoint route generation.

Expanded the public website into a more complete evaluation path for buyers and developers.

• Added feature, comparison, use-case, pricing, and developer guide pages.
• Aligned the web scraping API overview with real docs and samples.
• Improved public metadata and route coverage for organic discovery.

Added and exercised browser backend options used by harder endpoint families that need a rendered page before extraction.

• Expanded browser backend choices for difficult public pages.
• Improved service routing for rendered extraction paths.
• Kept API availability checks aligned with the new browser-backed paths.

Improved sign-in options, account profile presentation, and layout resilience across public platform pages.

• Added social sign-in support and account profile avatars.
• Hardened platform landing pages against layout overflow.
• Improved form behavior around API key fields and browser autofill.

Improved billing actions, active key visibility, usage period defaults, and pricing-to-console handoff.

• Connected pricing plan actions to billing workflows.
• Improved active API key selection and display in Playground and console pages.
• Defaulted usage views to the current billing period for more relevant reporting.

Aligned public domains, frontend routing, API host references, and MCP access points around the Crawlora brand.

• Moved public examples and site links onto Crawlora hostnames.
• Exposed MCP access from the public product surface.
• Linked pricing and billing flows more directly from the public site.

Strengthened session restore, auth-state loading, Playground parameter feedback, and API key workflows.

• Preserved sign-in status across browser refreshes and restarts.
• Clarified request parameter errors and sample response handling in Playground.
• Added focused loading states for overview, API key, and usage sections.

Reworked the homepage, platform pages, footer links, and docs metadata around the live public catalog.

• Made homepage sections catalog-driven with product endpoint examples.
• Added platform landing pages and footer navigation for supported public surfaces.
• Improved API contract metadata for docs, Playground, and agent-facing surfaces.

Added reliability checks, clearer failure classifications, and endpoint deprecation practices for older surfaces.

• Added scraper reliability auditing and guardrails.
• Clarified behavior for deprecated endpoint families.
• Documented lessons for browser-backed and stealth-sensitive endpoint work.

Improved documentation consistency, deprecated endpoint UX, and admin repair paths used during catalog maintenance.

• Improved docs cross-links and catalog consistency.
• Made retired endpoint states easier to understand.
• Added clearer repair paths for maintaining endpoint metadata.

Improved schema views, Playground forms, billing previews, and admin dashboards for day-to-day operations.

• Enhanced Playground discovery, forms, and schema inspection.
• Improved billing preview and admin data flows.
• Added clearer operational filters for console workflows.

Launched the first Crawlora web experience with public marketing pages, dashboard foundations, and console workflows.

• Added the first public site and console experience.
• Introduced dashboard pages for account and API usage workflows.
• Hardened sensitive console flows before broader public use.

Added the public status foundation and expanded route monitoring around the public API surface.

• Added a public status foundation for customer-facing service checks.
• Improved public API route monitoring and hostname checks.
• Expanded startup and availability budgets for smoother service updates.

Expanded service monitoring, public routing checks, and operational dashboards around the Crawlora API surface.

• Added application metrics and alert coverage for API health.
• Improved public route checks for customer-facing endpoints.
• Expanded dashboards for capacity, traffic, and service health.

Expanded professional network and web intelligence endpoints for company research and competitive analysis.

• Added broader LinkedIn company, product, and profile coverage.
• Expanded web intelligence search and detail surfaces.
• Updated public docs around the new business research coverage.

Strengthened the authenticated request path and broadened test coverage around important API contracts.

• Added static API key support for production-style requests.
• Broadened core endpoint test coverage.
• Added focused parsing checks for Google Maps search behavior.

Improved source quality reporting, validation throughput, and traffic accounting for the extraction network.

• Added source quality reporting for network inputs.
• Improved validation scheduling and throughput measurement.
• Persisted traffic and source refresh counters for clearer operational review.

Added mobile app store endpoint families with docs, examples, and integration coverage.

• Added App Store scraper APIs and documentation.
• Added Google Play scraper APIs, examples, and handler coverage.
• Expanded service and integration tests for mobile app data workflows.

Refreshed search endpoint behavior and browser impersonation support for search result extraction.

• Adjusted Google Search extraction for upstream changes.
• Improved browser impersonation support for harder pages.
• Kept search result parsing aligned with current page behavior.

Added Instagram profile, post, and reel coverage with documentation for social data use cases.

• Added Instagram profile extraction.
• Added post and reel coverage.
• Documented social endpoint behavior for developers.

Expanded YouTube transcript and community data alongside Product Hunt search and product discovery endpoints.

• Added YouTube caption, comment, and tag coverage.
• Added Product Hunt product and user search coverage.
• Improved docs for product discovery workflows.

Added Crunchbase organization and person coverage plus YouTube subtitle extraction for research workflows.

• Added company and person research endpoints.
• Added YouTube subtitle extraction.
• Expanded worker-backed enrichment for business data.

Expanded local business enrichment with business type, contact, status, and place data improvements.

• Added business type and place enrichment.
• Expanded website status and contact enrichment workflows.
• Improved Google Maps place and search behavior for local business research.

Expanded TikTok search, creator, hashtag, trend, and video data for social intelligence workflows.

• Added TikTok search user and trending documentation.
• Added creator and hashtag trend coverage.
• Expanded popular trend video and hashtag detail APIs.

Added Google Maps search coverage, documentation, and usage monitoring improvements.

• Added Google Maps search and place extraction.
• Updated documentation for local business workflows.
• Improved API usage monitoring around authenticated requests.

Added API usage monitoring and account identity improvements that later supported console billing and usage pages.

• Added API usage monitoring foundations.
• Added account email and username fields.
• Improved notification handling for account events.

Expanded endpoint families across Google Finance, Amazon, TikTok, Similarweb, and general web parsing.

• Added finance search, ticker, quote, income statement, balance sheet, cash flow, and crypto coverage.
• Added Amazon suggestion, search, and product improvements.
• Added TikTok post, comment, category, explore, and trending coverage.

Added LinkedIn endpoint coverage for people, schools, products, and jobs.

• Added LinkedIn people and school data extraction.
• Added LinkedIn product page coverage.
• Added LinkedIn job data coverage for recruiting and market research workflows.

Added Google Search, News, Image, and Shopping extraction with API documentation.

• Added Google Search result extraction.
• Added Google News and Image Search coverage.
• Added Google Shopping search and detail coverage.

Added sign-in, sign-up, rate limiting, metrics, and the first structured API documentation updates.

• Added account sign-in and sign-up foundations.
• Added rate limiting for fair API usage.
• Added metrics and documentation updates for early API consumers.

Started the platform foundation that later powered endpoint coverage, availability checks, and structured API delivery.

• Established early network validation and peer health workflows.
• Added the first operational building blocks for high-volume extraction.
• Created the base that later supported public API endpoints and monitoring.