Crawlora
ProductPlatformsUse CasesDocsPricingCompareContact
Sign inTry Playground Console
Crawlora

Structured public web data APIs for search, maps, geocoding, streaming, travel, real estate, marketplaces, apps, social, audio, crypto, finance, and AI workflows with managed execution and credit-based usage.

Product

Web Scraping APIFeaturesPlatformsTravel APIsReal Estate APIsPricingReferral Program

Platforms

Google SearchGoogle MapsGoogle TrendsBing SearchAmazonLinkedInApple PodcastsZillowTripAdvisorShopifyAll platforms

Developers

DocsGetting StartedAPI ExamplesPlaygroundSDKsGitHub

Use cases

SERP MonitoringSERP Rank Checker APIGoogle Maps LeadsProperty Market IntelligenceAmazon Product MonitoringCrypto Market ResearchAI Agent Web DataAll use cases

Resources

Free Web ScraperAnti-Bot CheckerKeyword ResearchBlogChangelogAll free tools

Legal

ContactTermsPrivacy
Product
Web Scraping APIFeaturesPlatformsTravel APIsReal Estate APIsPricingReferral Program
Platforms
Google SearchGoogle MapsGoogle TrendsBing SearchAmazonLinkedInApple PodcastsZillowTripAdvisorShopifyAll platforms
Developers
DocsGetting StartedAPI ExamplesPlaygroundSDKsGitHub
Use cases
SERP MonitoringSERP Rank Checker APIGoogle Maps LeadsProperty Market IntelligenceAmazon Product MonitoringCrypto Market ResearchAI Agent Web DataAll use cases
Resources
Free Web ScraperAnti-Bot CheckerKeyword ResearchBlogChangelogAll free tools
Legal
ContactTermsPrivacy
© 2026 Crawlora. All rights reserved.·Built by Tony Wang
System statusCrawlora API status
  1. Home
  2. /Anti-Bot Adoption Index
  3. /Government

Category

Anti-bot on Government sites

33.3% of the 30 Governmentsites we tested run a managed anti-bot or WAF. That is a homepage-level reading — the listing, search, and account pages people actually scrape are usually more protected.

Check a URL Back to the index

Vendors in this category

Cloudflare5 sitesAkamai Bot Manager5 sites
The list

Government sites (36)

SiteProtectedAnti-bot / WAF
archives.gov Open—
bls.gov ProtectedAkamai Bot Manager
canada.ca Open—
cdc.gov Open—
census.gov ProtectedCloudflare
congress.gov ProtectedCloudflare
dhs.gov ProtectedAkamai Bot Manager
ed.gov Open—
energy.gov Open—
epa.gov Open—
europa.eu Open—
fbi.gov ProtectedCloudflare
fcc.gov Open—
fda.gov Open—
ftc.gov Open—
house.gov Open—
irs.gov ProtectedAkamai Bot Manager
justice.gov Open—
loc.gov ProtectedCloudflare
nasa.gov Open—
nih.gov ProtectedCloudflare
noaa.gov Open—
nps.gov Open—
sec.gov ProtectedAkamai Bot Manager
senate.gov Open—
service.gov.uk Open—
ssa.gov Open—
state.gov Open—
treasury.gov ProtectedAkamai Bot Manager
usa.gov Open—
usda.gov Open—
usgs.gov Open—
uspto.gov Open—
va.gov Open—
weather.gov Open—
whitehouse.gov Open—

Compare with the rest of the full Anti-Bot Adoption Index (of 960 reachable top sites, 55.6% are protected).