Crawlora
ProductPlatformsUse CasesDocsPricingCompareContact
Sign inTry Playground Console
Crawlora

Structured public web data APIs for search, maps, geocoding, streaming, travel, real estate, marketplaces, apps, social, audio, crypto, finance, and AI workflows with managed execution and credit-based usage.

Product

Web Scraping APIFeaturesPlatformsTravel APIsReal Estate APIsPricingReferral Program

Platforms

Google SearchGoogle MapsGoogle TrendsBing SearchAmazonLinkedInApple PodcastsZillowTripAdvisorShopifyAll platforms

Developers

DocsGetting StartedAPI ExamplesPlaygroundSDKsGitHub

Use cases

SERP MonitoringSERP Rank Checker APIGoogle Maps LeadsProperty Market IntelligenceAmazon Product MonitoringCrypto Market ResearchAI Agent Web DataAll use cases

Resources

Free Web ScraperAnti-Bot CheckerKeyword ResearchBlogChangelogAll free tools

Legal

ContactTermsPrivacy
Product
Web Scraping APIFeaturesPlatformsTravel APIsReal Estate APIsPricingReferral Program
Platforms
Google SearchGoogle MapsGoogle TrendsBing SearchAmazonLinkedInApple PodcastsZillowTripAdvisorShopifyAll platforms
Developers
DocsGetting StartedAPI ExamplesPlaygroundSDKsGitHub
Use cases
SERP MonitoringSERP Rank Checker APIGoogle Maps LeadsProperty Market IntelligenceAmazon Product MonitoringCrypto Market ResearchAI Agent Web DataAll use cases
Resources
Free Web ScraperAnti-Bot CheckerKeyword ResearchBlogChangelogAll free tools
Legal
ContactTermsPrivacy
© 2026 Crawlora. All rights reserved.·Built by Tony Wang
System statusCrawlora API status
  1. Home
  2. /Anti-Bot Adoption Index
  3. /Reference & wiki

Category

Anti-bot on Reference & wiki sites

63.9% of the 36 Reference & wikisites we tested run a managed anti-bot or WAF. That is a homepage-level reading — the listing, search, and account pages people actually scrape are usually more protected.

Check a URL Back to the index

Vendors in this category

Cloudflare20 sitesGoogle reCAPTCHA5 sitesImperva (Incapsula)3 sites
The list

Reference & wiki sites (36)

SiteProtectedAnti-bot / WAF
ancestry.com ProtectedCloudflare
britannica.com ProtectedCloudflare
cambridge.org ProtectedCloudflare
collinsdictionary.com ProtectedCloudflare
deepl.com ProtectedCloudflare
dictionary.com ProtectedCloudflare + 1 more
encyclopedia.com ProtectedCloudflare
etymonline.com ProtectedCloudflare
familysearch.org ProtectedImperva (Incapsula)
fandom.com ProtectedCloudflare
findagrave.com ProtectedCloudflare
geni.com ProtectedImperva (Incapsula)
goodreads.com ProtectedCloudflare
infoplease.com ProtectedCloudflare
investopedia.com ProtectedCloudflare
librarything.com ProtectedCloudflare
linguee.com Open—
merriam-webster.com ProtectedCloudflare
myheritage.com ProtectedImperva (Incapsula) + 1 more
openlibrary.org Open—
reference.com Open—
thesaurus.com ProtectedCloudflare + 1 more
tvtropes.org ProtectedCloudflare
urbandictionary.com OpenGoogle reCAPTCHA
vocabulary.com ProtectedCloudflare + 1 more
wikibooks.org Open—
wikidata.org Open—
wikihow.com Open—
wikimedia.org Open—
wikipedia.org Open—
wikiquote.org Open—
wikisource.org Open—
wikitravel.org ProtectedCloudflare
wiktionary.org Open—
wordreference.com Open—
worldcat.org ProtectedCloudflare

Compare with the rest of the full Anti-Bot Adoption Index (of 960 reachable top sites, 55.6% are protected).