Category
12.1% of the 33 Search enginessites we tested run a managed anti-bot or WAF. That is a homepage-level reading — the listing, search, and account pages people actually scrape are usually more protected.
Vendors in this category
| Site | Protected | Anti-bot / WAF |
|---|---|---|
| ask.com | Open | — |
| baidu.com | Open | — |
| bing.com | Open | — |
| brave.com | Open | — |
| daum.net | Open | — |
| dogpile.com | Open | — |
| duckduckgo.com | Open | — |
| ecosia.org | Protected | Cloudflare |
| excite.com | Open | — |
| gibiru.com | Protected | Sucuri |
| google.ca | Open | — |
| google.co.in | Open | — |
| google.co.jp | Open | — |
| google.co.uk | Open | — |
| google.com | Open | — |
| google.com.au | Open | — |
| google.com.br | Open | — |
| google.de | Open | — |
| google.fr | Open | — |
| lycos.com | Open | — |
| metacrawler.com | Protected | Cloudflare |
| mojeek.com | Open | — |
| naver.com | Open | — |
| qwant.com | Open | — |
| searchencrypt.com | Open | — |
| seznam.cz | Open | — |
| sogou.com | Open | — |
| startpage.com | Open | — |
| swisscows.com | Open | — |
| webcrawler.com | Open | — |
| yahoo.com | Open | — |
| yandex.com | Open | — |
| yandex.ru | Open | — |
| you.com | Protected | Cloudflare |
Compare with the rest of the full Anti-Bot Adoption Index (of 960 reachable top sites, 55.6% are protected).