Data study · June 15, 2026
We probed 9,992,781 of the world’s most popular domains and labelled each one alive, redirect, blocked, or dead. The real dead figure is 14.1% — not the 27.6% a naive crawl reports, because most of “dead” is just blocking you.
14.1%
of the 9,992,781 probed top domains are genuinely dead — gone from DNS or refusing every connection.
8.9%
answer but block bots
1.1%
of responders are parked
Homepage-level reachability from a datacenter IP — a lower bound.
14.1%
of the 9,992,781 probed domains are genuinely dead — no DNS, no connection, nothing answers. That is the real dead-web figure, not the 27.6% a naive crawl reports.
8.9%
answer but block automated clients (403/429/challenge) from a datacenter IP — alive, just not to a bot. Naive scans count these as dead.
10.3%
of all domains no longer resolve in DNS — the dominant cause of true death, 1,027,492 domains gone dark.
33%
.cn is the deadest common TLD — institutional and cheap-registration TLDs rot fastest, well above the .com baseline.
Every probed domain, by outcome
A naive 2024 crawl of the same top-10M list reported 27.6% dead. Probe honestly — separating genuine death from anti-bot blocking and answered errors — and the real figure is 14.1%. Here is where the difference goes.
DNS failure, anti-bot 403s, 404/5xx and timeouts all lumped together
No DNS, connection refused, or nothing accepts a connection
Where the “dead” really goes
The same domains, probed by an honest bot and by a browser-like client (real Chrome TLS/JA3). Where the browser column is lower on dead/blocked, the site is reachable — the bot just wasn't let in.
| Probe arm | Probed | Alive | Blocked | Dead | Dead % |
|---|---|---|---|---|---|
| Polite bot | 9,992,781 | 7,657,422 | 891,517 | 1,412,544 | 14.1% |
| Reachability (browser) | 9,997,315 | 7,743,245 | 819,599 | 1,412,889 | 14.1% |
| China (.cn) | 33% |
| India (.in) | 25.8% |
| United States of America (.us) | 22% |
| Brazil (.br) | 20.9% |
| Spain (.es) | 16.6% |
| Japan (.jp) | 15.6% |
| United Kingdom (.uk) | 15.3% |
| Australia (.au) | 15% |
| Russia (.ru) | 14.8% |
| France (.fr) | 14.5% |
| Canada (.ca) | 14.1% |
| Italy (.it) | 13.5% |
| Poland (.pl) | 13.1% |
| Sweden (.se) | 11.6% |
| Switzerland (.ch) | 9.8% |
| Netherlands (.nl) | 9.7% |
| Austria (.at) | 8.6% |
| Germany (.de) | 7.6% |
| Czechia (.cz) | 7.2% |
The gap between 27.6% and 14.2% is mostly a measurement choice. A crawler that stops at the first response sees only 45.9% return a clean 200; follow the redirects and read the bodies, and 71.9% are alive. Here is where every first response ends up.
| 200 OK → Alive | 4,584,611 (46.3%) |
| 3xx redirect → Alive | 2,677,304 (27%) |
| No response → Dead | 1,413,013 (14.3%) |
| 403 / 429 → Blocked | 410,511 (4.1%) |
| 3xx redirect → Blocked | 365,368 (3.7%) |
| 404 → Alive | 236,685 (2.4%) |
| No response → Blocked | 105,222 (1.1%) |
| 5xx → Alive | 85,728 (0.9%) |
| 3xx redirect → Redirect | 31,267 (0.3%) |
| 3xx redirect → Dead | 1,775 (0%) |
Split the 10 million by popularity and the dead rate climbs more than 20× — from 0.8% in the top 1,000 to 16.1% past rank 5 million — while blocked runs the other way, peaking at the popular head.
99.8% of dead domains sit below rank 100,000. The popular top-100K — where most web traffic lives — is only 2.2% dead, so weighted by attention the dead web nearly disappears: 14.2% of the top 10M by domain count, but only about 3% weighted by traffic:
share of the top 10M that are dead
the popular top-100K is only 2.2% dead
The same figures behind the charts above, as plain HTML tables — easy to copy, and machine-readable for search engines and AI answer engines that can't parse a chart.
| TLD | Domains | Dead | Dead % |
|---|---|---|---|
| .com | 4,403,688 | 563,545 | 12.8% |
| .org | 878,764 | 114,092 | 13% |
| .io | 363,234 | 10,113 | 2.8% |
| .de | 348,251 | 26,446 | 7.6% |
| .net | 347,414 | 69,151 | 19.9% |
| .ru | 301,639 | 44,780 | 14.8% |
| .jp | 253,187 | 39,563 | 15.6% |
| .uk | 244,776 | 37,525 | 15.3% |
| .fr | 135,021 | 19,567 | 14.5% |
| .edu | 128,968 | 28,357 | 22% |
| .it | 107,638 | 14,564 | 13.5% |
| .ca | 106,814 | 15,023 | 14.1% |
| .br | 99,202 | 20,693 | 20.9% |
| .au | 92,764 | 13,883 | 15% |
| .nl | 86,383 | 8,400 | 9.7% |
| .pl | 70,063 | 9,212 | 13.1% |
| .es | 67,984 | 11,305 | 16.6% |
| .eu | 67,354 | 10,582 | 15.7% |
| .ch | 64,850 | 6,350 | 9.8% |
| .in | 63,614 | 16,442 | 25.8% |
| .info | 61,440 | 17,362 | 28.3% |
| .co | 60,670 | 9,264 | 15.3% |
| .cz | 53,177 | 3,853 | 7.2% |
| .app | 48,858 | 2,054 | 4.2% |
| .se | 46,523 | 5,398 | 11.6% |
| .gov | 43,435 | 11,251 | 25.9% |
| .at | 43,092 | 3,696 | 8.6% |
| .cn | 42,827 | 14,144 | 33% |
| .us | 41,645 | 9,146 | 22% |
| .me | 39,043 | 5,501 | 14.1% |
| Failure reason | Domains |
|---|---|
| ok | 7,195,864 |
| dns_failed | 1,027,492 |
| timeout | 441,714 |
| forbidden | 441,603 |
| not_found | 294,610 |
| tls_error | 192,304 |
| server_error | 128,756 |
| rate_limited | 86,240 |
| connection_error | 75,364 |
| client_error | 38,180 |
| redirect | 18,761 |
| connection_refused | 17,453 |
| too_many_redirects | 12,537 |
| auth_required | 9,527 |
| connection_reset | 6,879 |
| anti_bot | 5,154 |
| unavailable_legal | 330 |
| Outcome | Domains |
|---|---|
| alive | 7,657,422 |
| dead | 1,412,544 |
| blocked | 891,517 |
| redirect | 31,298 |
| Rank band | Dead % | Blocked % |
|---|---|---|
| Top 1K | 0.8% | 12.9% |
| 1K–10K | 1.2% | 15.1% |
| 10K–100K | 2.3% | 10.8% |
| 100K–1M | 8.7% | 9.3% |
| 1M–5M | 13.3% | 9.3% |
| 5M–10M |
Search, filter by outcome, switch the probe arm, and sort. The full dataset is on GitHub. Click a domain to see how each arm fared.
| Rank | Domain | Outcome | Reason | Status | Final URL |
|---|---|---|---|---|---|
| 7,653 | ordnet.dk | Alive | ok | 200 | https://ordnet.dk |
| 7,654 | iol.co.za | Blocked | forbidden | 403 | https://iol.co.za |
| 7,655 | www.ftc.go.kr | Alive | ok | 200 | https://www.ftc.go.kr |
| 7,656 | www.chubb.com | Alive | ok | 200 | https://www.chubb.com/us-en/ |
| 7,657 | www.theparisreview.org | Alive | ok | 200 | https://www.theparisreview.org |
| 7,658 | www.sf-express.com | Alive | ok | 200 | https://www.sf-express.com |
| 7,659 | www.photopea.com | Alive | ok | 200 | https://www.photopea.com |
| 7,660 | www.uni-wuerzburg.de | Alive | ok | 200 | https://www.uni-wuerzburg.de |
| 7,661 | moodle.com | Alive | ok | 200 | https://moodle.com/ |
| 7,662 | webpagetest.org | Blocked | forbidden | 403 | https://www.webpagetest.org/ |
| 7,663 | www.uab.cat | Alive | ok | 200 | https://www.uab.cat |
| 7,664 | cryptpad.fr | Alive | ok | 200 | https://cryptpad.fr |
| 7,665 | www.aps.anl.gov | Alive | ok | 200 | https://www.aps.anl.gov |
| 7,666 | climate.ec.europa.eu | Alive | ok | 200 | https://climate.ec.europa.eu/select-language?destination=/node/1 |
| 7,667 | www.motorsportmagazine.com | Alive | ok | 200 | https://www.motorsportmagazine.com |
| 7,668 | www.telerama.fr | Alive | ok | 200 | https://www.telerama.fr |
| 7,669 | www.planet.com | Alive | ok | 200 | https://www.planet.com |
| 7,670 | pjmedia.com | Alive | ok | 200 | https://pjmedia.com |
| 7,671 | cffi.readthedocs.org | Alive | ok | 200 | https://cffi.readthedocs.io/en/stable/ |
| 7,672 | blog.yelp.com | Alive | ok | 200 | https://blog.yelp.com |
| 7,673 | www.band.us | Alive | ok | 200 | https://www.band.us |
| 7,674 | www.kickresume.com | Alive | ok | 200 | https://www.kickresume.com/en/ |
| 7,675 | www.cyclingnews.com | Alive | ok | 200 | https://www.cyclingnews.com |
| 7,676 | www.shortform.com | Alive | ok | 200 | https://www.shortform.com |
| 7,677 | buildbot.pypy.org | Alive | ok | 200 | https://buildbot.pypy.org |
| 7,678 | www.daad.de | Alive | ok | 200 | https://www.daad.de/de/ |
| 7,679 | sifted.eu | Alive | ok | 200 | https://sifted.eu |
| 7,680 | www.etihad.com | Blocked | timeout | — | — |
| 7,681 | www.cac.gov.cn | Alive | ok | 200 | https://www.cac.gov.cn |
| 7,682 | simplywall.st | Alive | ok | 200 | https://simplywall.st |
| 7,683 | www.fox29.com | Alive | ok | 200 | https://www.fox29.com |
| 7,684 | www.emailmonday.com | Alive | ok | 200 | https://www.emailmonday.com |
| 7,685 | www.sabah.com.tr | Alive | ok | 200 | https://www.sabah.com.tr |
| 7,686 | freeicons.io | Blocked | forbidden | 403 | https://freeicons.io |
| 7,687 | indeed.com | Blocked | forbidden | 403 | https://indeed.com |
| 7,688 | today.yougov.com | Alive | ok | 200 | https://yougov.com/en-us/ |
| 7,689 | www.du.ae | Alive | ok | 200 | https://www.du.ae/personal |
| 7,690 | agora.xtec.cat | Alive | ok | 200 | https://educaciodigital.cat/moodle/moodle/ |
| 7,691 | www.pandadoc.com | Alive | ok | 200 | https://www.pandadoc.com |
| 7,692 | www.mturk.com | Alive | ok | 200 | https://www.mturk.com |
| 7,693 | www.wnycstudios.org | Alive | ok | 200 | https://www.wnycstudios.org/ |
| 7,694 | www.nexmo.com | Blocked | forbidden | 403 | https://www.vonage.com:443/ |
| 7,695 | www.sup.org | Blocked | rate_limited | 429 | https://www.sup.org |
| 7,696 | www.bankofcanada.ca | Alive | ok | 200 | https://www.bankofcanada.ca |
| 7,697 | www.bhg.com | Alive | client_error | 402 | https://www.bhg.com |
| 7,698 | www.rpi.edu | Alive | ok | 200 | https://www.rpi.edu/ |
| 7,699 | open.alberta.ca | Alive | ok | 200 | https://www.alberta.ca/open-government-program |
| 7,700 | www.sei.cmu.edu | Alive | ok | 200 | https://www.sei.cmu.edu |
| 7,701 | www.octopus.com.hk | Alive | ok | 200 | https://www.octopus.com.hk/tc/consumer/index.html |
| 7,702 | www.public.asu.edu | Alive | ok | 200 | https://asu.cloudflareaccess.com/cdn-cgi/access/login/www.public.asu.edu?kid=81a38d784ecf9d4637ce20c94540044d94ff2f3fae77275d6c4da1773d0da4af&meta=eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6IjA0YjVhYzFlMDU2NGQ3ZWFiYmUxYjE1ZTFkYmIxOWNiYjUyNDRiNGIzYjQ2MWM4OWRiNWRkMzgzZjdmOGFiOTMifQ.eyJ0eXBlIjoibWV0YSIsImF1ZCI6IjgxYTM4ZDc4NGVjZjlkNDYzN2NlMjBjOTQ1NDAwNDRkOTRmZjJmM2ZhZTc3Mjc1ZDZjNGRhMTc3M2QwZGE0YWYiLCJob3N0bmFtZSI6Ind3dy5wdWJsaWMuYXN1LmVkdSIsInJlZGlyZWN0X3VybCI6Ii8iLCJzZXJ2aWNlX3Rva2VuX3N0YXR1cyI6ZmFsc2UsImlzX3dhcnAiOmZhbHNlLCJpc19nYXRld2F5IjpmYWxzZSwiZXhwIjoxNzgxNTI1NzU0LCJuYmYiOjE3ODE1MjU0NTQsImlhdCI6MTc4MTUyNTQ1NCwiYXV0aF9zdGF0dXMiOiJOT05FIiwibXRsc19hdXRoIjp7ImNlcnRfaXNzdWVyX2RuIjoiIiwiY2VydF9zZXJpYWwiOiIiLCJjZXJ0X2lzc3Vlcl9za2kiOiIiLCJjZXJ0X3ByZXNlbnRlZCI6ZmFsc2UsImNvbW1vbl9uYW1lIjoiIiwiYXV0aF9zdGF0dXMiOiJOT05FIn0sInJlYWxfY291bnRyeSI6IlVTIiwiYXBwX3Nlc3Npb25faGFzaCI6ImEwMTAzMzQ2YzEwZDEzNDZjZmQxNWNkNDlkMmUxZjQ3MGVlY2IxNDcxNjNjZDY4YTgzNDFlM2RiOTgyNGUxZDMifQ.Seg3Cn-6NRVK2cdkEL4h1JbBCYfkrK4bPMgL-wCDbbdTukg0tLPvS3pOoisHZfD6myQsDc62QRk0ReoCwANyy7eivgwdA5YdC-cdVxlsCbrHQaRU8Lh5maR4N9bczPlCAYn377gFlsK_vqJu6kkDIT-B3PGIW7O0QY2j3Q2VDlqfeh6tczt-WBjFeGahh-3HQQhcu86bneXvyoES12uW6r3vdi9PJel30VhYvDeeQN2IdrycntFHd8KP2zndiK7T5hxuaTrRMPIlefjeNhMf6S0S3aVg2ai6AUE-oW1RV9MNuT3XDWyvBV3Lb80okH6mvwcjcSNyC_Px5RDFGxd45Q&redirect_url=%2F |
We probe a top-popularity domain list HTTPS-first from a datacenter IP, following redirects, and label each domain alive, redirect, blocked, or dead by the evidence the probe captures — a final HTTP status, or a transport error plus whether a raw TCP connect still succeeds. A served 404, a 5xx, or a Cloudflare 52x is alive (the host answered); a 403/429 or anti-bot challenge is blocked; only no DNS, a refused/reset connection, or nothing accepting a connection is dead. Every domain is probed twice — as a polite bot and as a browser-like client (real Chrome TLS/JA3) — and the full per-domain dataset is open.
This measures whether the domain itself still resolves and answers — a different question from Pew Research’s 2024 link-rot study (25% of pages from 2013–2023 are gone; 38% of 2013 pages) and Ahrefs’ link-rot study (66.5% of links have rotted), which measure broken links insideliving pages. It is also not the “dead internet theory” — that is a claim about AI-generated content, not domain reachability.
Cite this
Crawlora (2026). Dead-Web Index 2026. 14.1% of 9,992,781 top domains are genuinely dead; 8.9% answer but block automated clients. https://crawlora.net/dead-web-index.
14.1% of the top 9,992,781 domains are genuinely dead — about 1,412,544 sites that no longer resolve in DNS or refuse every connection. That is far below the often-quoted "27.6% of the web is dead," which counted anti-bot blocks and answered errors as death.
A dead site never answers — no DNS record, or nothing accepts a TCP connection. A blocked site is alive and answering, it just refuses an automated client (a 403, 429, or anti-bot challenge). 8.9% of the top web (891,517 sites) is blocked, not dead — a distinction naive crawlers miss.
No. The dead internet theory is a claim that AI-generated content and bots have replaced human activity on the living web. This index measures the opposite and concrete thing: how many domains have gone completely dark and unreachable — DNS gone, connection refused, server gone.
Earlier top-10M crawls counted three non-dead things as dead: anti-bot 403/429 blocks, 404/5xx pages served by a live server, and domains a single flaky DNS resolver failed to look up. Classifying honestly — dead means genuinely unreachable — brings the real figure to 14.1%.
.cn has the highest death rate among common TLDs at 33%. Institutional TLDs like .gov and .edu also rank high — matching Pew Research's finding that government and reference pages suffer the worst link rot.
Anti-bot systems (Cloudflare, DataDome, and others) serve a 403 or a challenge to a datacenter IP while letting a real browser through. A matched browser TLS/JA3 fingerprint reaches the site where a naive bot is blocked — which is exactly why this index probes every domain twice, as a polite bot and as a browser-like client.
8.9% of the top web answers but blocks a naive bot. Crawlora escalates from a plain request to a real browser fingerprint only as far as a site demands, and bills on success — so you reach the live web that the 14.1% genuine dead doesn’t include.
| informational | 12 |
| unknown | 1 |
| 16.1% |
| 8.5% |