Web Catalog · established 2011 Full Information About Any website
Straight to the entry
The reference section

Website Data Explained: whois Records, DNS Records and the Numbers Estimated From Outside

Eleven reference pages, built from the record outwards: what each field is, what it is not, and the specific mistake it invites.

11 reference pages 3 browser decoders Sources dated per page
One object shown as three concentric shells: an inner registry core, a middle routing shell and an outer measurement halo.

Website data is not one thing. It arrives from three different places, with three different levels of reliability, and no error recurs here more often than quoting one as though it were another. A registration date and a monthly-visits estimate are both website data, but one is a fact recorded by the party responsible for it and the other is a projection from a sample. Treating them alike produces confident nonsense.

The whois layer: what a registry publishes

The first layer is the registry. When a domain is registered, the registry records a small, fixed set of facts about it, and publishes most of them. That publication is the whois record, and its modern structured form is the RDAP response. Between them they carry the creation date, the date the record was last modified, the expiry date, the sponsoring registrar, a set of status codes and the nameservers the domain is delegated to.

This layer is authoritative in the narrowest possible sense: it is correct about what it covers and silent about everything else. A whois record will tell you, beyond argument, that a domain was created on a particular day. It will not tell you whether anything has ever been published on it. The most useful field is also the least discussed: the last-changed date, which moves whenever the registration is materially touched, and which is therefore the field that betrays a domain that has quietly changed hands.

DNS: how a name becomes an address

The second layer is resolution. A registration is an entry in a ledger; it does not, by itself, make anything reachable. That job belongs to DNS, and specifically to the DNS records published in the domain's zone. Seven types account for nearly everything anyone needs to read: A and AAAA for addresses, NS for delegation, MX for mail, TXT for verification and policy, CNAME for aliases, and SOA for the zone's own parameters.

The layer above them is delegation, and it produces the single most misread state in this whole subject. A domain can be registered, paid for and entirely valid while having no nameservers at all. It then resolves to nothing, and most tools report it exactly as they report a name that was never registered. Reading that as "available" is wrong, and it is wrong in a way that costs money.

Which records are authoritative and which are estimates

The third layer is measurement, and nothing in it is published by the site. Traffic figures, authority scores and safety ratings are all produced by third parties who never see the server logs. Traffic estimation works from panels and clickstreams, extrapolated by models that each vendor keeps to itself, which is why two reputable tools routinely disagree about the same site by a factor of five.

Authority metrics, DR, DA, AS, PA, are logarithmic scores computed over link graphs that no two vendors crawl identically. They are useful for comparison and worthless as absolutes. Backlinks and referring domains are the raw material underneath them, and the distinction that matters most there is the one people skip: the most valuable citations on the web, the ones from reference works, pass no ranking signal at all.

Website data that nobody publishes any more

The awkward part of any honest guide to website data is how much of the measurement layer has closed. Alexa Rank ran from 1996 to 2022 and was quoted in press releases, pitch decks and academic papers as though it were a census; it was a toolbar panel. Compete closed in 2016. Yahoo Site Explorer, the last free public backlink index, closed in 2011. SiteAdvisor and Web of Trust, which between them defined site reputation for a decade, are both gone.

That matters for reading old sources. A citation to an Alexa rank is not wrong, it is unverifiable, and the difference is worth stating, which is why how this catalog is written makes it a rule rather than a preference. The dated report on closed measurement tools collects the whole list. And the last page in this section, robots.txt and crawl limits, explains why the kind of open bulk querying that fed those tools is no longer something a catalogue can simply do.

A solid engraved block beside a soft edgeless cloud of scattered marks, separated by a thin rule: authoritative record against outside estimate.
The dividing line that runs through this whole section: on one side what a registry or a zone publishes, on the other what a third party estimates from a sample.
All eleven pages

The reference index

In reading order. Each page ends with the next one, so the section can be read straight through or opened at any point.

The whois record

Every field a registry publishes, what each one means, and which of them GDPR removed from public view.

Read

Reading an RDAP response

The structured successor to whois, field by field, plus the one date that proves a domain changed hands.

Read

DNS record types

A, AAAA, NS, MX, TXT, CNAME and SOA, each with a real example and the mistake people make with it.

Read

Nameservers and delegation

How authority is handed down the tree, and why a registered domain can resolve to nothing at all.

Read

The domain lifecycle

Five windows after expiry: grace, redemption, pending delete and the drop, each with its own rules.

Read

How traffic is estimated

Panels, clickstreams and modelled extrapolation: why two tools give one site two very different numbers.

Read

Alexa Rank, 1996 to 2022

What the number actually measured, why it was quoted everywhere, and what its closure removed.

Read

Site safety and reputation

What SiteAdvisor and Web of Trust did, and which checks are worth running in their place.

Read

Backlinks and referring domains

Links, domains, follow and nofollow, plus why the most valuable citations pass no ranking signal.

Read

Authority metrics compared

DR, DA, AS and PA side by side: what each is built from, and what none of them can tell you.

Read

robots.txt and crawl limits

The file every crawler reads first, what it can and cannot enforce, and where scraping stops being allowed.

Read
Decoders

Read a record you already have

Three browser tools that name and explain the fields these pages describe. Nothing is uploaded and nothing is stored.

Record field decoder

Paste a whois or RDAP block and get every field named and explained, line by line.

Open

DNS record decoder

Paste one zone-file line and see each of its parts separated and identified.

Open

Lifecycle calculator

Enter an expiry date and read the grace, redemption, pending-delete and drop windows that follow.

Open

Frequently asked questions

What counts as website data?

Anything published or estimated about a domain and the site on it. Published website data comes from the registry, the whois record and its RDAP equivalent, and from the zone, where DNS records live. Estimated website data comes from third parties who never see the server: traffic figures, authority scores and reputation ratings. The first kind is authoritative and narrow. The second kind is broad and unverifiable.

Which website data is authoritative?

Only what the registry and the zone publish. A whois record is authoritative about registration dates, status codes and delegation because the registry is the party that sets them. DNS records are authoritative about where a name points because the nameservers are the party that answers for it. Everything else, traffic, authority, safety scores, is modelled from samples and should be quoted with its source.

Can I look up a domain from this page?

No. This is a reference section, not a lookup service. It explains what each field in a whois record means, what each of the DNS records does, and how the estimated numbers are produced. The three decoders will name and explain the fields in a record you already have, entirely inside your own browser.

Why does so much of this section describe closed services?

Because the free measurement layer of the web largely shut down between 2011 and 2023. Any honest guide to website data has to say which sources still answer and which do not. Alexa, Compete, Yahoo Site Explorer, SiteAdvisor and Web of Trust are all named here with the year they closed, so a decade of citations pointing at them can be read correctly.