Skip to content
Plumb
Light theme onCheck a URL

DocsRendering

Pre-rendering Tester

See what each user agent is served: compare the status, title, canonical, robots directives and text a page returns to crawlers with what a browser shows, before and after JavaScript.
  • Up to 30 user agents
  • Browsers rendered in Chromium
  • Text similarity
  • JSON API

What it Checks

Dynamic rendering serves crawlers a pre-rendered HTML page and browsers the JavaScript app. The tester requests the URL once per user agent you select, without running JavaScript, as a crawler's first request would. The browsers are the reference: their page is also rendered in Chromium, because that is what visitors see.

Each crawler is compared with the browser of its kind: smartphone crawlers with a phone browser (Chrome on Android), the others with a desktop browser (Chrome on Windows). When you select no browser of a kind, it is added as the reference. Two comparisons are made:

  1. The crawler's HTML against the browser's HTML. When they match, the server sends everyone the same page: same HTML.
  2. Otherwise, against the browser's page after JavaScript. When they match, the crawler gets a working pre-render: pre-rendered. When they don't, the crawler gets different content.

Two versions match when they have the same status, title, canonical and meta robots, and at least 90% of their text in common. Text is compared by overlapping three-word sequences, so a date, a counter or a rotating banner doesn't make two versions different.

Run a Test

  1. Paste the URL of the page.
  2. Keep the default user agents (Googlebot Smartphone, Googlebot, Bingbot, GPTBot, Facebook, Chrome on Android and Chrome on Windows) or change them.
  3. Press Compare. The verdict reads Crawlers get the same content as browsers., Crawlers get a pre-rendered page that matches the browser., or, for example, 2 of 5 crawlers get different content. or 5 of 5 crawlers are refused.
Open the Pre-rendering Tester

Options

  • User agents. One to 30 from the user-agent list: search engines, AI crawlers, social fetchers and browsers.
  • Render browsers with JavaScript. On by default. Turn it off for a faster test that compares raw HTML only; pre-rendered pages then show as different.

Reading the Result

  • Reference: each browser compared against, with its status and its words in the HTML and after JavaScript.
  • Same HTML, Pre-rendered, Different, Refused, Not compared: the crawlers in each group.
  • JavaScript: shown when JavaScript adds content in the browser. Google renders it; crawlers that don't run JavaScript miss it.
  • Responses: one row per user agent with its result, status, words (HTML → after JavaScript for browsers), the share of text in common with the browser's HTML and with its rendered page, size, Vary header and title. Click a row for the differences, the text only it gets, the text visitors see that it doesn't get, and the HTML it received. The table can be exported.
  • SEO signals per user agent: titles, descriptions, canonicals, robots directives, hreflang, headings, links and structured data of the HTML each one received.
ResultMeaning
same HTMLThe crawler gets the HTML a browser gets. No dynamic rendering for it, no cloaking.
pre-renderedAnother HTML than the browser's, matching the browser's page after JavaScript: dynamic rendering that works.
differentMatches neither: a stale or broken pre-render, or cloaking. Search engines expect the same content.
refused401, 403, 429 or 503 for the crawler: bot protection refusing the user agent from this server (see below).
not comparedThe request failed, or the reference browser didn't get the page (an error status): there is nothing to compare with.

Good to Know

  • Robots.txt is not checked. To see one user agent's page in full (screenshot, requests, what JavaScript changes), use Fetch & Render.
  • Browsers are rendered once the page has loaded, the network is quiet (up to 5 seconds) and one more second has passed.
  • A Vary: User-Agent header tells caches that the response depends on the user agent, which dynamic rendering requires. Canonicals that differ per user agent are covered in the rel=canonical guide.

API

POST /api/pre-rendering

Send the URL, the user-agent ids to compare (1 to 30) and, optionally, render: false. Each result carries the response, its words, the browser's rendering (rendered, browsers only) and the comparison: verdict (reference, same, prerendered, different, refused or failed), the reference browser, the text similarities (0 to 1), the differences and up to 30 text blocks only it gets or only the browser shows. The HTML of each response is cut at 1 MB. A browser you didn't select but that was added as a reference has added: true.

Request
curl -X POST https://plumb.reacthive.dev/api/pre-rendering \
  -H "content-type: application/json" \
  -d '{
    "url": "https://www.airbnb.com/",
    "agents": ["googlebot-smartphone", "chrome-android"],
    "render": true
  }'
Response (Trimmed)
{
  "url": "https://www.airbnb.com/",
  "render": true,
  "results": [
    {
      "id": "googlebot-smartphone",
      "agent": "Googlebot Smartphone",
      "mobile": true,
      "browser": false,
      "added": false,
      "status": 403,
      "finalUrl": "https://www.airbnb.com/",
      "bytes": 368,
      "vary": "",
      "signals": { "title": "Access Denied", "...": "..." },
      "words": 29,
      "rendered": null,
      "html": "<HTML><HEAD><TITLE>Access Denied</TITLE>...",
      "error": null,
      "comparison": {
        "verdict": "refused",
        "reference": "Chrome (Android Mobile)",
        "similarity": 0,
        "renderedSimilarity": 0,
        "differences": ["Status 403 (browser: 200)", "Title \"Access Denied\" (browser: \"Redirecting to www.airbnb.co.in\")"],
        "textOnlyHere": ["Access Denied"],
        "textMissing": ["Now you'll see one price for your trip, all fees included."]
      }
    },
    {
      "id": "chrome-android",
      "agent": "Chrome (Android Mobile)",
      "browser": true,
      "status": 200,
      "words": 0,
      "rendered": { "status": 200, "finalUrl": "https://www.airbnb.co.in/?locale=en", "title": "Airbnb | Holiday rentals, cabins, beach houses & more", "words": 941, "errors": 0 },
      "comparison": { "verdict": "reference", "reference": null, "similarity": null, "renderedSimilarity": null, "differences": [], "textOnlyHere": [], "textMissing": [] }
    }
  ]
}