How Search Engines Process JavaScript
Covered here
- The three phases Google uses for JavaScript pages
- What the Web Rendering Service does
- What Googlebot does not do when rendering
- Why non-Google crawlers may miss JavaScript content
Short answer
Google processes JavaScript pages in three phases: it crawls the HTML, queues the page for rendering in an evergreen Chromium browser, then indexes the rendered result. Rendering can be delayed, and Googlebot does not click, scroll, or keep state between pages. Many other crawlers, including some AI crawlers, do not render JavaScript at all.
Open a React app’s page source and you might see almost nothing: an empty <div id="root"></div> and a script tag. Everything visible appears only after JavaScript runs. Google can handle that, but with extra steps and extra risk.
The three phases
- Crawl: Googlebot fetches the HTML. Links in the raw HTML can be found immediately.
- Render: the page waits in the render queue, then Google’s Web Rendering Service runs it in an evergreen Chromium browser.
- Index: Google indexes the rendered HTML, including content and links added by JavaScript.
What Googlebot does not do
- No clicking, typing, or “Load more” buttons
- No real scrolling; it uses a tall viewport instead
- No saved state: no cookies, logins, or data from earlier pages
- No waiting forever: slow or failing scripts can leave content out
- No access to blocked resources: scripts disallowed in robots.txt cannot run
Not every crawler renders
Bing renders with tighter limits. Many social media previews, SEO tools in default mode, and AI crawlers read only the raw HTML. For broad visibility, the safest place for important content and links is the initial HTML.
Practice: will Googlebot see it?
Sort each item into the right group.
-
Text inserted by JavaScript on page load
Answer: Likely seen.
-
Reviews loaded only after clicking 'Show reviews'
Answer: Likely missed.
-
Product data from an API blocked in robots.txt
Answer: Likely missed.
-
Links in the raw HTML navigation
Answer: Likely seen.
-
Prices shown only to logged-in users
Answer: Likely missed.
Common mistakes
- Assuming Google sees exactly what you see in your browser.
- Blocking JavaScript or API endpoints in robots.txt.
- Forgetting non-Google crawlers.
Your action
Next, you will compare HTML source with rendered HTML.
Key terms
- Rendering
- Running a page's JavaScript in a browser to produce the final HTML users see.
- Web Rendering Service (WRS)
- Google's system that renders pages using an up-to-date headless Chromium.
- Render queue
- The waiting line of crawled pages scheduled for rendering.
- Stateless rendering
- Googlebot loads each page fresh, without cookies, local storage, or a previous session.
Questions beginners ask
Does Google render all JavaScript?
Google attempts to render all indexable HTML pages, but scripts that error, time out, or are blocked by robots.txt can fail.
How long does rendering take?
Often seconds to minutes after crawling, sometimes longer for large or low-priority sites.
Do Bing and AI crawlers render JavaScript?
Bing renders, with limits. Many AI and social crawlers read only the raw HTML, so important content there is safest.
Does Googlebot interact with pages?
No. It does not click buttons, scroll like a user, or type into forms. Content that needs these actions may not be seen.
Related lessons
Want someone to handle SEO for your business while you learn? The team at Remar Digital can help.