Reading Crawl Reports and Exports
What we will go through
- What crawl overviews and issue reports show
- Which export columns matter for analysis
- How to join crawl, Search Console, and analytics data
- How to set up a clean working spreadsheet
Short answer
Crawl reports summarize issues, but analysis happens in exports. Export all internal HTML URLs with status, indexability, canonical, titles, depth, inlinks, word count, and Search Console clicks and impressions. Filter to the URLs that matter, join other data sources by URL, add a page type column, and keep raw exports untouched in a separate sheet.
Modules 2 to 9 taught you how to find issues. Module 10 teaches you to make sense of them. It starts with turning a crawl into a spreadsheet you can actually analyze.
Reports vs. exports
- Overview and Issues reports tell you what the tool noticed and roughly how many URLs.
- Exports let you ask why, where, and how much it matters.
The columns that matter
From Internal, HTML, keep:
- Address, Status Code, Indexability, Indexability Status
- Canonical Link Element, Meta Robots
- Title, Meta Description, H1 (with lengths and counts)
- Crawl Depth, Unique Inlinks, Word Count
- Response Time
- Search Console Clicks, Impressions (if connected)
- Analytics Sessions or Conversions (if connected)
Drop columns you will not use. Fewer columns, clearer thinking.
Build the working sheet
- Raw tab: paste the untouched export.
- Working tab: copy, then filter to HTML URLs on the in-scope host.
- Add a page type column from URL folders.
- Join other data by URL: Search Console Pages reasons, sitemap presence, backlink counts.
- Add issue columns (TRUE/FALSE) for checks like “duplicate title” or “non-200 inlinks.”
Practice: keep or drop this column?
Sort each item into the right group.
-
Indexability Status
Answer: Keep for analysis.
-
Search Console Impressions
Answer: Keep for analysis.
-
Content-Type for HTML pages
Answer: Usually drop.
-
Unique Inlinks
Answer: Keep for analysis.
-
Hash of the response body
Answer: Usually drop.
Common mistakes
- Copying the tool’s issue list into the report as is.
- Editing raw exports. You lose the original.
- Not joining traffic data. Impact cannot be judged without it.
Your action
Next, you will group URLs by issue type.
Key terms
- Crawl overview
- A summary dashboard of URL counts, response codes, and issues found in a crawl.
- Issues report
- A crawler's list of detected problems, often with priority labels and affected URL counts.
- Bulk export
- A CSV or spreadsheet export of URLs and their data, or of relationships like inlinks.
- Join key
- The shared column, usually the URL, used to combine data from different tools.
Questions beginners ask
Should I trust the crawler's issue priorities?
Use them as a starting point. Tools do not know your business, traffic, or intended index states, so you rank issues yourself.
Which export is most useful?
Internal HTML with all columns, plus link exports for inlinks. Most analysis starts there.
Why keep raw exports separate?
So you can always trace back to the original data and redo analysis if a filter or formula was wrong.
Spreadsheet or database?
Spreadsheets work for most sites under 100,000 URLs. Larger sites benefit from BigQuery, Python, or Looker Studio.
Related lessons
Want someone to handle SEO for your business while you learn? The team at Remar Digital can help.