freecourses.digital
Lesson progress: 0 of 3 activities done
All lessons in Technical SEO Auditing Lesson 5.2 of 84

Module 1: Introduction to Technical SEO Auditing

  1. 1.1What Is a Technical SEO Audit?
  2. 1.2Technical SEO Audit vs. General SEO Audit
  3. 1.3When Should You Audit a Website?
  4. 1.4Types of Technical SEO Issues
  5. 1.5Defining Audit Scope and Objectives

Module 2: Website Crawling and URL Discovery

  1. 2.1How SEO Crawlers Discover URLs
  2. 2.2Configuring a Website Crawl
  3. 2.3Crawl Scope, Limits, and Exclusions
  4. 2.4Internal Links and Crawl Depth
  5. 2.5Orphan Pages and URL Discovery
  6. 2.6Crawl Data vs. Search Engine Data
  7. 2.7Identifying Crawl Coverage Gaps

Module 3: HTTP Status Codes and Redirect Auditing

  1. 3.1Understanding HTTP Status Codes
  2. 3.2Finding 4xx Errors and Broken Links
  3. 3.3Identifying 5xx Server Errors
  4. 3.4Redirect Chains and Redirect Loops
  5. 3.5Internal Links to Redirected URLs
  6. 3.6301 vs. 302 Redirects
  7. 3.7Auditing 404 Pages and Soft 404s

Module 4: Crawlability and Indexability Auditing

  1. 4.1Crawling vs. Indexing
  2. 4.2Robots.txt Audit
  3. 4.3Meta Robots and X-Robots-Tag
  4. 4.4Noindex and Canonical Conflicts
  5. 4.5XML Sitemap Validation
  6. 4.6Canonical URL Auditing
  7. 4.7Identifying Indexability Conflicts
  8. 4.8Comparing Crawl Data with Google Search Console

Module 5: URL Structure and Duplicate Content Issues

  1. 5.1URL Structure and Normalization
  2. 5.2Duplicate URLs and Duplicate Pages
  3. 5.3HTTP vs. HTTPS and Hostname Variations
  4. 5.4Trailing Slashes and URL Parameters
  5. 5.5Pagination and Faceted Navigation
  6. 5.6Canonicalization Strategies
  7. 5.7Internal Linking to Preferred URLs

Module 6: Technical On-Page Auditing

  1. 6.1Missing and Duplicate Title Tags
  2. 6.2Missing and Duplicate Meta Descriptions
  3. 6.3Missing, Duplicate, and Multiple H1 Headings
  4. 6.4Heading Hierarchy and HTML Structure
  5. 6.5Missing Image Alt Attributes
  6. 6.6Internal Link and Anchor Text Issues
  7. 6.7Empty, Thin, and Near-Duplicate Pages
  8. 6.8Auditing HTML Metadata at Scale

Module 7: Website Performance and Core Web Vitals

  1. 7.1Core Web Vitals: LCP, INP, and CLS
  2. 7.2Lab Data vs. Field Data
  3. 7.3Identifying Slow Pages
  4. 7.4Image and Resource Optimization Opportunities
  5. 7.5JavaScript and CSS Performance
  6. 7.6Mobile Usability and Responsive Rendering
  7. 7.7Prioritizing Performance Fixes

Module 8: JavaScript SEO and Rendering

  1. 8.1How Search Engines Process JavaScript
  2. 8.2HTML Source vs. Rendered HTML
  3. 8.3Client-Side vs. Server-Side Rendering
  4. 8.4JavaScript-Generated Content and Links
  5. 8.5Rendering Failures and Missing Content
  6. 8.6Lazy Loading and Crawl Accessibility
  7. 8.7Diagnosing JavaScript SEO Problems

Module 9: Structured Data and Schema Auditing

  1. 9.1Structured Data and Schema.org Basics
  2. 9.2JSON-LD and Structured Data Formats
  3. 9.3Finding Structured Data Across a Website
  4. 9.4Detecting Invalid or Incomplete Markup
  5. 9.5Schema Validation and Rich Result Eligibility
  6. 9.6Conflicting or Duplicate Structured Data
  7. 9.7Prioritizing Schema Fixes

Module 10: Analyzing Audit Data and Prioritizing Issues

  1. 10.1Reading Crawl Reports and Exports
  2. 10.2Grouping URLs by Issue Type
  3. 10.3Identifying Root Causes vs. Symptoms
  4. 10.4Evaluating Severity, Impact, and Effort
  5. 10.5Separating Sitewide and Isolated Issues
  6. 10.6Identifying False Positives
  7. 10.7Building an Actionable Issue Register

Module 11: Technical SEO Audit Reporting

  1. 11.1Structuring a Technical SEO Audit Report
  2. 11.2Documenting Evidence and Affected URLs
  3. 11.3Writing Developer-Ready Recommendations
  4. 11.4Mapping Issues to Business and Search Impact
  5. 11.5Creating a Prioritized Remediation Roadmap
  6. 11.6Presenting Findings to Stakeholders
  7. 11.7Tracking Fixes and Ownership

Module 12: Fix Verification and Technical QA

  1. 12.1Re-Crawling After Fixes
  2. 12.2Comparing Before-and-After Crawl Results
  3. 12.3Verifying Redirects, Canonicals, and Indexability
  4. 12.4Detecting Regressions and Newly Introduced Issues
  5. 12.5Testing Website Changes Before Deployment
  6. 12.6Confirming Fixes with Search Console and Other Evidence
  7. 12.7Closing Audit Findings and Recording Results

Duplicate URLs and Duplicate Pages

This lesson covers

  • The difference between duplicate URLs and duplicate pages
  • How crawlers detect exact and near duplicates
  • Where technical duplicates usually come from
  • How to choose between redirect, canonical, and merge

Short answer

Duplicate URLs are different addresses that load the same page, usually from protocol, case, slash, or parameter variations. Duplicate pages are separate pages with the same or very similar content. Find both with your crawler's exact and near duplicate reports, then redirect, canonicalize, or merge so Google indexes one preferred version.

A Pampanga food supplier had 40 branch pages. Each said: “We deliver fresh tocino and longganisa to [town].” Only the town name changed. Google indexed six and ignored the rest. That is page duplication. The same site also had every product reachable with and without ?ref= parameters. That is URL duplication.

Two kinds of duplication

Duplicate URLs: one page, many addresses. Causes: HTTP/HTTPS, www/non-www, case, slashes, parameters, session IDs, printer versions.

Duplicate pages: separate pages, same or very similar content. Causes: templated location pages, product variants (sizes, colors), tag and category archives with the same posts, copied boilerplate.

How to find them

  1. Enable near duplicate detection in your crawler (Content settings) at 90%, and run Crawl Analysis.
  2. Open Exact Duplicates (same content hash). These are almost always URL duplication.
  3. Open Near Duplicates and review groups. These are usually page duplication.
  4. Check Duplicate titles and H1s as quick hints of duplicates.
  5. In Search Console, check “Duplicate without user-selected canonical” and “Duplicate, Google chose different canonical.”

Choosing a fix

  • Same page, different address: 301 redirect (protocol, host, case) or canonical (parameters).
  • Truly identical pages: merge and 301 the extras.
  • Similar pages that should rank separately: make them genuinely different with unique content.
  • Utility duplicates (print, sort): canonical to the main version.

Practice: URL duplicate or page duplicate?

Sort each item into the right group.

  • /menu and /menu/ both return 200

  • 40 town pages with only the name changed

  • Product with ?utm_source=fb

  • Tag and category archives listing the same 5 posts

  • http:// and https:// versions both load

Common mistakes

  • Canonicalizing near duplicates that should rank separately. Improve them instead.
  • Treating every duplicate title as duplicate content. Check the actual content.
  • Fixing pages but leaving parameter duplicates linked internally.
1. Exact duplicates in a crawl usually come from...
2. Is there a penalty for technical duplicate content?
3. Similar location pages should rank separately. Best fix?

Your action

Next, you will audit HTTP vs. HTTPS and hostname variations.

Key terms

Exact duplicate
Pages whose HTML or content hash is identical.
Near duplicate
Pages with very similar content, measured by a similarity percentage, such as 90% or more.
Content hash
A fingerprint of a page's content used by crawlers to spot identical pages.
Keyword cannibalization
Several pages targeting the same search query, often caused by duplicate or overlapping content.

Questions beginners ask

Is there a duplicate content penalty?

Not for normal technical duplication. Google filters duplicates and picks one version. The risk is that it picks the wrong one or splits signals.

What similarity threshold should I use?

Start at 90% for near duplicates and review samples. Product variants and location pages often sit between 85% and 95%.

Do printer-friendly pages count?

Yes. Canonicalize them to the main page or noindex them.

What about content copied from other sites?

That is a content issue. This course focuses on duplication created by your own site's technical setup.

Related lessons

Want someone to handle SEO for your business while you learn? The team at Remar Digital can help.