URL Structure and Normalization
In this lesson
- What makes a URL clean and consistent
- What URL normalization means
- The variations that create duplicate addresses
- How to audit URL patterns in a crawl
Short answer
URL normalization means making sure every page has one consistent address, with the same protocol, hostname, letter case, trailing slash format, and no unneeded parameters. Clean URLs are short, readable, lowercase, and use hyphens. Audit them by sorting crawled URLs and flagging variations that return 200 instead of redirecting to the preferred version.
To a person, these all look like one page. To a server, they can be five:
https://www.example.ph/rooms/deluxe/
https://www.example.ph/Rooms/Deluxe/
https://www.example.ph/rooms/deluxe
http://example.ph/rooms/deluxe/
https://www.example.ph/rooms/deluxe/?ref=fb
If all five return 200, Google sees five copies. URL normalization picks one and makes the others point to it.
What clean URLs look like
- Short and readable:
/tours/mayon-volcano/beats/index.php?id=4471&cat=9 - Lowercase, hyphen-separated
- Logical folders that match site sections
- No session IDs or unneeded parameters
- Stable: they do not change when titles or dates change
The normalization rules to check
For each, one format should return 200 and the others should 301 to it:
- Protocol: HTTPS, not HTTP
- Hostname: www or non-www
- Letter case: lowercase
- Trailing slash: with or without, consistently
- Index files:
/not/index.html - Parameters: tracking and sorting parameters canonicalized or ignored
How to audit
Sort crawled URLs alphabetically and scan for near-identical pairs. Use your crawler’s filters for uppercase, underscores, parameters, and non-ASCII characters. Then manually test variations of 5 key pages: change the case, remove the slash, switch to HTTP and non-www, and add ?test=1. Note the status code for each.
Practice: clean or needs work?
Sort each item into the right group.
-
/tours/mayon-volcano/
Answer: Clean URL.
-
/Tours/Mayon_Volcano.html
Answer: Needs work.
-
/product.php?id=883&sessionid=a8f2
Answer: Needs work.
-
/locations/legazpi/
Answer: Clean URL.
-
/2019/03/14/our-new-menu-update-final-v2/
Answer: Needs work.
Common mistakes
- Renaming URLs without redirects.
- Allowing every variation to return 200.
- Mixed formats in internal links. Half link with a slash, half without.
Your action
Next, you will learn how to find duplicate URLs and duplicate pages.
Key terms
- URL normalization
- Standardizing URLs so each page is reached at one preferred format, with other variations redirected or canonicalized.
- Slug
- The readable part of a URL that names the page, such as /deluxe-room/.
- Percent encoding
- How special characters and spaces appear in URLs, such as %20 for a space.
- Case sensitivity
- On most servers, /Rooms/ and /rooms/ are different URLs, which can create duplicates.
Questions beginners ask
Do keywords in URLs help rankings?
Only slightly. Readable URLs mainly help users and click-through. Never change working URLs just to add keywords without redirects.
Should URLs be lowercase?
Yes. Use lowercase consistently and redirect uppercase variations, since many servers treat them as separate pages.
Hyphens or underscores?
Use hyphens. Google treats hyphens as word separators.
Should I include dates in blog URLs?
Usually not. Dates make content look old and force URL changes when updating posts.
Related lessons
Want someone to handle SEO for your business while you learn? The team at Remar Digital can help.