SEO Basics: How Search Engines Understand a Web Page
Short answer
SEO means making your pages crawlable, understandable, and worth ranking. The basics are a unique title and description on every page, a single H1, a correct canonical, and internal links that tie your pages together. Everything else rests on content that is genuinely useful.
How do search engines work?
Google officially describes the process in three stages (How Google Search Works):
- Crawling: Googlebot follows links and sitemaps to discover URLs and downloads the pages.
- Indexing: Google analyzes the page’s text, tags, and images, works out what it’s about, and decides whether to store it in the index.
- Serving search results: When someone searches, Google picks the most relevant, highest-quality pages from the index and ranks them.
That means SEO problems can be diagnosed along the same three layers: not crawled (blocked by robots.txt, no links pointing to the page), not indexed (noindex, duplicate content, low quality), and not ranking (the content is weaker than the competition).
Which five page elements matter most?
| Element | What it does | Common mistake |
|---|---|---|
<title> |
The blue headline in search results; the single most important SEO element | Using the same title across the whole site |
meta description |
The snippet text in search results; affects click-through rate | Left blank or unrelated to the content |
<h1> and subheadings |
Tell search engines the page topic and section structure | Big text styled with CSS instead of heading tags |
canonical |
When the same content lives at several URLs, names the original | Every page pointing to the homepage |
| Internal links | Help crawlers discover pages and pass authority | Important pages with no links pointing to them (orphan pages) |
How should I write a title?
- Make every title unique, and put the most important keyword first.
- Keep it to about 60 characters in English (about 30 characters in CJK languages); longer titles get truncated.
- Suggested format:
Page Topic | Site Name. This site follows that format.
Does the meta description affect rankings?
Not directly. But it acts as the “ad copy” in search results, and a good one improves click-through rate. Google may also ignore yours and pull a passage from the page that better matches the search query.
What is a canonical?
The same content can end up at several URLs: a version with ?utm_source= parameters, with or without a trailing slash, http versus https. <link rel="canonical"> tells search engines, “These are all the same page; treat this URL as the one that counts.” Adding a self-referencing canonical to every page is the safest approach. Keep in mind that to Google, a canonical is a “hint,” not a directive.
What’s the difference between robots.txt and noindex?
This is the pair people confuse most often:
- robots.txt Disallow: tells crawlers “don’t fetch this.” But if other sites link to the URL, it can still appear in search results (just without a snippet).
- meta robots noindex: tells search engines “you can fetch this, but don’t index it.”
The fatal combination is using both together: if robots.txt blocks the page, crawlers never see the noindex on it, so the page can’t be removed. To remove a page from search results, use noindex only and let crawlers in so they can read it.
How do I check my own site?
- Use this site’s SEO Health Check to review all of the elements above in one pass.
- Use your browser’s “View Page Source” to confirm the title, description, and canonical are actually in the HTML.
- After launch, use “URL Inspection” in Google Search Console to see the version Google actually sees.
The complete official primer is Google’s Search Engine Optimization (SEO) Starter Guide. It’s worth reading from start to finish.
FAQ
Do meta keywords still matter?
No. Google stated publicly back in 2009 that it does not use meta keywords as a ranking factor. Adding them today has no effect at all.
How long does it take Google to index a new site?
There is no fixed timeline; it can take anywhere from a few days to a few weeks. Adding your site to Google Search Console and submitting a sitemap can help Google discover it faster, but it does not guarantee indexing.
Will my site rank first once the SEO is done?
No. Technical SEO only makes sure search engines can understand your pages correctly. Rankings depend mainly on whether your content satisfies searchers better than other pages do.