Oliver Zeman
How Google Ranks Websites: Crawling, Indexing, and Ranking Factors
How search engines rank websites — crawling, indexing, and the ranking factors that matter most.
You type something into Google. Half a second later, ten blue links appear, ordered like someone actually thought about it. But nobody did. Not a human, anyway. A sprawling set of algorithms just sifted through hundreds of billions of pages and decided which ones you'd find useful.
The question is how. And if you run a website, the follow-up question is even more urgent: how do you get your pages to show up somewhere in that top ten?
Search engines rank websites through three stages: crawling, indexing, and ranking. Each stage filters out more pages. Most never make it past the first two. Understanding how all three work is the difference between showing up on page one and not showing up at all.
The three stages every search goes through
Before Google can rank anything, it has to know the page exists. Then it has to understand what's on it. Only then can it decide where that page belongs for any given query.
The process looks like this:
| Stage | What happens | Pages that get through |
|---|---|---|
| Crawling | Bots follow links and sitemaps to discover URLs | Most publicly accessible pages |
| Indexing | Content is parsed, analyzed, and stored in a database | Pages deemed useful, non-duplicate, and canonical |
| Ranking | Algorithms score pages against a query and order them | Pages that match intent and pass quality thresholds |
Google is explicit about one thing: it does not accept payment for higher rankings. If someone tells you they can pay Google to rank you higher in organic results, they're wrong. Paid ads live in separate slots, clearly marked, and they don't influence organic rankings at all.
Crawling: how search engines find your pages
Google uses automated programs called crawlers (Googlebot is the main one) to discover pages. Crawlers start from a list of known URLs and follow links from those pages to new ones. They also read sitemaps you submit through Google Search Console.
But crawling is not guaranteed. Googlebot makes decisions about what to crawl based on:
- Page importance. Pages linked from high-authority sites get crawled faster and more often.
- Site speed. Slow servers get crawled less frequently. Google doesn't want to overload your infrastructure.
- Crawl budget. Every site has an invisible budget of how many pages Googlebot will crawl per day. Large sites with lots of low-value pages waste it.
- Robots.txt rules. If you block a directory, Googlebot respects it and moves on.
A page that never gets crawled never gets ranked. It's that simple. So if you've launched a new site or added new pages, submitting your sitemap in Google Search Console is the fastest way to get Google's attention. Google's own documentation on crawling explains that the vast majority of pages aren't manually submitted but discovered through links.
Start your free SEO scan to see how many of your pages are actually indexed and what's holding the rest back.
Indexing: what gets stored and why
Crawling gets your page in the door. Indexing is where Google decides whether to keep it.
During indexing, Google parses the page's content, images, videos, and structured data. It identifies the page's language, topic, and canonical URL. Then it decides whether the page is worth adding to the index at all.
Pages get excluded from the index for a few reasons:
- Duplicate content. If the same content exists on multiple URLs, Google picks one canonical version and ignores the rest.
- Thin content. Pages with little to no original content (doorway pages, auto-generated pages, near-empty category pages) get dropped.
- Low quality. Google's quality algorithms flag pages that appear to offer no real value.
- Technical issues. Noindex tags, canonicalization errors, or broken redirects can keep pages out.
A page that's crawled but not indexed might as well not exist. You can check your index status in Google Search Console under the "Pages" report. If you see a gap between discovered pages and indexed pages, you have a problem worth fixing.
How ranking actually works
Once a page is in the index, it's eligible to rank. But ranking isn't a single score. It's a query-by-query decision.
When someone searches, Google's ranking systems go through a sequence:
Interpret the query. What is the user actually looking for? Google's systems correct spelling, expand synonyms, and classify intent. A search for "apple" could mean the fruit, the company, or the record label. The algorithm has to figure out which one based on context and probability.
Retrieve matching pages. Google pulls every indexed page that could potentially answer the query. For a broad query, this might be millions of pages.
Score and rank. Each page gets scored against hundreds of signals. The weight of each signal shifts depending on the query type. Freshness matters for news queries. Authority matters for medical queries. Location matters for "coffee shop near me."
Apply context. The results get adjusted based on the user's location, language, device, and sometimes search history.
The whole thing happens in under a second. And the ranking factors that drive step three are what SEO is all about.
The ranking factors that matter in 2026
Google uses over 200 ranking factors. Nobody outside Google knows all of them, and the list changes constantly. But the core ones have been stable for years, and they fall into three buckets.
Content quality and E-E-A-T
Content is the single most important ranking factor. Not because Google says so, but because every other signal depends on it. Backlinks don't come to bad content. Users don't stay on bad content. And Google's systems are getting better at detecting bad content directly.
The framework Google uses to evaluate content quality is E-E-A-T: Experience, Expertise, Authoritativeness, and Trustworthiness. These aren't direct ranking factors. They're concepts that Google's human quality raters use to evaluate search results, and Google's algorithms are trained to approximate those judgments.
What E-E-A-T means in practice:
- Experience. The author has actually done the thing they're writing about. A product review from someone who bought and used the product. A travel guide from someone who went there.
- Expertise. The author knows the subject deeply. Credentials help, but demonstrated knowledge matters more.
- Authoritativeness. The site and author are recognized as go-to sources in their field. This is where backlinks from reputable sites come in.
- Trustworthiness. The site is secure, accurate, and transparent about who's behind it.
Google's Helpful Content System, introduced in 2022 and refined through multiple updates, specifically targets content created for search engines rather than people. If your content feels like it was written to hit a word count and stuff keywords, it will struggle.
Backlinks: still the strongest external signal
Backlinks are links from other websites to yours. They function like votes of confidence, but not all votes count equally.
A link from a major news site or a .edu domain carries more weight than a link from a random blog. Links from sites in your topic area matter more than links from unrelated sites. And links from sites that themselves have strong backlinks pass more authority.
What's changed in recent years:
- Relevance matters more than raw quantity. One link from an authoritative site in your niche beats ten from unrelated sites.
- Link schemes get penalized aggressively. Buying links, excessive link exchanges, and private blog networks are not worth the risk.
- Natural anchor text is expected. Exact-match anchor text on every link looks manipulative. Variation is normal.
Google's PageRank is still the foundation, but it's been augmented by AI systems like RankBrain and Neural Matching that understand the context and intent behind links rather than just counting them. Google's ranking systems guide lists the active systems and what each one does.
Technical SEO: Core Web Vitals and page experience
Technical SEO is the foundation. If your site is slow, broken, or impossible to crawl, nothing else matters.
The three metrics that Google uses to measure page experience are called Core Web Vitals:
| Metric | What it measures | Good threshold |
|---|---|---|
| Largest Contentful Paint (LCP) | How fast the main content loads | Under 2.5 seconds |
| Interaction to Next Paint (INP) | How responsive the page is to user input | Under 200 milliseconds |
| Cumulative Layout Shift (CLS) | How much the page jumps around while loading | Under 0.1 |
These aren't tiebreakers. A page with great content and terrible Core Web Vitals can still rank well if no other page answers the query as thoroughly. But when two pages are close in quality, the faster, more stable page wins.
Beyond Core Web Vitals, technical SEO includes:
- Mobile-friendliness. Google uses mobile-first indexing. If your page doesn't work on a phone, it won't rank on any device.
- HTTPS. Secure sites get a modest ranking boost. More importantly, browsers flag HTTP sites as "not secure," which kills trust.
- Crawlability. Clean URL structures, internal linking, and proper canonical tags help Google understand your site.
- Structured data. Schema markup helps Google display rich results, which can improve click-through rates even if they don't directly boost rankings.
Run a technical SEO audit to see how your site scores on Core Web Vitals and what's dragging down your rankings.
What doesn't matter (as much as you think)
Some things get more attention than they deserve. Here's what you can stop worrying about:
Domain age. Google's John Mueller has said explicitly that domain age doesn't help. Older domains tend to have more backlinks and content, which is why they rank better. The age itself is not a factor.
Exact match domains. Having your keyword in the domain name (like best-running-shoes.com) used to be a shortcut. Google's Exact Match Domain update neutralized that advantage. It doesn't hurt, but it doesn't help either.
Word count. There is no ideal word count for ranking. Google has said this repeatedly. Longer content tends to rank better because it covers topics more thoroughly, not because the algorithm is counting words.
Social signals. Likes, shares, and follower counts are not direct ranking factors. Social media can drive traffic and earn backlinks, both of which help rankings indirectly. But the social activity itself doesn't move the needle.
Keyword density. The idea that there's a magic percentage of keywords on a page is outdated. Write naturally. Include the keyword in the title, headings, and body where it fits. Don't force it.
How to check your own rankings
Knowing where you rank is the first step to improving. Here's how to do it:
Google Search Console shows you exactly which queries your site appears for, your average position, and your click-through rate. It's free and it's the most accurate data you'll get. Go to the Performance report, and you'll see every query that triggered your site in the results. If you're not sure how to set it up, our guide to the best SEO tools for beginners walks through it step by step.
Don't rely on manual searches. If you Google your own keywords while logged in, Google personalizes the results based on your history. You'll see your site higher than it actually ranks for everyone else. Search Console removes that bias.
Third-party rank trackers like Semrush, Ahrefs, or Lookelo's rank tracking tool can monitor your positions across hundreds of keywords automatically. They're useful for tracking trends over time and watching what your competitors are doing.
Look for patterns. If your rankings dropped after a specific date, check whether a Google algorithm update coincided with it. If a specific page is underperforming, compare it to the pages that are ranking above you. What are they doing that you're not?
FAQ
How do search engines determine which websites appear first?
Search engines score pages against hundreds of ranking factors and order them by how well they match the query's intent. The top factors are content quality, backlinks, relevance to the search, and page experience. No single factor dominates. The algorithm weighs them differently depending on the query type.
What is Google PageRank and how does it work?
PageRank is Google's original algorithm for measuring page authority based on backlinks. It treats links as votes, with votes from authoritative pages counting more than votes from low-authority pages. PageRank is still part of Google's ranking system, but it's now one signal among hundreds, augmented by AI systems like RankBrain.
What is Google's RankBrain and how does it affect rankings?
RankBrain is a machine learning system that helps Google interpret queries and match them to relevant pages. It's particularly good at handling never-before-seen queries and understanding the relationships between words and concepts. RankBrain is part of how Google determines relevance, not a separate ranking factor you can optimize for directly.
How important are backlinks for search engine ranking?
Backlinks remain one of the strongest ranking signals. A 2023 study by Backlinko found that the number of domains linking to a page was the factor that correlated most strongly with higher rankings. But quality matters more than quantity. Links from relevant, authoritative sites in your niche are worth far more than links from unrelated or low-quality sites.
How does Google's Core Web Vitals affect rankings?
Core Web Vitals are a direct ranking factor, but their weight is modest compared to content quality and backlinks. They matter most when two pages are otherwise close in quality. A page that passes all three Core Web Vitals thresholds will have an advantage over one that doesn't, all else being equal. But great content with poor Core Web Vitals can still outrank mediocre content with perfect scores.
What is the difference between organic and paid search results?
Organic results are ranked by Google's algorithm based on relevance and quality. Nobody can pay to appear in them. Paid results are advertisements that appear above or below organic results, marked with a "Sponsored" label. They're sold through Google Ads on a pay-per-click basis. Organic and paid systems are completely separate, and spending on ads does not improve organic rankings.
How does Google's Helpful Content System work?
The Helpful Content System is a site-wide signal that identifies content created primarily for search engines rather than for people. If the system determines that a site has a high proportion of unhelpful content, all pages on that site may see reduced rankings. The fix is to remove or improve the low-value content. The system runs continuously, so recovery is possible once the issues are addressed.
How do search engines rank local businesses?
Local rankings use a different set of signals: relevance (how well the business matches the query), distance (how close the business is to the searcher), and prominence (how well-known the business is, based on reviews, backlinks, and other signals). A well-optimized Google Business Profile, consistent NAP (name, address, phone) information across the web, and genuine customer reviews are the most important factors for local SEO.
How do search engines crawl websites?
Search engines use automated bots called crawlers (Googlebot, for Google) that start from a list of known URLs and follow links to discover new pages. Crawlers also read sitemaps submitted by site owners. They respect robots.txt directives and crawl budgets, which limit how many pages they'll fetch from a single site in a given period.
How to check your website's Google ranking?
Use Google Search Console's Performance report to see which queries your site appears for, your average position, and your click-through rate. This is the most accurate free method. For tracking positions across many keywords over time, use a rank tracking tool like Lookelo, Semrush, or Ahrefs. Avoid checking rankings manually while logged into Google, as personalized results will skew what you see.