1. My site's new to the web, and I recently submitted it.
Google finds sites through a process known as "crawling" the web. This involves robot software that follows hyperlinks from site to site. Google currently looks at more than 8 billion URLs during our crawls.
When a URL is submitted to Google, we're able to look for it in our next crawl. If you've already submitted your URL, your site could easily appear in our search results after our next crawl. However, if no other sites links to yours, it may be difficult for our crawler to find you. Conversely, if many sites link to your page, there's a good chance we'll find you even without the submission of your URL.
2. My site's been live for a few months.
If we haven't picked up your site after several months, it's possible that our spiders aren't able to find your pages. If you increase the links pointing to these pages, it'll improve the chance that we'll find your site.
It's also possible that we're not able to crawl your site due to technical reasons. A few of the most common ones are listed below:
- Your pages were unavailable when we tried to crawl them. If a page is down due to network or hosting problems, we try to visit it multiple times. If our crawlers can't reach it, it won't be listed in our index. If such unavailability was a transient problem, your site will likely be added to our index again soon.
- Your pages are dynamically generated. We're able to index dynamically generated pages. However, because our web crawler could overwhelm and crash sites that serve dynamic content, we limit the number of dynamic pages we index. In addition, our crawlers may suspect that a URL with many dynamic parameters might be the same page as another URL with different parameters. For that reason, we recommend using fewer parameters if possible. Typically, URLs with 1-2 parameters are more easily crawlable than those with many parameters.
- You employ doorway pages. Google does not encourage the use of automatically generated pages that are designed for search engines instead of users. We want to point users to useful content pages, not to doorways or splash screens.
- Your pages use frames. Google supports frames to the extent that we can. Frames tend to cause problems with search engines, bookmarks, emailing links and so on, because frames don't fit the conceptual model of the web (every page corresponds to a single URL). If a user's query matches the page as a whole, Google returns the frame set. If a user's query matches an individual frame on the page, Google returns the URL for that frame. The page is not displayed in a frame because there may be no frame set corresponding to that URL.
If you're concerned with the description of your site as seen by search engines, please read "Search Engines and Frames." It describes the "NoFrames" tag, which is used to provide alternative content. If, instead of providing alternative content, you use wording such as "This site requires the use of frames" or "Upgrade your browser," you're excluding both search engines and individuals whose browsers don't support frames. (For example, audio web browsers, such as those used in automobiles and by the visually impaired, typically do not deal with frames, which are a visual mechanism.) You can read about "NoFrames" in the HTML standard here.
3. Some of my pages are included, but others are missing.
Although we index more than 8 billion webpages, we cannot guarantee that we'll crawl all the pages on a particular site. However, we're always working to increase the number of pages we crawl and hope to include more pages in our index over time. For more information about how we find and include pages in our index please read our technology overview.
If your site's internal link structure doesn't provide a path to all of your pages, our robot may not see all the pages on your site. Google follows links from one page to the next, so pages that aren't linked to by others may be missed. Please see our Webmaster Guidelines for other ways to make your site more crawlable.
Although you can't buy your way into our search results, you can purchase advertising adjacent to them. More information about advertising with Google can be found here.