How ranking in Google Search Works ! - GeeksforGeeks
Search Engine: A program that searches for and identifies items in a database that corresponds to keywords or characters specified by the user, used especially for finding particular sites on the World Wide Web.
Example: Google search engine, Yahoo , Bing etc.
Search Engine Index: A search engine index is a database that correlates keyword and websites so that the search engine can display websites that match the user's search query.
For example, if the user searches for Cheetah running speed, then the software spider searches these terms in the search engine index.
Web crawler: The first thing you need to understand is what a Web Crawler or Spider is and how it works. A Search Engine Spider (also known as a crawler, Robot, SearchBot or simply a Bot) is a program that most search engines use to find what's new on the Internet. Google's web crawler is known as GoogleBot. The program starts at a website and follows every hyperlink on each page.
So it can be said that everything on the web will eventually be found and spidered, as the so called "spider" crawls from one website to another. When a web crawler visits one of your pages, it loads the site's content into a database. Once a page has been fetched, the text of your page is loaded into the search engine's index, which is a massive database of words, and where they occur on different web pages.
Robots.txt file: Web crawlers crawls on few websites without approval. Therefore every website includes a robots.txt file which contains instructions for the spider(web crawler) on which parts of the website to index, and which parts to ignore.
Read full article from How ranking in Google Search Works ! - GeeksforGeeks
No comments:
Post a Comment