This Forum has been archived there is no more new posts or threads ... use this link to report any abusive content
==> Report abusive content in this page <==
Post Reply 
 
Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
importance of crawler in search engines?
05-16-2014, 07:45 PM
Post: #1
importance of crawler in search engines?

Ads

Find all posts by this user
Quote this message in a reply
05-16-2014, 07:51 PM
Post: #2
 
search engines crawls the website as you have updated the content in blogging sites or article. make a fan page put some appealing in your wall.

Ads

Find all posts by this user
Quote this message in a reply
05-16-2014, 08:02 PM
Post: #3
 
The role of crawler is to crawl or explore you website in order to index the changes you have made in your website or blog.
Different search engines have different crawlers like Google Bot for Google, Yahoo Slurp for Yahoo and Bingbot for Bing.
thanks...
Find all posts by this user
Quote this message in a reply
05-16-2014, 08:14 PM
Post: #4
 
Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine, that will index the downloaded pages to provide fast searches. Crawlers can also be used for automating maintenance tasks on a web site, such as checking links or validating HTML code.
Find all posts by this user
Quote this message in a reply
05-16-2014, 08:16 PM
Post: #5
 
every search engine has its crawler. It crawls the content in your website.Please make sure that your website should not contain any duplicate content or matching content found in other website.Search engine may ban your site.Optimize your website to your user and crawler friendly so that it can rank well in a search engine when any user type any keyword your website should result first..
Find all posts by this user
Quote this message in a reply
Post Reply 


Forum Jump:


User(s) browsing this thread: 1 Guest(s)