+- Twitist Forums (http://twitist.com)
+-- Forum: General Social Media & Marketing Forums (/forum-8.html)
+--- Forum: SEO Search Engine Optimization (/forum-30.html)
+--- Thread: Suppose we are targeting home page for specific keyword.Is it necessary sitemap,robots.txt file for that site? (/thread-138769.html)
Suppose we are targeting home page for specific keyword.Is it necessary sitemap,robots.txt file for that site? - Harvey - 04-11-2014 12:43 AM
- Richard - 04-11-2014 12:52 AM
Hi Harvey,
I guess you are asking if you need to add a sitemap and robots.txt for your site. For sitemap, yes you need to do this, because it helps crawlers to index your page(s). You might also need to add one for your users to navigate especially if it's a big site.
For robots.txt, you only need this if you need to disallow crawlers to index certain page(s).
I am not sure I answered you exact question, but shout if you need further information.
- john - 04-11-2014 01:00 AM
Not necessary but it is better.
Sitemap helps Google to index your site faster.
Robots.txt shows google what pages should it index and what pages he shouldn't.