+- Twitist Forums (http://twitist.com)
+-- Forum: General Social Media & Marketing Forums (/forum-8.html)
+--- Forum: SEO Search Engine Optimization (/forum-30.html)
+--- Thread: Why Won't Google Spider All My Web Pages? (/thread-157728.html)
Why Won't Google Spider All My Web Pages? - Mat - 05-20-2014 02:41 AM
I have a large website... with over 100,000 pages. I did a search to see how many google has indexed and it is 10...??? Why so little. The site is 11 months old...
How can I get google to spider ALL the pages on my site???
I want all 100,000 spidered and searchable on google...
Do I need a robot.txt file or something more powerful?
- Etta - 05-20-2014 02:46 AM
Get yourself a xml sitemap and join Google Webmaster Tools.
- TheMedjai - 05-20-2014 02:54 AM
Maybe because not all of your pages are cross linked. Or maybe you need to optimize your links and make them search engine friendly, just google SEO about that.