This Forum has been archived there is no more new posts or threads ... use this link to report any abusive content
==> Report abusive content in this page <==
Post Reply 
 
Thread Rating:
  • 0 Votes - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How many mod_rewritten pages is too many?
04-08-2014, 06:38 PM
Post: #1
How many mod_rewritten pages is too many?
I'm creating a website which aggregates and displays areas where photos have been taken in a particular location. 99% of my human visitors will type a place in the search bar on my website. But I also wanted to provide a 'Browse Locations' section in the site, mainly for SEO to crawl, where areas of the world can be drilled down in to, e.g. United Kingdom > England > London > Trafalgar Square.

To do this I'm going to use the geonames API, and the aim is to target search engine searches for for 'photos in trafalgar square', for example with a 'dedicated', mod_rewrit[ten] page.

My question is really, does this sound dodgy? Obviously there could be hundreds of thousands or millions of seemly static pages if I do this. Not to mention I'll blow my API usage limit when the Browse section gets crawled (I'm assuming there's some kind of 'crawl this section once' directive I can put on the section, but haven't looked into this yet). Is there a point where the crawler 'gives up' or even penalises the site?

I suppose I could limit it to a certain level of place, e.g. stop and London in the heirarchy, but still this will be probably tens of thousands of pages.

Be interested to hear your thoughts.

Ads

Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
How many mod_rewritten pages is too many? - Darren - 04-08-2014 06:38 PM
[] - Hal Smith - 04-08-2014, 06:48 PM

Forum Jump:


User(s) browsing this thread: 1 Guest(s)