Different navigational links for friendly crawlers/spiders than for visitors

[BSlepkov]

Assuming I've already blocked undesirable bots, I now want to identify 'friendly' crawler or spider type activity from a normal surfer so as to not offer links for resorting lists - i.e. http://mywebsite.com/dir1/content_list.php?sort=date&order=asc

 

Such a script would set a flag variable when client 123.45.678.90 accesses X number of pages within X number of seconds. Could this be done without having to use sessions or cookies?

[wildteen88]

Wouldn't you be better of looking in to mod_rewrite so you can use SEO friendly urls eg

 

http://mywebsite.com/dir1/content_list/date/asc

 

That way you urls are friendly for both your visitors and bots.

 

 

[BSlepkov]

Sorry wildteen, I assumed made it clear from my opening line to the post, that I already do block undesirables. I just didn't clarify how ... using mod_rewrites.The example url I gave is a mock legitimate link that for anyone other than spiders, I could just present as regular text.