Jump to content

Robot txt, favicon.ico


MemphiS

Recommended Posts

no.. but I suppose people COULD in theory find what you're trying to hide without much effort...

 

disallow /privatestuff

 

really?

 

Use authentication if you're trying to hide something critical from a crawler. Use robots.txt to keep them from crawling something useless like a 404 error page.

Link to comment
https://forums.phpfreaks.com/topic/56368-robot-txt-faviconico/#findComment-279128
Share on other sites

Archived

This topic is now archived and is closed to further replies.

×
×
  • Create New...

Important Information

We have placed cookies on your device to help make this website better. You can adjust your cookie settings, otherwise we'll assume you're okay to continue.