natasha_thomas Posted March 24, 2011 Share Posted March 24, 2011 Folks, I want google not to index two types of URLs from my Site. 1- Whereever the URL containts : bookmark.php Example: www.natty.com/bookmark.php?item=b004jnbkj4 I have Put in Robots.txt: User-agent: * Disallow: bookmark.php 2 - Whereever the URL containts : trackprice.php Example: www.natty.com/trackprice.php?item=b004jnbkj4 I have Put in Robots.txt: User-agent: * Disallow: trackprice.php I believe this Diclairation in Robots.txt is right.. No? If so, why google did not follow Robots.txt rules & indexed URLs matching these patterns? Am i doing something wrong here? Cheers Natasha T Quote Link to comment Share on other sites More sharing options...
natasha_thomas Posted March 24, 2011 Author Share Posted March 24, 2011 Is this the right Declaration: User-agent: * Disallow: /trackprice.php Disallow: /bookmark.php OR User-agent: * Disallow: trackprice.php Disallow: bookmark.php Which of the two is right Declaration in Robots.txt? Cheers N Quote Link to comment Share on other sites More sharing options...
cssfreakie Posted March 24, 2011 Share Posted March 24, 2011 Hi Natasha, this is a website on how to write disallow things in a textfile: http://www.robotstxt.org/orig.html#examples As far as being still indexed, i think it will takes some time for google to remove your from their index, here is some info, i think you can use google webmaster tools for this, never done it though http://www.google.com/support/webmasters/bin/answer.py?answer=164734 Quote Link to comment Share on other sites More sharing options...
natasha_thomas Posted March 24, 2011 Author Share Posted March 24, 2011 Hi Natasha, this is a website on how to write disallow things in a textfile: http://www.robotstxt.org/orig.html#examples As far as being still indexed, i think it will takes some time for google to remove your from their index, here is some info, i think you can use google webmaster tools for this, never done it though http://www.google.com/support/webmasters/bin/answer.py?answer=164734 Thanks Frikiey, You are always so helpful. Cheers Natasha T Quote Link to comment Share on other sites More sharing options...
cssfreakie Posted March 24, 2011 Share Posted March 24, 2011 hehe no problem Quote Link to comment Share on other sites More sharing options...
KevinM1 Posted March 24, 2011 Share Posted March 24, 2011 D'oh, wrong thread Quote Link to comment Share on other sites More sharing options...
Philip Posted March 24, 2011 Share Posted March 24, 2011 D'oh, wrong thread Free post! Woo! I have nothing of value to add to this thread, apologies. Quote Link to comment Share on other sites More sharing options...
xylex Posted March 25, 2011 Share Posted March 25, 2011 Do you have Robots.txt instead of robots.txt? That would do it. Quote Link to comment Share on other sites More sharing options...
natasha_thomas Posted March 25, 2011 Author Share Posted March 25, 2011 Do you have Robots.txt instead of robots.txt? That would do it. in FTP i have robots.txt Quote Link to comment Share on other sites More sharing options...
crmamx Posted March 25, 2011 Share Posted March 25, 2011 Thanks Frikiey, You are always so helpful. He is a walking encyclopedia... Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.