natasha_thomas Posted March 24, 2011 Share Posted March 24, 2011 Folks, I want google not to index two types of URLs from my Site. 1- Whereever the URL containts : bookmark.php Example: www.natty.com/bookmark.php?item=b004jnbkj4 I have Put in Robots.txt: User-agent: * Disallow: bookmark.php 2 - Whereever the URL containts : trackprice.php Example: www.natty.com/trackprice.php?item=b004jnbkj4 I have Put in Robots.txt: User-agent: * Disallow: trackprice.php I believe this Diclairation in Robots.txt is right.. No? If so, why google did not follow Robots.txt rules & indexed URLs matching these patterns? Am i doing something wrong here? Cheers Natasha T Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/ Share on other sites More sharing options...
natasha_thomas Posted March 24, 2011 Author Share Posted March 24, 2011 Is this the right Declaration: User-agent: * Disallow: /trackprice.php Disallow: /bookmark.php OR User-agent: * Disallow: trackprice.php Disallow: bookmark.php Which of the two is right Declaration in Robots.txt? Cheers N Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1191712 Share on other sites More sharing options...
cssfreakie Posted March 24, 2011 Share Posted March 24, 2011 Hi Natasha, this is a website on how to write disallow things in a textfile: http://www.robotstxt.org/orig.html#examples As far as being still indexed, i think it will takes some time for google to remove your from their index, here is some info, i think you can use google webmaster tools for this, never done it though http://www.google.com/support/webmasters/bin/answer.py?answer=164734 Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1191728 Share on other sites More sharing options...
natasha_thomas Posted March 24, 2011 Author Share Posted March 24, 2011 Hi Natasha, this is a website on how to write disallow things in a textfile: http://www.robotstxt.org/orig.html#examples As far as being still indexed, i think it will takes some time for google to remove your from their index, here is some info, i think you can use google webmaster tools for this, never done it though http://www.google.com/support/webmasters/bin/answer.py?answer=164734 Thanks Frikiey, You are always so helpful. Cheers Natasha T Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1191805 Share on other sites More sharing options...
cssfreakie Posted March 24, 2011 Share Posted March 24, 2011 hehe no problem Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1191812 Share on other sites More sharing options...
KevinM1 Posted March 24, 2011 Share Posted March 24, 2011 D'oh, wrong thread Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1191850 Share on other sites More sharing options...
Philip Posted March 24, 2011 Share Posted March 24, 2011 D'oh, wrong thread Free post! Woo! I have nothing of value to add to this thread, apologies. Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1191957 Share on other sites More sharing options...
xylex Posted March 25, 2011 Share Posted March 25, 2011 Do you have Robots.txt instead of robots.txt? That would do it. Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1191993 Share on other sites More sharing options...
natasha_thomas Posted March 25, 2011 Author Share Posted March 25, 2011 Do you have Robots.txt instead of robots.txt? That would do it. in FTP i have robots.txt Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1192026 Share on other sites More sharing options...
crmamx Posted March 25, 2011 Share Posted March 25, 2011 Thanks Frikiey, You are always so helpful. He is a walking encyclopedia... Link to comment https://forums.phpfreaks.com/topic/231567-why-still-indexed-by-google/#findComment-1192162 Share on other sites More sharing options...
Recommended Posts
Archived
This topic is now archived and is closed to further replies.