spider only checks first vhost? How to enable spider to check all vhosts?

[turnbui]

Hello everyone,

I am running Apache2.2 with vhosts on Windows XP home. From my logs I can see both Google and Yahoo checking the first defined vhost in the vhosts.conf but none of the others are being checked.

I'm using name based vhosts. How can I get the spiders to check the remaining vhosts please?

[trq]

Are these vhosts using different domains?

[turnbui]

http://iants.homeip.net

http://ian21.homeip.net

As I understand it homeip.net is the domain so yes. Thanks.

[trq]

I don't think theres anything apache can do about that. Maybe spiders don't like investigating into subdomains. Theres nothing apache would be doing to stop them however.

 

I think this may be more of an SEO question than that of apache help.

[turnbui]

Thanks. Rats!

[turnbui]

Allow: ../tony2htdocs/index.html

Allow: /../tony2htdocs/index.html

 

Not sure which one did it but I'm now getting both googlebot and yahoo.net visiting both my vhosts. I think the 2nd one with leading / is incorrect. Will remove it and retry.