Question : Robots.txt and Googlebot

I accidentally messed up robots.txt and googlebot stopped crawling my site. googlebot usually crawls my site all day long.

Will googlebot crawl my site again?

When can I expect googlebot to be back?

Answer : Robots.txt and Googlebot

Yes it will get there again. One sure fire way to ensure it comes back soon would be to sign up to there Webmaster tools, verify your site and upload an XML sitemap to Google with all of your pages URLs in.

http://www.google.com/webmasters/tools/

Google will DEFINITELY come back with this technique.

Shane

Random Solutions  
 
programming4us programming4us