OrangeSoul Posted September 12, 2003 Share Posted September 12, 2003 http://web.archive.org/web/20020731104952/....com/robots.txt they are blocking google bots and waybackmachine bots Link to comment Share on other sites More sharing options...
Steven Posted September 12, 2003 Share Posted September 12, 2003 ok and this is important because...... :unsure: Link to comment Share on other sites More sharing options...
OrangeSoul Posted September 12, 2003 Author Share Posted September 12, 2003 because they block google Link to comment Share on other sites More sharing options...
+BudMan MVC Posted September 12, 2003 MVC Share Posted September 12, 2003 So? It is there site - if they do not want it to be searched, they have that right. Link to comment Share on other sites More sharing options...
Fred Derf Veteran Posted September 12, 2003 Veteran Share Posted September 12, 2003 because they block google whatever Link to comment Share on other sites More sharing options...
Fedorpheux Posted September 12, 2003 Share Posted September 12, 2003 maybe they just dont want google news to steal their traffic or something...or maybe they're just completely insane...either way, it's up to them :p Link to comment Share on other sites More sharing options...
Steven Posted September 12, 2003 Share Posted September 12, 2003 because they block google and this is important because..... :unsure: Link to comment Share on other sites More sharing options...
cyclingplatypus Posted September 12, 2003 Share Posted September 12, 2003 :rolleyes: Ummmmm....ok.... :rolleyes: Link to comment Share on other sites More sharing options...
Miyagi Son Posted September 12, 2003 Share Posted September 12, 2003 that is a lame header. Link to comment Share on other sites More sharing options...
Steven Posted September 12, 2003 Share Posted September 12, 2003 Link to comment Share on other sites More sharing options...
Recommended Posts