Frank Hagan Posted May 22, 2007 Report Share Posted May 22, 2007 There is a nasty "robot" from the domain http://www.cuill.com/twiceler/ that is using up to 6.45 GB of bandwidth per day. It doesn't appear to honor our "robots.txt" file that tells them what to link. It hails from a range of IP addresses owned by PSI.NET out of Washington DC. I have blocked the entire range of IP addresses starting with 38.99.*.*, so if you know of anyone who has had trouble connecting to messing-about.com, that may be the reason. There is no solution to the problem. Search engines are now banned from messing-about.com and my sister sites via the use of the robots.txt file, and I will continue to restrict IP addresses from robots that don't honor the robots.txt file. Quote Link to comment Share on other sites More sharing options...
Frank Hagan Posted June 14, 2007 Author Report Share Posted June 14, 2007 The IP range has been "unblocked" for now. Quote Link to comment Share on other sites More sharing options...
Recommended Posts
Join the conversation
You can post now and register later. If you have an account, sign in now to post with your account.