There is a nasty "robot" from the domain http://www.cuill.com/twiceler/ that is using up to 6.45 GB of bandwidth per day. It doesn't appear to honor our "robots.txt" file that tells them what to link. It hails from a range of IP addresses owned by PSI.NET out of Washington DC. I have blocked the entire range of IP addresses starting with 38.99.*.*, so if you know of anyone who has had trouble connecting to messing-about.com, that may be the reason.
There is no solution to the problem. Search engines are now banned from messing-about.com and my sister sites via the use of the robots.txt file, and I will continue to restrict IP addresses from robots that don't honor the robots.txt file.
1 reply to this topic
