I am excited to be User Of The Day out of over 25,000 active users on the MilkyWay@Home project. I have been helping the project compute data for a 3D model of our galaxy. MilkyWay@Home - Several years ago I was the User Of The Day on Einstein@Home
Not only did the Baidu Bot and BingBot crawl a restricted URL listed in my robots file. But they both acquired the URL address from the same instruction to not index it. It was a "bad bot" trap, and it worked. But surprising from 2 of the internet's top search engines.