Graphic Bar
D3xt3r.com
Panel
Graphic Bar
Honeypot & Baidu

12.22.2012

For my friends that are web developers. I advise you to not trust the Baidu Bot. Baidu is the most popular search engine in China. However, I recently caught Baidu with my own honeypot trap. I told no website to crawl a certain page on my website with a robots.txt file. I also didn't link to the page anywhere else. However, Baidu not only visited the page, and they must have got the link to the page via the robots.txt file that was denying them access to it (or guessed the page name, which is unlikely). Extremely shady I think. Why crawl if they are not indexing also.

Also, be on the look out for referrer spam, as many bots are roaming the net lately with fake referrer information. I guess in hopes of increasing backlinks on sites that have referrers public, or getting traffic from administrators.



My works are covered under D3xt3r.com Works



Comments


Name

Website

Email (Not public.)
Comment


d3xt3r d3x d3xt3r.net www.d3xt3r.net
Online | 1,620,418 Hits | 5 Users Online | Load 0.078 Secs
Website Design & Implementation By D3xt3r
Powered By X.D.D | W3C Validate: HTML/CSS
veltx veltix d3xt3r d3x dex dexter