Shero Support

How can we help?

Follow

How to block Baidu from accessing your website

The Baidu crawler really likes a website for some reason that can't really
be explained.If you tail the apache log, over 90% of requests are coming from Baidu, which ends up consuming all of your website's bandwidth. We do see this from time to time and don't know why Baidu it is being so aggressive. Only the developers behind the bot would be able to explain. 

 

The solution: Temporarily block this crawler in your .htaccess. This will stop the excessive bandwidth usage to your site. In a few days you can comment out the lines in the .htaccess file blocking the crawler to see if its weird behavior has stopped.

This is the code you can use: 

BrowserMatchNoCase Baiduspider bot
order deny,allow
Deny from env=bot

Comments