Skip to main content

Posts

Showing posts from February, 2023

How to fix high server load caused by bot indexing

 If our Technical Support team has contacted you due to your website or server being under heavy load, it could be for a number of reasons, including: Your website is experiencing a high number of website visitors Your website or server is under some form of DDOS attack Search Engine or other bots could be crawling your website excessively In this article, we’ll cover the details on what you can do if bots are causing high server load. What is a bot? A bot or web spider is a software application which performs repetitive and automated tasks via the Internet. Search Engines, such as Google, use these bots to crawl websites, collecting information on the website. When a bot crawls a website, it uses the same resources that a normal visitor would do; this includes bandwidth and server resources. Not all bots are benign in nature, though: some bots crawl websites for more nefarious purposes, such as harvesting email addresses for spamming or looking for vulnerabilities to exploit. Iden...