DNS monitoring timeout alerts, 2013-03-29 00:45Z onwards

Hi, At approximately 00:45Z this morning, customers with DNS domains hosted by BitFolk would have started receiving lots of CRITICAL and then RECOVERY alerts which went on through the night. Also, customers who monitor external DNS servers with their own software may have seen similar issues. This was due to rate-limiting of UDP/53 traffic put in place by our transit provider without our prior knowledge. I have been in discussion with them and the change was backed out at around 08:20Z. There is no need for you to take any action. We are still investigating the full extent of what took place. If you have any evidence that DNS queries (other than those from your monitoring software) failed, I would be interested to know. Please do let me know off-list. Now that the rate-limiting is disabled I do not expect further problems but I will follow up on what happened when I have more information. Cheers, Andy -- http://bitfolk.com/ -- No-nonsense VPS hosting