[bitfolk] 2010-09-06 0030Z: Emergency reboot of curacao.bitfolk.com

Hi, On the afternoon of the 5th September a customer on curacao attempted to reboot their VPS and encountered an error. They were then unable to start their VPS at all. We were also unable to start the VPS, with a very generic "failed" error message coming back from Xen. Being unable to start the customer's service, the customer's VPS was eventually moved to another server. On further investigation it's proving impossible to create any new virtual machine on curacao and I believe it's going to require a reboot to get back into a working state. This needs to be carried out ASAP since any customer on curacao who shuts down or reboots their VPS will currently be unable to start it again. I am therefore about to reboot curacao, starting at 0030Z (01:30am UK time). Customer VPSes will experience a clean shut down and later start up again. I believe the root cause will be a bug in Xen, and curacao is already scheduled for a major OS upgrade, which will be accomplished at a later date by moving all of its customers to new hardware. The current uptime is 410 days. Please accept my apologies for the disruption. Cheers, Andy -- http://bitfolk.com/ -- No-nonsense VPS hosting