AmigoFish blipped off the net last evening. That sort of thing always gives one a sinking feeling, but this did seem different from an average box outage because the name didn’t even resolve DNS. By fooling around a little, I was able to figure out that it wasn’t just my box but a big chunk of the hosting company. Their nameservers were down, and even the management console for the account gave a “Host not found” error. Uh oh.
Later in the evening I got an email from The Planet that included this information:
This evening at 4:55 in our H1 data center, electrical gear shorted, creating an explosion and fire that knocked down three walls surrounding our electrical equipment room Thankfully, no one was injured. In addition, no customer servers were damaged or lost.
We have just been allowed into the building to physically inspect the damage. Early indications are that the short was in a high-volume wire conduit. We were not allowed to activate our backup generator plan based on instructions from the fire department. This is a significant outage, impacting approximately 9,000 servers and 7,500 customers.
My apologies for anyone that tried or tries to use AmigoFish while this outage is occurring. As soon as The Planet gets their stuff resolved, I’ll get AmigoFish back up. This sucks big time but I’ll get it resolved as soon as I can after the hosting company gets service restored.
