main
Report a problem

Explosion at theplanet knocks out 9000 servers

Steven Parker   on 01 June 2008 - 13:08 · 40 comments & 23647 views

Advertisement (Why?)
Neowins previous web servers host, ThePlanet based in Dallas Texas, suffered a major setback yesterday as an electrical fire allegedly caused an explosion, knocking out around 9000 of their customers hosted websites.

Marcus Langenveld writes: "Apparently there was an electrical fire at ThePlanet’s H1 data center in Houston Texas. According to some sources there was an actual explosion powerful enough that it knocked down walls in an equipment room. So far there are no reports of damage to servers or networking equipment but power is offline at the facility and approximately 9000 websites are affected. This will surely be all over the tech news websites by morning. <- You got that right! - Ed.

View: Marcus Langenvelds Blog + theplanet customer statement
View: Updated information by the staff @ ThePlanet Forum

Update
Just over an hour ago staff member, Todd Mitchell posted an update on the situation:
Morning,

We are continuing to work through various issues this morning. We will have additional contractors on-site this morning starting at approx. 7 AM. Some will hand-off from contractors who worked overnight and others will start the recovery/installation of new electrical gear to power the data center.

We are still working through the EV1 DNS and ServerCommand items. We are making progress on both items and expect to have both functional within the next 120 minutes.

In addition to the above, the network engineering group worked overnight to prepare the network for the recovery of H1. We expect the reconvergence of the network to go smooth once H1 comes back online.

We do not have an Estimated Time to Repair at present; we should have a better estimate this morning. Our staff and management continue to work through the night and morning-- we will continue to provide hourly updates.

Todd

Post a comment · Send to friend Comments · There are 40 additional comments
#1 Ste on 01 Jun 2008 - 13:14
thank god i moved outta there a few months ago...


ste
#2 Neobond on 01 Jun 2008 - 13:15
Same here, they were always quite good for Neowin though! Hope they sort it and no-one was harmed in the process..
#3 StonedMonkey on 01 Jun 2008 - 13:17
My sites are all affected :/ been down since early evening yesterday.
#4 Lare2 on 01 Jun 2008 - 13:34
Been hosted there before. Wondering if any major site got hitted ?
#5 Ste on 01 Jun 2008 - 14:12
update 2:

Hello,

The team here at The Planet continues to work through the various issues that we continue to encounter. We are still making progress on the previous items that I mentioned in my last post. DNS infrastructure has been migrated to another data center and propagation has begun. We are working through some database issues with ServerCommand and fully expect those to be resolved within the next hour.

I’d also like to address the idea of migrating from one data center to another. During the early stages of the H1 data center we opportunistically relocated some customers to another data center. However, due to network and data center (power/cooling) constraints, this option is no longer available and requests for migration cannot be honored. Please rest assured that our teams are working diligently to return service to all affected customers.

At this time we do not have an Estimated Time to Repair at present; we should have a better estimate this morning. Our staff and management continue to work through the night and morning-- we will continue to provide hourly updates.

Todd

(1 reply) #6 superkid on 01 Jun 2008 - 14:12
I wounder if the hard drives will be damaged, hopefully they can recover some websites..
#6.1 +M2Ys4U on 01 Jun 2008 - 15:04
"We have determined that no servers in the data center have been damaged. Nonetheless, they are down because power is out."
#7 WAR-DOG on 01 Jun 2008 - 14:38
i want pics of the explosion!
(2 replies) #8 z0phi3l on 01 Jun 2008 - 14:45
Wow that blows, every minute a single site is down costs them money, imagine how much is being lost over this issue
#8.1 toadeater on 02 Jun 2008 - 04:07
Not as much as I'm losing filling up my gas tank thanks to another famous product of Texas.
#8.2 schubb on 02 Jun 2008 - 14:11
(toadeater said @ #8.1)
Not as much as I'm losing filling up my gas tank thanks to another famous product of Texas.


No one else is going to make it any better either, not NY, not IL, not AZ. You should be able to figure out what I mean.
#9 nvme on 01 Jun 2008 - 14:49
luckily my server wasn't affected. they reported that none of the servers or networking equipment were damaged so it looks like the data on the systems is fine.
#10 +M2Ys4U on 01 Jun 2008 - 15:02
My server is still up, thankfully :|
#11 +Chrono951 on 01 Jun 2008 - 15:05
I wonder what caused the explosion. Maybe the fire started in a chemical closet or something?
(1 reply) #12 Patchou on 01 Jun 2008 - 15:31
yup, some of my servers are down alright.

I want pics too.
#12.1 Magallanes on 02 Jun 2008 - 15:16
(Patchou said @ #12)
yup, some of my servers are down alright.

I want pics too.



Exclusive photo :



(1 reply) #13 Tikitiki on 01 Jun 2008 - 15:31
Ouch - someone is getting fired
#13.1 +Smigit on 01 Jun 2008 - 16:07
only if someone caused the problem. It's possible that it was just some hardware they had laying around that had a spac. Will have to wait and see.
#14 vetKoDeXeRo on 01 Jun 2008 - 16:37
hehe.. howard from Horwardforums.com is a funny guy:

ZOMG!!! The HowardForums Image Server is down (something at the Data Center caught fire). This will cause pages to load slowly. Turn images off to speed things up or use wap.howardforums.com or if you're just bored.....



I was wondering why that was happening. Now it makes sense.
#15 vetHorrocks on 01 Jun 2008 - 16:51
Ouch, my site has been down since yesterday. Now I know why
#16 Deathray on 01 Jun 2008 - 17:38
I was wondering why the web was behaving oddly... At least some sites in particular

Hope it gets sorted out quickly
#17 funciona on 01 Jun 2008 - 17:55
So thats why http://www.mess.be was/is down...
(1 reply) #18 scotty588 on 01 Jun 2008 - 19:57
The fire was at The Planet's Houston datacenter aka EV1 (Everones Internet) before TP bought them out. This was not at their Dallas DC.
#18.1 DaveLegg on 01 Jun 2008 - 20:18
You are indeed correct. I have updated the story to correct this mistake
(1 reply) #19 Xocide on 01 Jun 2008 - 21:17
ThePlanet are ****tards.
#19.1 stifler6478 on 01 Jun 2008 - 22:07
???

I'm sure they would much rather their servers didn't catch fire.

-Spenser
(2 replies) #20 +The Cub on 01 Jun 2008 - 23:05
I wonder if http://www.msgpluslive.net is/was hosted there
#20.1 salis on 02 Jun 2008 - 01:36
yep
Nameservers for www.msgpluslive.net:

* ns1.ev1servers.net returned (SERVFAIL)
* ns2.ev1servers.net returned (SERVFAIL)
#20.2 Patchou on 04 Jun 2008 - 18:04
Some of the Messenger Plus! services are hosted at EV1 yes. For the main web site, it's just the DNS that was knocked off.
#21 :: Lyon :: on 02 Jun 2008 - 00:01
Yeah and also Entrecard.com, the best blogger community out there. It's been down for around 2 days now
#22 Saladas on 02 Jun 2008 - 00:27
The fuselage [http://www.thefuselage.com/] was also hosted there, one of the best sites for lost addiction
#23 Ironman2003 on 02 Jun 2008 - 01:46
A major local forum here in my town got taken down by it. Before it went down, their servers were really lagging anyway, so I figured it was them taking it down. Good to know it wasn't because of that.

(1 reply) #24 Kaidiir on 02 Jun 2008 - 04:12
Wait... how many servers were knocked out?
.
.
.
.
OVER 9000!
#24.1 Tha Bloo Monkee on 02 Jun 2008 - 14:15
Good one!
(1 reply) #25 Sirius on 02 Jun 2008 - 07:13
Looks like Chuck Norris was out of town
#25.1 Lare2 on 02 Jun 2008 - 08:10
He's in Dallas right now, god knows for what reason
(2 replies) #26 webeagle12 on 02 Jun 2008 - 09:02
TODAY SPECIAL" Server Blowout Sale



http://www.theplanet.com/news/pr/pr20080522.asp LFMAO
#26.1 u2_storm on 02 Jun 2008 - 09:28
(webeagle12 said @ #26)
TODAY SPECIAL" Server Blowout Sale



http://www.theplanet.com/news/pr/pr20080522.asp LFMAO


#26.2 chisss on 02 Jun 2008 - 20:41
now that's just wrong...
#27 Unholy Moley! on 03 Jun 2008 - 19:21
WHAT NINE THOUSAND?!

Commenting has either been disabled on this article or you are not logged in. Click here to login or register, its free!

Note: Anonymous commenting is disabled in order to keep the quality of responses to a high standard.

Advertisement (Why?)