Microsoft's Hotmail gets new storage system

Microsoft's Hotmail web-based email service is supposed to reveal a number of new features at a press event in early October. But before that event happens, Microsoft decided to reveal a new way that it is handling the data storage on Hotmail. In a new entry on the Windows Live blog site, Microsoft's Kristof Roomp talks about its upcoming storage improvements that will be put in place later this fall.

Just in case you might be wondering about Hotmail's stats, Roomp says, "Hotmail’s storage system supports over one billion mailboxes and hundreds of petabytes of data (one petabyte is a million gigabytes, or a million billion bytes). The system services hundreds of thousands of simultaneous transactions from across the world." Microsoft has been using a RAID set up for the Hotmail storage system for while. For those who are not familiar with the term, A RAID (Redundant Array of Inexpensive Disks) system basically links up two or more hard drives to one controller board. To the operating system, multiple drives under a RAID set up look like one big hard drive.

Roomp says that kind of storage system works if just one of the drives fails but " ... they don’t help if the whole machine or the RAID controller runs into problems. For larger drives, we found that having completely independent copies (on hard drives not sharing the same machine or controller) was much more reliable than a significantly more expensive RAID configuration."

The new Hotmail storage system is name JBOD (Just a Bunch Of Disks). In essence, the hard drives, instead of being connected to one controller board, are handled in software. Roomp says, "The software we developed for the JBOD system monitors the hard drives schedules repair actions, detects failures, and diagnoses repairs. This software consists of a number of “watchdogs” that constantly monitor for certain types of failures. If the watchdog detects the failure that it is looking for, it raises an alert, which automatically triggers a repair process." About 30 million Hotmail users are already using the new system and 100 million more will be transferred in the next couple of months.

In addition, Hotmail will also add solid state drives to handle other functions. SSDs are much faster than normal hard drives but are also much more expensive. Roomp says the new Hotmail storage system will use SSDs to handle features like "the list of messages in your inbox, read/unread status of your messages, conversation threading, mobile phone synchronization etc." This kind of data normally takes most of a hard drives activity. With SSDs handling this data and normal hard drives handling the actual email storage Roomp says, " ... we are able to take advantage of the trend in larger and cheaper hard drives without making any sacrifices in the performance of our system."

Report a problem with article
Previous Story

Battlefield 3 DLC packs to be released for PS3 owners first

Next Story

Next Big Thing: Browserstack

15 Comments

That's the first I've ever heard of using SSD's for production environments at the server level like this, and especially the first time for a free email service! Microsoft's really on the ball these days.

Oh my god, SSDs, maybe it'll start pushing the price of them down if they start using insane numbers of them doing things like this!

xpclient said,
Hotmail is improving continuously these days. Windows Live Essentials needs to take a cue from it.

wait till windows 8.. im pretty sure they have been holding back for a huge update for next year.

Windows Server/SQL/Exchange needs these features. Where's MY option to slap in an unraided SSD just to host a copy of the database indexes? Why does MY software RAID suck so much that it's practically not an option?

jasonon said,
wowww these ssd's will be used with skydrive as well?

Not likely - Skydrive doesn't quite need discs that fast yet - and even with Hotmail, they're not actually using the SSD's to store your actual emails, just supporting content. Considering we get upto 25GB + Extra Mesh space and device storage, you're looking at maybe 5 people per SSD? That's a ridiculous cost for them for a free service.

RAID actually stands for Redundant Array of Independent Disks. It was changed from "Inexpensive Disks" to try to dissociating a low-cost expectation from RAID technology

GMail is also using JBOD. Microsoft also recommend JBOD as an option for Exchange 2010 with since the addition of DAG's.
Its great to see new methods of making use of storage without RAID.

~Johnny said,
And people wonder why their online divisions lose so much money But it's a win for consumers, so awesome .

It is awesome, and the original post cited that this change was done in part to save money. They are spearheading some cool tech with upgrade.

Commenting is disabled on this article.