main

Editorial: Yankee Group Spreads On The FUD

Michael Stanclift   on 07 June 2006 - 15:07 · 57 comments & 32872 views

Advertisement (Why?)
Monday, technology research firm Yankee Group released a report claiming that "Windows 2003 Server is a more reliable server operating system than Linux." Fair enough, I'm open minded enough to give the assessment a fair shake. I administrate both Windows and Linux servers and was interested to see this report. However, reading into the article a bit more makes me question the validity of their assessment.

The Yankee Group states that Windows 2003 Server led Red Hat Enterprise Linux with nearly 20% more annual up time.

I had to do a double take when I saw that. 20% more!? Assume for a moment that you have two servers, one running Windows Server 2003 and one running Red Hat Enterprise Linux 4. Assume that your Windows box ran non-stop, without rebooting (which means you probably are not loading any Microsoft security updates) for 365 days. For your Linux box to have 20% more downtime it'd have to only be up for 292 days. If that is the case, your machine is no longer a server and is nothing more than a space heater.

Looking into the Yankee Group, and the analyst who contributed to this article, Laura DiDio, it can quickly be decided that they can hardly be seen as an objective source for technology analysis. Yankee has regularly been tasked and paid by Microsoft to provide "objective" reviews for its Get the Facts campaign (see all 184 results from Microsoft's website). The Facts campaign is the same campaign that said one company switched from Linux because they had been effected by the Blaster worm (a Windows worm) on their Linux systems which caused them massive down time and as a result made the switch to Windows Server systems. (read that one for yourself)

Continue reading...

View: Full Editorial
I'm not jumping to conclusions to say that Microsoft paid the Yankee Group to put out this analysis as they have done in the past. Yankee did make a point of stressing that the survey was not sponsored or supported by any server OS maker. That aside, a research group that has continually been used to produce bias results cannot really be trusted to bring objective opinion to the table, especially when they make claims of being 20% better.

From my experience, Windows servers require far more restarts and downtime than any Linux system. Typically a Linux server only needs a full restart upon upgrade of the kernel, which happens very rarely. Windows Servers will at the least need to be restarted once a month on "patch Tuesday." Are there Windows systems that outperform Linux systems, yes, absolutely. A properly configured Windows server network with redundancy and backup systems will probably perform at the same level (or at least within a few tenths of a percentage point) of efficiency as a similarly configured Linux counter part. If your organization, regardless of if you run Windows or Linux, has 73 days of downtime per year, you need to hire new IT people now!

The Windows Server system is good stuff. My real life company relies on Windows and I use Linux servers for other tasks (such as Neowin) and can say with experience that Microsoft has made great strides in their server platform over the years. However, I refuse to believe the statement that Windows Server provides what the Yankee Group says, and has said in the past.

View: Original Article @ Yahoo News
View: About Laura DiDio @ Wikipedia
View: The Yankee Group | Report

Post a comment · Send to friend Comments · There are 57 additional comments
(2 replies) #1 reidtheweed01 on 07 Jun 2006 - 15:29
Arnt you just doing the same thing they are? Pushing one OS by saying its better.
#1.1 Marshalus on 07 Jun 2006 - 15:34
I'm not trying to say either one is better. Each has it's own purpose, advantages, disadvantages, etc. I'm disputing their claim that Windows has 20% better uptime than Linux. I take issue with their past as well, working for Microsoft to produce "unbias" analysis.
#1.2 Coolme on 07 Jun 2006 - 21:12
No, this article is not pushing any OS by saying it's superior. It's pointing out that a particular study of windows and linux OSes is bias. Seriously man, read the article. I mean some of the things they were saying were just, impossible...
Quote -
The Facts campaign is the same campaign that said one company switched from Linux because they had been effected by the Blaster worm (a Windows worm) on their Linux systems which caused them massive down time and as a result made the switch to Windows Server systems.
(3 replies) #2 Quick Reply on 07 Jun 2006 - 15:30
Look at that Wikipedia Article.... Would you trust that ugly monster? somebody call a surgeon!
#2.1 apa1exakis on 07 Jun 2006 - 15:47
Grow up. There's no need for a comment like that.
#2.2 quanta on 07 Jun 2006 - 16:41
I've actually met DiDio in 2004 at a Toronto conference when she was presenting the Sunbelt-sponsored TCO findings (BTW: Sunbelt is a Microsoft Gold certified partner).

I wrote about the talk in my blog, it ended kind of funny: http://www.silentblue.net/mtarchives/000946.html
#2.3 lbmouse on 07 Jun 2006 - 18:40
You can only believe about 20% of what comes out of DiDiot's mouth.
#3 Express on 07 Jun 2006 - 15:49
Neowin Editorial Spreads on the FUD.
(2 replies) #4 linked on 07 Jun 2006 - 15:50
Always nice to see... a front page opinion?
WTF is this doing on our news site? There's already a nice long argument thread about this in the forums; looks like the author's shameless whoring of his own take on the matter, forced down our throats by his mod-power.

As for the "20% more uptime" claim, we run into this sort of thing all the time in statistical annalysis- Odds are, they meant to say "20% less downtime", which is perfectly viable. ("Less down" means "more up", right? Wrong.)
#4.1 Joel on 07 Jun 2006 - 16:04
Quote - linked said @ #4
Always nice to see... a front page opinion?
WTF is this doing on our news site? There's already a nice long argument thread about this in the forums; looks like the author's shameless whoring of his own take on the matter, forced down our throats by his mod-power.

It's amusing to what people like you will read into something. How is typing an opinion "whoring"? He's presenting a discrepancy by stating that the "unbiased" source has in fact been hired by MS to do these objective test before.

Have any of you people ever read an actual newspaper? It's that thing they sell at newsstands, made from paper (a pulped tree, bleached and flattened to allow for printing and portability)? There are editorial sections in those too, you know.
#4.2 nacs on 07 Jun 2006 - 17:20
Right. And he made you sit there and made you read it right?

If you don't want to read the opinion piece--here's a thought--DON'T READ IT. Skip over. Amazing!
(4 replies) #5 raskren on 07 Jun 2006 - 15:53
How about letting people read the article and form their own opinions? Is that too hard?

"Coloring" news articles as their posted isn't journalism.
#5.1 markjensen on 07 Jun 2006 - 16:00
raskren, this is clearly labelled an "editorial". And the amazing thing is that all news media (printed, televised, and other) contains editorials.

As for the news item this is commenting on, it seems that the common media is misrepresenting the Yankee report, or the Yankee Group has unintentionally misled the media - perhaps a mis-typed news release.

Here is a better source: http://www.iaps.com/2006-Server-Reliability-Survey.html
#5.2 raskren on 07 Jun 2006 - 22:12
Was it always an editorial? I could have sworn it was a news post this morning.
#5.3 shanepitman on 07 Jun 2006 - 22:43
It was always an Editorial.
#5.4 raskren on 08 Jun 2006 - 15:02
OK. I retract my previous statement then.
(1 reply) #6 Martin Blank on 07 Jun 2006 - 15:58
The article title opens with the word "Editorial." Based on your post, it would seem that no newspaper should have an editorial page, because it would affect the opinions of the readers.
#6.1 linked on 07 Jun 2006 - 16:01
EDIT-- Meh, comment removed, I was rude =P
(1 reply) #7 Joel on 07 Jun 2006 - 15:59
Quote - Express said @ #3
Neowin Editorial Spreads on the FUD.

An example of that claim, please.
#7.1 werejag on 07 Jun 2006 - 18:14
Quote - Joel said @ #3.1
Quote - Express said @ #3
Neowin Editorial Spreads on the FUD.

An example of that claim, please.


joel

express wont provide any facts to support his claim these fanboys never do
#8 Jugalator on 07 Jun 2006 - 16:06
Quote -
"Windows 2003 Server is a more reliable server operating system than Linux."

I wonder what such a broad claim serves to make? WHAT kind of servers? I mean, a server can be anything from a home user one being based on a 50 MB large Linux distro running an FTP, to a load balanced multi-computer cluster serving millions of requests per day.

Anyway, Linux is way more common in many server markets, so obviously the OS is doing something right, and stability is waay up on any admin's list, almost always moreso than cost due to economical and PR losses if it's not up. I'll leave it at that and let others draw conclusions.
#9 Sp3ctranova on 07 Jun 2006 - 16:06
pwned.
#10 simon360 on 07 Jun 2006 - 16:14
Good editorial! Iknew something was wrong with it, my Linux server can run for months without going down, although on low traffic (very low). I'mnot saying Windows server is bad, but I think something is wrong with that survey.

I think we need more editorials like these.
#11 JiggyTom on 07 Jun 2006 - 16:24
it was an interesting read nonetheless.
#12 Divide Overflow on 07 Jun 2006 - 16:32
This just in. . Fox News admits that it is a right wing news agency, far from being fair and balanced. More opinions at 11. Since when did this site turn into Neodot? Since when does an immature fanboyish ****ing contest of an "editorial" like this were only welcome on Slashdot?

Last edited by Divide Overflow on 07 Jun 2006 - 17:13
(1 reply) #13 jb23fan on 07 Jun 2006 - 16:37
WHAT THE HELL is this Fanboy crap doing on the frontpage?!?! - Surely we can do better than this.
#13.1 Coolme on 07 Jun 2006 - 21:14
Please, care to explain by what you mean?
#14 Krome on 07 Jun 2006 - 16:40
Almost all "surveys" are never been an indisputable fact. It's mere someone's opinion based on datas that can misrepresented. I have not seen any survey that ask the right question or datas collected in the right way. This is one example of such. Even with that B. A. degree, I am not amused.
#15 The_Decryptor on 07 Jun 2006 - 16:58
Yes, the mothership is calling, back to Redmond!

How is pointing out a biased report "fanboyisim"? that's like saying, if Bill Gates said he was god, and somebody pointed out the fact he cant be, then them ending up getting called a fanboy, it makes no sense.
(2 replies) #16 shockz on 07 Jun 2006 - 17:04
See EDITORIAL in the news title... i don't know about you... but I've been around Neowin since Mid 01' and editorials have always been a part of the site
#16.1 shockz on 07 Jun 2006 - 17:07
Oh I forgot to mention the large image in the news article



#16.2 NeoTrunks on 07 Jun 2006 - 17:47
It's not an editorial if it hurts someone's feelings, apparently. :/
#17 Divide Overflow on 07 Jun 2006 - 17:15
Quote - The_Decryptor said @ #12.1
Yes, the mothership is calling, back to Redmond!

How is pointing out a biased report "fanboyisim"? that's like saying, if Bill Gates said he was god, and somebody pointed out the fact he cant be, then them ending up getting called a fanboy, it makes no sense.
Because the report states opinion as fact, and only uses the report as a point of argument. I don't give two ****s who an editorial supports, I don't want to see opinions posted on the front page. If I want that I'll go read Slashdot or something by Thurrott.
#18 nacs on 07 Jun 2006 - 17:22
It's fanboy crap because he doesn't cheer for Microsoft. And I'm glad you presented your facts and opinions on this article so clearly in your comment. </sarcasm>
(1 reply) #19 nacs on 07 Jun 2006 - 17:24
Quote - Divide Overflow said @ #14.1
I don't want to see opinions posted on the front page. If I want that I'll go read Slashdot or something by Thurrott.


It's clearly marked "Editorial" in a big red circle. If you still want to moan and bitch and whine, then go ahead and stop coming to Neowin. Please. You'll do us all a favor.
#19.1 Divide Overflow on 07 Jun 2006 - 17:35
Quote - nacs said @ #16.1
Quote - Divide Overflow said @ #14.1
I don't want to see opinions posted on the front page. If I want that I'll go read Slashdot or something by Thurrott.


It's clearly marked "Editorial" in a big red circle. If you still want to moan and bitch and whine, then go ahead and stop coming to Neowin. Please. You'll do us all a favor.


I don't care if it's marked as an editorial. Anyone posting flamebait like this on the front page on this site is just looking to stir up a controversy. And just a thought. . you're bitching about my whining. . how ironic.
#20 m-head on 07 Jun 2006 - 17:45
What in the world has possessed all of these people to become such moaning idiots all of a sudden? I've never seen people bitch this much about something on Neowin.

The situation here is the same as bitching because a bag of nuts contains nuts. It's labelled that it's a bag of nuts, and you know it's going to be a bag of nuts when you open it. But you still moan as if you're surprised at it being nuts?

Replace nuts with editorial. Shut up and get on with your life if you don't like nuts.
(1 reply) #21 selphj on 07 Jun 2006 - 17:45
To the editorial: Any admin knows that reliability is more than just how much time your server is up and running your OS. It involves services availability and how much time the admin is constantly fiddling with the system. The report states that the problem with linux is it's mismash of conflicting documentation online, where as Microsoft is more consistent and reliable on that front. And the point is valid. The docs redhat has aren't much either. So I would say it's accurate that linux takes 20% more time for an average admin than Windows 2003. That's highly dependent on the people involved. But generally you'll find more good Windows admins in IT than linux, and taking that into account I think the report is valid. For most companies, they'll have less trouble out of Windows 2003. Now with us, we have top notch people in both areas. And our Windows 2003 and RHEL reliability are just about equal. But I don't think you'd find that kind of knowledgebase at IT in most companies.
#21.1 pixels on 07 Jun 2006 - 18:17
And that clearly vindicates his point: Regardless of the system, if you've got 73 days of downtime per year, you need to hire new IT people.
#22 shanepitman on 07 Jun 2006 - 17:52
I've worked in IT all of my adult life, administrated both Windows and Linux shops. In my personal opinion, both have their advantages and disadvantages. However, these days the two play very nicely together, more so than they ever did in years past. I find it very beneficial for some to operate mixed shops, especially for those who have limited budgetary concerns.

Edit: And for those of you bitching about an Editorial being on the front page of Neowin, Editorials have been a part of Neowin longer than most of you have and they will continue to be. Feel free to debate the content of them all you like, but if you don't like editorials, don't read them, it's that simple.

Last edited by shanepitman on 07 Jun 2006 - 18:06
(1 reply) #23 jb23fan on 07 Jun 2006 - 17:53
Quote - nacs said @ #12.1
It's fanboy crap because he doesn't cheer for Microsoft. And I'm glad you presented your facts and opinions on this article so clearly in your comment. </sarcasm>


I believe I presented my opinion that it is fanboy crap. Someone griping about one thing and praising another does not belong on the frontpage of a news site.
#23.1 nacs on 07 Jun 2006 - 19:19
Quote - jb23fan said @ #18.1
Someone griping about one thing and praising another does not belong on the frontpage of a news site.


It belongs there if it's marked "EDITORIAL". And it is labelled that way-- in a big red circle for those who have weak eyes. If you don't like editorials, don't read it.
#24 Eduardo on 07 Jun 2006 - 18:03
First article worth reading at Neowin in long time.
#25 pixels on 07 Jun 2006 - 18:15
IS EVERYBODY RETARDED? How is this flamebait? How is this fanboyism? He CLEARLY states that THEY'RE BOTH GOOD SYSTEMS. He never once said Windows Server sucked. He said that the "facts" presented by the survey had to be incorrect. He's right. He even said at the end that he uses both in his professional and personal lives and they both work very well. HOW IS IT FANBOYISM?!
#26 Jonny6pak on 07 Jun 2006 - 19:32
This is not an issue of one system being editorialized as better or worse, it is that an idea of 20% downtime is suspect and such results are being called to question. I don't see anything wrong with stating that such findings seem flawed and should be investigated. If anything the editorial should note to the reader that one should alwasy consider looking beyond the base claims prosented by any form of a statistical report. It's very easy to work the numbers in any direction when translating the results to an article or even a memo.
(1 reply) #27 Joshie on 07 Jun 2006 - 19:35
Ignoring all sides of the argument here, I just have one complaint, and it's a complaint I've had for a VERY long time.

Just because Microsoft asks a third party to do a test does not automatically make the results biased. SOMEBODY has to ask these people to do the tests, right? If the open source community asked, could we automatically assume the results are biased in favor of Linux?

It just seems retarded to think an organization is just gonna waste their time on a project without *some* party expressing interest first. To therefore automatically assume bias makes you look freakin' paranoid.
#27.1 lbmouse on 07 Jun 2006 - 19:58
You don't know DiDiot very well, do you? They would have had a less biased report if Ballmer had been the analyst. I wish it was just paranoia, but it is not... research her record and the records of the organizations she has been a part of.
(1 reply) #28 markjensen on 07 Jun 2006 - 19:59
You do realize that Microsoft often gives very specific parameters for testing, and has even specified registry changes for their systems in the tests. In the past, these parameters often key in on points where Linux is weaker, such as using certain RAID modes, or certain ethernet configurations. And, in none of these tests that I am aware of, was any RedHat or SUSE/Novell advice or adjustments made - just use default generic settings of an install.

The moral is, you cannot accept any summarized results without also knowing the details of the testing. In this case, there are barely ANY details.

Does it make me "freakin' paranoid" to doubt the conclusion of this report?

Does it make sense to you that a Windows sysytem has an average of 20% more uptime than a Linux system? Really? Because if Windows is close to 100% uptime (let's just say 5 out of 5 days uptime for a work week), then that means the Linux box was only up for about 4 days, and was down all day Friday. Every week.

Yes. I doubt this report. No sysadmin would accept 80% uptime on Linux or Windows.
#28.1 James123 on 07 Jun 2006 - 22:09
Quote - markjensen said @ #27.2
You do realize that Microsoft often gives very specific parameters for testing


The article doesn't state that Microsoft did or didn't give specific parameters, so could you possibly be sure that they did?

Quote - markjensen
Does it make sense to you that a Windows sysytem has an average of 20% more uptime than a Linux system? Really? Because if Windows is close to 100% uptime (let's just say 5 out of 5 days uptime for a work week), then that means the Linux box was only up for about 4 days, and was down all day Friday. Every week.

Yes. I doubt this report. No sysadmin would accept 80% uptime on Linux or Windows.


That's not actually what it means, it means that if the Windows server was down for say… 20 hours in the 365days it was running the Linux server was down 20% more (24 hours), albeit the article is badly written and doesn’t make this very clear.

That said… this article is still pointless because for all we know they might have configured the servers wrong and the downtime being there own fault.
#29 mx3 on 07 Jun 2006 - 20:07
Honestly, I don't see why this long editorial was necessary. Not that I'm against them on the front page in anyway, but you just need to look past the first paragraph in the report to see what they're talking about... When they say 20% they're referring to the data from the survey -- based on downtime.

"on average, individual corporate Linux, Windows and Unix servers experience three to five failures per server per year, resulting in 10.0 to 19.5 hours of annual downtime for each server."

Ok, so on average you're going to have, at most, 20 hours of downtime per year. And they did say that Redhat servers were the worst, so we can assume they would hit the 20 hour mark. Therefore, in order for Windows Server 2003 to have 20% more uptime, it would need to have only 16 hours of downtime per year (4 hours better).

UNIX servers technically have 50% more uptime than Redhat, if you look at it the same way this report did. Their main message was that ALL the modern servers are very reliable, and being 20% better is actually not as "OMGAMAZING" as the news poster thought.

Is it a deceptive way to document survey results? Probably. But who wants to hear "Windows Servers stay up 1% longer than Redhat servers per year"?
#30 Magallanes on 07 Jun 2006 - 22:01
Not think in uptime, think in downtime. The truth is windows is infamous because it is not trusty and because this fact, many windows server will run with a bdc, also with clear politics of backup of the system files and maintenance periodically. In opposite many linux server runs without a decent or clear backup system, in fact many linux server runs without any backup because "linux is stable and secure so not need for backup". Indeed linux can be more stable but it's not immune to hardware issues (hd fail for a typical example). So usually a server crash in windows can take a few days (or hour) of downtime but in linux can be really catastrophic...

Of course there are exception of the rule but a big group of linux admin don't care about backup or a alternative plan.

While for a normal condition windows can have a low uptime in comparison with linux, in a danger situation windows can also have a low downtime.

(1 reply) #31 Proneax on 07 Jun 2006 - 22:47
Check your math.

for 365 days to be 20% more than linux uptime, linux would be up almost 305 days/year.

305 x 1.2 = 365 (365 x 0.8 = 292 is not the same, but close 1/1.2=0.8333333)


I agree with linked, they've definitely mis-reported the results with some incorrect math.
Gee, where else have I seen incorrect math today?


What the article probably meant was windows has 20% less downtime, which again is not equivalent to any other statement relating downtime or uptime or differences thereof and involving the number 20% directly.
Remember, we're COMPARING DIFFERENCES, NOT THE ACTUAL NUMBERS.

In fact, you can't determine the percentage difference in uptime based on the percentage difference in down time.

Example1:

Windows uptime: 9000 hours, downtime 1000 hours
redhat uptime 8750 hours, downtime 1250 hours

Windows has 20% less downtime, windows has 2.85% more uptime

Example 2:

Windows uptime: 19000 hours, downtime 2000 hours
redhat uptime 18500 hours, downtime 2500 hours

Windows has 20% less downtime, windows has 2.63% more uptime.
2.85 != 2.63

if you're confused, remember (actual-expected)/expected x100= answer.
If you're comparing windows to linux, linux is the 'expected', but if you're comparing linux to windows, windows is the 'expected'.
#31.1 Marshalus on 07 Jun 2006 - 23:03
Forgive me for not being a math major. I was making a point by highlighting how their article wording was misleading. 365 x 20% = 73

If you read details of the actual report you can figure out that isn't REALLY what they mean, but the way that they make it sound that the conclusion readers can jump to.
(2 replies) #32 LTD on 08 Jun 2006 - 00:08
**yawn**

When oh when will these server wars end??
#32.1 AfroTrance on 08 Jun 2006 - 05:41
When my army of cyborg penguins storm Redmond.
#32.2 yudi_lks on 08 Jun 2006 - 06:02
Hahahah
#33 Colin-uk on 08 Jun 2006 - 08:29
"DiDio" ... *giggles*

Commenting has either been disabled on this article or you are not logged in. Click here to login or register, its free!

Note: Anonymous commenting is disabled in order to keep the quality of responses to a high standard.

Advertisement (Why?)