ext4 or btrfs on Synology


Recommended Posts

The latest DSM version defaults to formatting volumns with BTRFS, while I know there are advantages to this file system, do you really gain anything over just going with ext4? It from what I've read seems like a relatively new file system. I'm not really a linux person so I don't have the largest knowledge on the two file systems.

 

Is it better to just stick with ext4 for now? it seems like btrfs uses more disk space up since it versions (i assume ext4 doesn't from the light reading i've done on the two?)

Link to comment
https://www.neowin.net/forum/topic/1308408-ext4-or-btrfs-on-synology/
Share on other sites

Btrfs has issues and isn't to be depended on for long-term storage, whereas ext4 was made for it. Since you've pretty much answered your own question by the statement "btrfs uses more disk space", yeah. Ext4 is the clear choice of the two. :yes: 

  On 11/09/2016 at 23:31, Unobscured Vision said:

Btrfs has issues and isn't to be depended on for long-term storage, whereas ext4 was made for it. Since you've pretty much answered your own question by the statement "btrfs uses more disk space", yeah. Ext4 is the clear choice of the two. :yes: 

Expand  

Well all I knew about BTRFS was the journaling part and that take, and that synology pushes it as the default file format now.... I put a new volumn on and it went right to btrfs... probably should redo that as Ext4, which is what I've been using for the other volumns

"Btrfs has issues and isn't to be depended on for long-term storage"

 

Where did  you read this??  Why would it not be good for long term storage???

 

To be honest for a storage system btrfs would be hands down the most logical choice period!! 

  On 12/09/2016 at 19:43, BudMan said:

"Btrfs has issues and isn't to be depended on for long-term storage"

 

Where did  you read this??  Why would it not be good for long term storage???

 

To be honest for a storage system btrfs would be hands down the most logical choice period!! 

Expand  

I found that fishy as well. For desktop use, yes, EXT4 is better. But for server/storage with several disks, BTRFS is better all around.

  On 12/09/2016 at 19:43, BudMan said:

"Btrfs has issues and isn't to be depended on for long-term storage"

 

Where did  you read this??  Why would it not be good for long term storage???

 

To be honest for a storage system btrfs would be hands down the most logical choice period!! 

Expand  

Too many reports of btrfs flaking out and destroying the data stored within the file system. The guy that does the Linux Action Show had a run-in with it about a year ago, iirc, and was quite vocal about how badly it treated him after a mere weekend of use.

 

[EDIT] Here's the whole incident. 

 

https://www.youtube.com/watch?v=WfpNGJt40Lc&t=3384s (The point where he finally loses his cool about btrfs)

Edited by Unobscured Vision

So 1 idiot on youtube??  without even 5k views?  Over a year ago..  So that was posted Apr 2015, so that was what version at best 3.19.1?  Maybe 4?

 

https://btrfs.wiki.kernel.org/index.php/Changelog

 

So we are now version 4.7.2, think maybe a few improvements? ;)

 

So synology has now made it their default??  Do you think that would be a wise choice for a company that makes nas's for their bread and butter if their was even a slight chance it could flake out and wipe all their users data??  Does that sound plausible??  Mindovermatter was their red flashing lights, bells going off warning warning warning you could loose data using this??

  • Like 2

I'm using btrfs on my DS1815+. I have 3x6TB WD Red drives in it, and it's set up for 1 drive parity. I haven't had any issues with the file system at all. Pretty much every issue I've had so far has been with DSM 6.0, but they've since been cleared up (mainly issues with packages not running). It's been running solid for about 3 months or so now.

BTRFS is fine if you stick with the non-RAID and RAID 0 or 1 setups. RAID 5 or 6 is NOT safe. I've used BTRFS for close to 2 years now and I haven't experienced any data loss or corruption. I make use of RAID 1 with LZO compression and snapshots. I've experienced power outages and system freezes caused by others things than the file system. I've never lost data.

  On 13/09/2016 at 02:24, BudMan said:

So 1 idiot on youtube??  without even 5k views?  Over a year ago..  So that was posted Apr 2015, so that was what version at best 3.19.1?  Maybe 4?

 

https://btrfs.wiki.kernel.org/index.php/Changelog

 

So we are now version 4.7.2, think maybe a few improvements? ;)

 

So synology has now made it their default??  Do you think that would be a wise choice for a company that makes nas's for their bread and butter if their was even a slight chance it could flake out and wipe all their users data??  Does that sound plausible??  Mindovermatter was their red flashing lights, bells going off warning warning warning you could loose data using this??

Expand  

:rofl:

  On 14/09/2016 at 00:30, Radium said:

BTRFS is fine if you stick with the non-RAID and RAID 0 or 1 setups. RAID 5 or 6 is NOT safe. I've used BTRFS for close to 2 years now and I haven't experienced any data loss or corruption. I make use of RAID 1 with LZO compression and snapshots. I've experienced power outages and system freezes caused by others things than the file system. I've never lost data.

Expand  

Synology for RAID5 and RAID6 default to BTRFS in DSM6

 

One thing I'm noticing is it uses up a lot more CPU time doing file level stuff, the check disk (raid error checking) / defrag take a lot longer to run, and of course uses up a good bit more space keeping change logs for files

  On 14/09/2016 at 20:19, Jason S. said:

what do you mean by this? i dont understand

Expand  

when you make a RAID5 or RAID6 volume it defaults the format to BTRFS as part of the creation, you have to explicitly tell it now no use ext4, which was previously the only format they used

 

I only brought that up because of the previous poster saying don't use it on RAID5 and RAID6 because it's not safe... if it wasn't safe I don't think they'd make it the default format

"if it wasn't safe I don't think they'd make it the default format"

 

There you go using logic again ;)  Didn't you watch the youtube video put out by that guy.. Clearly btrfs is a complete ###### show and your going to loose your data.  Which is why Synology has switched too it I am sure, they clearly want all their users to have a crap experience with their products..  And loose their data, maybe they got a dmca about their users storing copyrighted material and this is their way of getting rid of it ;) heheheh ROFL

 

Or maybe they just didn't see that video and don't understand that is not safe, and went ahead and enabled it and made it default without any testing of it at all.. Yeah that's prob it ;)

  On 15/09/2016 at 01:06, neufuse said:

when you make a RAID5 or RAID6 volume it defaults the format to BTRFS as part of the creation, you have to explicitly tell it now no use ext4, which was previously the only format they used

 

I only brought that up because of the previous poster saying don't use it on RAID5 and RAID6 because it's not safe... if it wasn't safe I don't think they'd make it the default format

Expand  

BTRFS has RAID 0, 1, 5 and 6 built in. That's what I'm talking about. Synology most likely uses MD-RAID 5 or 6 and then put BTRFS on top of it. That's completely different.

 

BTRFS RAID is configured during or after you set up the filesystem (using btrfs-progs).

If you create a RAID and pick a filesystem after the RAID has been configured then it's either hardware RAID or MD-RAID.

People have reported unrecoverable data loss from RAID56 in BTRFS. It even warns you on the BTRFS Wiki about it.

Based on this, Synology most likely uses MD-RAID, especially when you can(?) pick your own filesystem for the RAID. BTRFS is perfectly fine when run on top of a block level RAID since it doesn't do RAID itself when you do that.

You mean the wiki article that states

 

any system which might encounter unplanned shutdowns (power failure, kernel lock-up), and it should not be considered production-ready.

 

I completely agree that unplanned power failures or just plain lockup of the OS (kernel) could cause you loss... How is this not an issue for any raid system anywhere?  This is one of the reasons raid cards have battery backups.

 

So you have your synology just plugged into wall power?  Or do you have it using a UPS, and then planned shutdown before loss of battery power on power loss?

 

 

  On 15/09/2016 at 14:48, BudMan said:

You mean the wiki article that states

 

any system which might encounter unplanned shutdowns (power failure, kernel lock-up), and it should not be considered production-ready.

 

I completely agree that unplanned power failures or just plain lockup of the OS (kernel) could cause you loss... How is this not an issue for any raid system anywhere?  This is one of the reasons raid cards have battery backups.

 

So you have your synology just plugged into wall power?  Or do you have it using a UPS, and then planned shutdown before loss of battery power on power loss?

 

 

Expand  

Oh I always plan ahead my unplanned outages :rofl:

  On 15/09/2016 at 11:42, Radium said:

BTRFS has RAID 0, 1, 5 and 6 built in. That's what I'm talking about. Synology most likely uses MD-RAID 5 or 6 and then put BTRFS on top of it. That's completely different.

 

BTRFS RAID is configured during or after you set up the filesystem (using btrfs-progs).

If you create a RAID and pick a filesystem after the RAID has been configured then it's either hardware RAID or MD-RAID.

People have reported unrecoverable data loss from RAID56 in BTRFS. It even warns you on the BTRFS Wiki about it.

Based on this, Synology most likely uses MD-RAID, especially when you can(?) pick your own filesystem for the RAID. BTRFS is perfectly fine when run on top of a block level RAID since it doesn't do RAID itself when you do that.

Expand  

MD-RAID? Area you talking about "Multiple Device RAID"? Gawd I had to look this up... so BTRFS does it's own version of software RAID to span across multiple disks or volumes or it could be BTRFS as standalone file system split over a hardware RAID array (which is what sinology is doing)? am I getting this right?

  On 15/09/2016 at 20:39, neufuse said:

MD-RAID? Area you talking about "Multiple Device RAID"? Gawd I had to look this up... so BTRFS does it's own version of software RAID to span across multiple disks or volumes or it could be BTRFS as standalone file system split over a hardware RAID array (which is what sinology is doing)? am I getting this right?

Expand  

You've got it right. There are benefits to do it like BTRFS and ZFS compared to relying on hardware RAID or an intermediate software RAID layer. You lose performance but RAID is more about reliability and uptime than performance. Having the filesystem in on it allows you to have an odd number of drives and mismatched drives when you mirror your data. It also allows you to add and remove drives on the fly while the filesystem is online, just to mention some features.

  • 1 year later...

Reviving an old thread because I found it (so others will as well) while investigating the use of Btrfs on striped RAID arrays on Synology.  Here is their response:

https://www.synology.com/en-us/knowledgebase/DSM/tutorial/General/What_was_the_RAID_implementation_for_Btrfs_File_System_on_SynologyNAS

 

"However, it is known that Btrfs RAID is unstable and not suitable for production environments. For this reason, Synology chose Linux RAID over Btrfs RAID. The following diagram explains the concept - Synology has implemented the layers in between to ensure that we have full control of the communication for the highest stability."

  • 3 weeks later...
  On 12/12/2017 at 00:45, Unobscured Vision said:

No. Use ext3/4 (Linux raid). Far more stable. That's what Synology was saying. Btrfs RAID isn't supported at all due to data corruption issues.

Expand  

That isn't what they are saying at all. Synology isn't using the RAID functionality of BTRFS since it has issues and isn't production ready (as the official BTRFS wiki is telling the rest of the world). It is this RAID functionality that people mean when they are saying that RADI5/6 with BTRFS gives issues (read: data corruption).

 

What Synology is doing, is what just about the entire storage world has been doing for years: they layer. You start with hardware RAID (which requires a RAID card) or software RAID (which can be something that is part of the OS such as MD) and on top of that you put the filesystem (ext4, BTRFS, ZFS, NTFS, APFS, HFS+, etc.). There are also other options where you can put more layers. That's exactly what the picture given by @Zakman12 shows: Synology uses software RAID and puts BTRFS or ext4 on top of that.

 

In this case you can opt for MD (or Linux RAID as Synology calls it) or Synology's own software RAID which they call Synology Hybrid RAID (SHR). Next you pick what filesystem should be used: ext4 or BTRFS. This means that you can pick whatever RAID level you want without it wreaking havoc on the BTRFS filesystem that you put on top of it.

 

So once more:

  • RAID functionality in BTRFS = trouble
  • separate RAIDed volume with BTRFS on top like Synology does it = no issues
  • To stress: Synology is NOT using the RAID functionality of BTRFS at all

Thus: the way Synology does it makes it safe to use RAID6 and BTRFS. 

 

However, the use of RAID6 is debatable. Most are using RAID10 instead. If you want to know more about that I suggest to search around by starting with the Wikipedia article on RAID.

 

Btw, by no means is ext3/ext4 Linux RAID. They are filesystems and do not have any form of RAID functionality. You need a newer generation filesystem such as BTRFS or ZFS for that. When using ext4 you therefore need something else to do the RAID part. That, the issues with BTRFS' RAID functionality and their desire to control the RAID part is probably why they are using MD and SHR.

Edited by dyn
This topic is now closed to further replies.
  • Recently Browsing   0 members

    • No registered users viewing this page.
  • Posts

    • Google open-sources zero-knowledge proof code for enhanced online privacy by Paul Hill When you go out to a physical store and attempt to buy alcohol or cigarettes, you’ll get asked to show some ID; online, when you want to visit adult sites, you don’t currently need to prove your age, but lawmakers in various countries are looking to change this. One technology that has been developed to address the age checks needed is Zero-Knowledge Proof, where you prove your age without having to reveal other data like birth date or ID. To help companies develop their own Zero-Knowledge Proof (ZKP) technologies, Google has released its ZKP libraries as open-source, meaning they can be taken and used in other projects or adapted. This will make it easier for third-party developers to create privacy-enhancing age verification applications. We heard a bit about ZKP from Google earlier this year when the company said that it was integrating the technology into Google Wallet to help disconnect your age from your identity. It also said at the time that it would be using it in other Google products and partner with apps like Bumble to help with verification. It also said at the time that it would open-source ZKP; that promise has now been fulfilled. As libraries, Google’s newly open-sourced software can be integrated into a whole range of applications. As mentioned, Google is using it in Google Wallet, and it could also be used to verify the age of people visiting adult websites without needing to reveal their identity as part of the verification process. Google has also said that the European Union’s eIDAS regulation encourages EU member states to integrate technologies like ZKP into the European Digital Identity Wallet (EUDI Wallet). The open-sourcing of ZKP could help with the acceleration of the development of these EUDI Wallets. The open-sourcing of the ZKP libraries by Google will benefit various groups of people. We’ve mentioned that developers will benefit as they can use the libraries in a variety of apps. Businesses will also benefit by being able to meet privacy needs more easily. Another group to benefit will be researchers who can use this “more efficient and performant ZKP implementation” to help create new applications and uses of technology. Finally, users will benefit from more private and secure digital ecosystems. Now it remains to be seen how much adoption these ZKP libraries will get, given the growing need for such technology. Image via Depositphotos.com
    • I Have a batch file that opens 2 websites dealing with money. I want to add to it with the first step to remind me to start a vpn extension that I use with chrome.  If  it is easier to use powershell that is fine too.  thx   Hope this is enough info.
    • IMO, Vivaldi feels overdesigned at this point.
    • You have to look at the value proposition. Any product can be good or bad at either the right or wrong price. At $110, the GTX 1050 was considered a good GPU for the price, and again at $160 the GTX 1650 was extremely popular and considered one of the best value GPUs ever. The problem here is this RTX 5050 has a performance uplift over the 4050 so small it is basically lost in the margin of error, yet they still price it at $250!! That is bad value. At $200 it is at least in line with the other overpriced GPUs, at $175, it would actually be a good product!
    • I built my first computer with a low profile GTX 750 Ti OC and it was a great 720p card for its time. And that was a $160 card at the time. The 50 models used to be a good mid-range for price to performance. Not anymore.
  • Recent Achievements

    • Week One Done
      956400 earned a badge
      Week One Done
    • First Post
      loose_observer earned a badge
      First Post
    • Week One Done
      BeeJay_Balu earned a badge
      Week One Done
    • Week One Done
      filminutz earned a badge
      Week One Done
    • Reacting Well
      SteveJaye earned a badge
      Reacting Well
  • Popular Contributors

    1. 1
      +primortal
      446
    2. 2
      ATLien_0
      157
    3. 3
      +FloatingFatMan
      148
    4. 4
      Nick H.
      65
    5. 5
      +thexfile
      62
  • Tell a friend

    Love Neowin? Tell a friend!