Recommended Posts

Hey Guys,

I've got a HP MicroServer N36L as my primary Storage server at home, currently running 4 x 2TB Drives in a Software RAID5 configuration. This gives me around 5.5TB of Storage with some redundancy.

I need to increase the amount of storage available to this array so I want to exchange one of the 2TB drives with a 3TB Drive. What steps should I take to achieve this?

RAID-5 was created in Windows Server 2008 R2

Thanks

Chris

Due to how RAID-5 is, you need all the disks to be the same capacity. Simply removing one 2TB drive and replacing it with a 3TB drive will not gain you a single byte of extra storage. You would need to change each disk individually until they are all 3TB then you can expand the array if the built in Windows software raid function supports it. Unfortunately I cannot comment on if it does support that as I've only ever used Hardware RAID cards under Windows.

All drives must be the same capacity. You can't just add a little more. And I have not seen adding drives to an existing raid set without first destroying the raid set which means either take an image of the drive, copy all of your data off, or be prepared to loose your data.

Well, losing the Data isn't an option. So I guess I'll order another HP MicroServer in a few months and begin using FreeBSD to setup a ZFS pool and migrate the data over. Either that or maybe a Drobo-esque solution.

Any ideas for an expandable storage solution? Doesn't Windows Server 2012 come with some new RAID-style redundant data spanning system?

Just thought I would mention how I am handling my storage on my N40L

I am running 2k8r2 essentials storage server (big brother of WHS) And the drivepool addon - http://stablebit.com/ in a virtual machine. I then have RDM of the drives to this VM.

Sweet thing about the addon is that allows you to create pool of all your storage without having to worry about any sort of raid. And allow you to expand on the file - no need for same size or speed of disks, etc.

So for example I have a 2TB, a 2x 750 all in one pool. So it adds up to like 3.18TB -- now for safety reasons I have my grand daughter vids duplicated (copy on more than one disk).. This is not my backup!! This is just so if I loose a drive in the pool I don't have to worry about recovery those files from backup - which they are (in multiple places!)

post-14624-0-08230800-1340653945_thumb.j

If I want to add more space, just connect another disk - with the N40L I can add 2 more drives for a total of six. But my current plan is to wait til drives come down in price and then swap out my 750s for bigger drives. Its as simple as remove drive from pool (will need enough space free to move the files off of it in the pool). Then just replace with newer bigger drive and it will the redistribute the files across the pool.

I just don't see the need in home setup for the overhead of conventional raids. Now I have looked into the ZFS pool stuff, and it is slick stuff. But you might want to read the details of adding more space - you can not just add one more drive to the pool. Say you have a raidz setup with 3 drives in 5, to add more space to the pool you would have to create another raidz with 3 more drives, etc. It is SLICK, don't get me wrong!! But in the home setup, I would go with unraid setup or what I am doing. I would like to go with unraid as my space requirements grow - but I was able to accomplish my goals on a very cheap budget by leveraging the drive bays of my N40L and just using a VM as the frontend to the drives.

Since I can add 2 more drives to my N40L, and not counting the drive I am using for my VMs datastore - I can have like 5 drives in one large pool or 5x3TB say for 15TB of storage - with the ability to duplicate my stuff across multiple.. Shoot even if I just limit myself to the 3 actual bays of the N40L using now - could go with 4TBx3 if really needed space for 12TB.

And as you saw from the performance thread -- able move files on and off this pool with no issues at very very good speeds.

edit: Another nice thing about the drivepool addon, is I was able to add the drives with their files on them, no need to wipe the drive or anything when added to the pool.. And then just moves the files into the pool, etc.

Hmm, I'd give something like that a spin, but I need 100% disk-disk redundancy not just file-level redundancy. I guess the only 'true' solution for this right now is something like a Drobo Pro mounted back to the File Server over iSCSI.

"but I need 100% disk-disk redundancy"

Why?? Is this a home setup or not? And sorry to break it too you, but you have clearly stated your running raid 5 - that is not 100% disk-disk redundancy.

So which is it? Do you need 100% disk-disk redundancy, or do you not really know what you need ;)

Please tell me your not using your RAID as your backup.. If I had a dollar for every time we have gone over this -- RAID is NOT a BACKUP!!

"but I need 100% disk-disk redundancy"

Why?? Is this a home setup or not? And sorry to break it too you, but you have clearly stated your running raid 5 - that is not 100% disk-disk redundancy.

So which is it? Do you need 100% disk-disk redundancy, or do you not really know what you need ;)

Please tell me your not using your RAID as your backup.. If I had a dollar for every time we have gone over this -- RAID is NOT a BACKUP!!

Maybe my wording there was a little off, but if one of these drives fails and I replace it, I will not lose any data. 100% Disk-Disk would be closer to RAID10 I guess...

And no, I'm fully aware RAID is not a Backup solution, critical data is duplicated on Amazon S3. But Data Loss of any form sucks and RAID5 is the best preventative measure easily available to protect the entire storage pool.

All 'Personal' data is backed up to a Time Machine volume located at my office, hopefully they don't mind me chewing up their Bandwidth.

I've been looking at various NAS solutions for this and I believe the Drobo Pro would provide the best redundancy vs capacity expansion in this when using iSCSI, but I've had data-loss with a Drobo first gen in the past.

ZFS is worth looking at again; and with most of the critical systems moved off of this server onto the ESXi Server I could easily reformat this server and set-it-up as a FreeBSD box.

In my opinion you should look in to purchasing a hardware RAID card something like an LSI 9260-8i which is an 8 Port RAID card with 512MB onboard Cache and a Dedicated RAID5/RAID6 XOR chip by Intel. It supports expansion and migration.

The reason I recommend this card is for its dedicated RAID processor and its RAID6 capability which offers you two disk redundancy instead of the one disk redundancy that RAID5 has.

I'm also going to recommend that perhaps it is time you moved off your HP Microserver and built yourself a server. You like to run VM's you need a lot of storage and I think you've probably outgrown that box. The Drobo is nice but I think you can build a much better complete system for only a little bit more than the Drobo which would last you a lot longer and provide you with a significant performance bump in the CPU area which will benefit your virtual machines.

But this is just my advice and my opinion I'm not saying this is right I'm just giving my assessment.

What I hear about drobo is they are slow! I would prob look at http://www.qnap.com/useng/index.php?sn=69〈=en-us

"RAID5 is the best preventative measure easily available to protect the entire storage pool."

Best?? Depends on what your doing - Raid 1 would be better in some cases, 10 in others - 6 as already mentioned in others even.

If what you want is parity, and expansion -- take a look at unraid. It gives you parity you want to help prevent having to restore from backup on hardware failure. But allows for very easy expansion. http://lime-technology.com/

I got raid 5 too (thinking of 6 but would have required a bit mor money) ... suffice to say in my case I have a free SAS (4Sata) available so what I do (in the near future) is get 4x3T and connect them -- then move the 4x1T on them and done.

Well, losing the Data isn't an option. So I guess I'll order another HP MicroServer in a few months and begin using FreeBSD to setup a ZFS pool and migrate the data over. Either that or maybe a Drobo-esque solution.

Any ideas for an expandable storage solution? Doesn't Windows Server 2012 come with some new RAID-style redundant data spanning system?

RAID 5 is starting to be non-recommended, and for good reason.

Personally i have a ZFS RAIDZ2 setup, thats double redunancy, ie.e whereas in RAID5 (or ZFS RAIDZ) you can only survive one bad drive in the array (lose another while waiting to replace (or even while replacing) the defective drive and theres your data gone...

ZFS RAIDZ2 will survive 2 bad drives, so for me, and this might seem extreme, and even as my data is home based i find it comforting. Of course along with backups to external once in a while.

There is of course RAIDZ3 (triple redendancy), but i wasnt going to push things that far, pricewise.

Currently i have:

FreeBSD

ZFS with RAIDZ2

5 2Tb drives in the array pool

1 hot spare

2 spare

Be aware that upgrading the storage has caveats as mentioned above, growing your pool is not what you would call easy.

Options for software raid (ZFS) are:

FreeBSD

OpenSolaris

OpenIndiana

FreeNAS

NAS4Free (continued version of FreeNAS NOT based on NanoBSD)

Linux...not recommended (ZFS via FUSE eek)

I always prefer to go software RAID rather than get locked into a chipset and find yourself one day not able to easily recover data.

Software RAID you can at least transfer...

This is topic I am very curious about (expansion of drive pool and raid in the home) -- so I want to bring up a couple of other things. BTW great post LiquidCrystalMeth for only 3rd one on the board, and nice nick as well ;)

I fail to understand the requirement for spending boat loads of money on parity/redundancy in the home setup to be honest. For example I am well over 1.8GB worth of music and video.. Not really a large collection, but its starting to expand now that I have a bit more breathing room. Then again I keep the files small vs large 8GB rips of movies, etc. So your talking quite a few (just looked over 3.1k video files and 3.5k music)

Here's the thing - would it suck if it all was lost, ok sure.. But they are not critical files, every single one of them can be replaced. Be it rerip or just download, etc. Now my "critical" (home videos/pictures) files are redundant as well as backed up all over the place on different media, different locations, online as well.

As to the vast majority of my storage requirements - its just videos and music that I could replace no problem. So why spend extra money on redundancy and or parity on such data?

My thought process here is I have my drives in a pool, so even if one fails only the data on that drive is lost - not the whole array. So would only have to rerip/replace those files - if I desired to do so. Quite possible those videos have already been watched and not really all that important that I have a live online copy.

It's cool to have your video's online and such to watch with a flick of a button - but come on, how many times do you watch the same video. Its more as show piece when friends come over, etc. Hey you want to watch X? - Click here you go, oh remember that south park episode from season 3 - click there you go. That sort of thing.

But if those files were lost - not really that big of deal. Now don't get me wrong, I would love to throw some parity in there. Have been looking at unraid, and almost went that route when my server died. But then going the esxi route to allow me easy VMs to play with along with storage for a cheaper budget won out in the race for my dollars.

Now I do have smart monitoring of my data drives (drive scanner from same people that make drivepool) And it emails me if there is any issues with the drives that might point to failure. So if that were the case I could replace with new drive before actual failure and not have to worry about redo of my video/music/etc that might of been lost.

So I guess my real question is - what sort of media do you have on your storage, and why does it warrant redundancy/parity to help prevent loss of access to data in hardware failure. Keep in mind that raid is not a backup!! So you can't say you don't want to loose critical files.. Because you wouldn't - all critical files would be backed up anyway! So what your saying is loss of access until replacement/recovery of the files only.

In a company setup, this is a major issue! If loss of access to the WORK files were lost for even a day or so you could be talking large loss of revenue with workers having nothing to do ;) So you prevent that with raid! So drive fails you just pop in another and no time loss in access to files. But this really doesn't scale to the home imho.

And no not talking about striping or raid 0 -- this I do believe has some merit in the home, if looking for performance or just playing, etc.

So are you running raid in the home because you have money to burn, or this is your hobby and what you want to spend your dollars on. Or are you really worried about loss of access to some files that can be replaced with just some effort. The creation of the raid, can also mean loss of MORE data that has to be replaced if bad luck and you loose 2 drives. If your just pooling them - only the % of files stored on those disks would have to be replaced.

Which is part of the reason I think unraid makes a lot of sense. You can get way more bang for your buck while still having parity vs typical raid 5 be it hardware or software setup. Best of both worlds kind of solution.

Your opinions and thoughts on this are most welcome - kind of a tangent to the original thread. But hey its still on point in helping the OP make a decision on how to best store his files. Should he expand his current setup with raid5 or go a different route? etc.

edit:

"Where can I pick p a copy of 2k8r2 essentials storage server? "

http://www.microsoft.com/en-us/server-cloud/windows-server/storage-server-essentials.aspx

It's not really sold in stores.. Are you an OEM? I work in the field, so I have lots and lots of OEM contacts plus my own oem system builders lic

http://www.microsoft.com/oem/en/licensing/sblicensing/Pages/index.aspx

Plus full access to MS downloads directly with enterprise agreement. Normally you get it with an appliance, lots of places to get it with an appliance. So if you buy an appliance you will get it - then depends if come pre installed or if you get media to install yourself, etc.

There are a few places on the web to buy just the software, quick google found this

http://www.mybusinesswebspace.com/cart/index.php?main_page=product_info&cPath=2_270_272&products_id=435

I have never dealt with that company, so please don't me linking to it as recommendation of it.

This is topic I am very curious about (expansion of drive pool and raid in the home) -- so I want to bring up a couple of other things. BTW great post LiquidCrystalMeth for only 3rd one on the board, and nice nick as well ;)

I fail to understand the requirement for spending boat loads of money on parity/redundancy in the home setup to be honest. For example I am well over 1.8GB worth of music and video.. Not really a large collection, but its starting to expand now that I have a bit more breathing room. Then again I keep the files small vs large 8GB rips of movies, etc. So your talking quite a few (just looked over 3.1k video files and 3.5k music)

Here's the thing - would it suck if it all was lost, ok sure.. But they are not critical files, every single one of them can be replaced. Be it rerip or just download, etc. Now my "critical" (home videos/pictures) files are redundant as well as backed up all over the place on different media, different locations, online as well.

As to the vast majority of my storage requirements - its just videos and music that I could replace no problem. So why spend extra money on redundancy and or parity on such data?

My thought process here is I have my drives in a pool, so even if one fails only the data on that drive is lost - not the whole array. So would only have to rerip/replace those files - if I desired to do so. Quite possible those videos have already been watched and not really all that important that I have a live online copy.

It's cool to have your video's online and such to watch with a flick of a button - but come on, how many times do you watch the same video. Its more as show piece when friends come over, etc. Hey you want to watch X? - Click here you go, oh remember that south park episode from season 3 - click there you go. That sort of thing.

But if those files were lost - not really that big of deal. Now don't get me wrong, I would love to throw some parity in there. Have been looking at unraid, and almost went that route when my server died. But then going the esxi route to allow me easy VMs to play with along with storage for a cheaper budget won out in the race for my dollars.

Now I do have smart monitoring of my data drives (drive scanner from same people that make drivepool) And it emails me if there is any issues with the drives that might point to failure. So if that were the case I could replace with new drive before actual failure and not have to worry about redo of my video/music/etc that might of been lost.

So I guess my real question is - what sort of media do you have on your storage, and why does it warrant redundancy/parity to help prevent loss of access to data in hardware failure. Keep in mind that raid is not a backup!! So you can't say you don't want to loose critical files.. Because you wouldn't - all critical files would be backed up anyway! So what your saying is loss of access until replacement/recovery of the files only.

In a company setup, this is a major issue! If loss of access to the WORK files were lost for even a day or so you could be talking large loss of revenue with workers having nothing to do ;) So you prevent that with raid! So drive fails you just pop in another and no time loss in access to files. But this really doesn't scale to the home imho.

And no not talking about striping or raid 0 -- this I do believe has some merit in the home, if looking for performance or just playing, etc.

So are you running raid in the home because you have money to burn, or this is your hobby and what you want to spend your dollars on. Or are you really worried about loss of access to some files that can be replaced with just some effort. The creation of the raid, can also mean loss of MORE data that has to be replaced if bad luck and you loose 2 drives. If your just pooling them - only the % of files stored on those disks would have to be replaced.

Which is part of the reason I think unraid makes a lot of sense. You can get way more bang for your buck while still having parity vs typical raid 5 be it hardware or software setup. Best of both worlds kind of solution.

Your opinions and thoughts on this are most welcome - kind of a tangent to the original thread. But hey its still on point in helping the OP make a decision on how to best store his files. Should he expand his current setup with raid5 or go a different route? etc.

For me, i dont have money to burn...anymore, i have several thousands of dollars in legally bought DVD's, and god knows how many terabytes of mp3's ripped legally thats where i once had money to burn once, and like any collector when you collect things you tend to throw money at it..

As the original DVD's and CD's deteriorate over time, even wihtout being played (environmental factors, rotting dyes etc), it was

important to me to safeguard the investment i made (like i said, thousands of dollars on DVD's alone).

I rarely play the actual original media, as i treat that as archival as well.

I dont want to have to purchase all those things again.

So i spent just over a thousand to build my RAID pool as really both an investment and an additonal level of protection. Add to that a backup to external onc ein a while and its worth the outlay.

As for the nick, i always try and put a spin on something tech :)

So you have a backup of them, then why the Raid? Don't get me wrong I would do it as well if money to play with - but I spend enough on tech. Personally the added cost of conventional raid is not worth it in my home setup.

To me the dollars spent on drives sitting there doing nothing but parity could be spent on either more storage, or more Movies/Music. There is nothing there that can not be replaced.

So you state TBs of storage.. Which I just noticed I stated 1.8GB -- thats TBs ;) That you actually "backup" So why spend money on the parity if you have a backup. Your just spending money on not having to spend any time on restore from your backup sounds like to me.

Which is fine, just trying to understand the thought process. So your worried about lost time on hardware failure in replacement time.. For me I would spend that money on other tech or more media, etc. But that is me.

If I lost a drive, it would be at most 1/3 of my collection currently. And its just that a collection, more of pack rat syndrome than actually NEED of the files. So what your doing is your hobby, ripping the stuff, storing it, protecting it, etc. Which is great!

Have you looked at say unraid -- lots of bang for the buck there in parity vs storage costs. With the 1 disk as your parity disk, you can have a very very large pool.

I had looked at unRAID but I don't feel the technology was explained well enough, again, I'd rather have a single large pool of Data with a folder structure instead of multiple filesystems being linked together in some mysterious way; that said being able to use any old disk I have lying around is a great idea. FreeNAS was another I was looking at; as was OpenFilier.

I guess I just want an easy 'just works' solution.

If your trying to understand how their parity drive works, this is a start

http://lime-technolo..._parity_work.3F

With links to deeper discussions.

You would have a large data pool, with 1 folder structure.

To be honest if what your looking for is folder structure and ease of access - what does it matter what the filesystem is or standalone on multiple disks vs striped across. I would worry about striping across spindles for performance. But if performance is not of primary concern, to be honest the tech used to provide you with your 1 common folder structure should be of secondary importance.

I fully agree with understanding the tech, at least at a basic level before using it. But its really not all that different than parity in a normal striped raid setup like 5. Just that the parity is stored on 1 drive vs stripped across all of them in the array.

One of the cool things about it and some of the other options, is that unlike with a typical raid where parity has to be created on the fly when you write the file. With unraid the parity can be created in the background after the fact for performance increase with the use of a cache drive. And my other below options also have ability to not have to do realtime parity creation.

I was a couple of minutes a way from going with unraid on the N40L, and even running it as a VM just like doing with my current setup. But the ability of the drivepool addon to add my existing data into the pool without having to wipe drives pushed me to go my current route. As long as I can have duplication of specific data that I don't want to have to recover from backup on a loss its a win win for me.

I get my common folder structure that spans the multiple drives for ease of use. I have a media folder, and then under that subfolders for tv/movies/music/etc -- I don't really care what filesystem its on. What is nice with this setup as well - is if need be I can directly access the files off the disks on any system that can read NTFS - with same folder structure and names.

My point being is I would expand your view of what is available - and not get stuck using the old standard raids and methods of file storage/parity and access.

If your priority is ease of file management (folder structure) and ease of expandability and ability to use nonlike drives I would look to some of the newer methods vs just plain jane raid 5. I have been very impressed with using the drivepool on my windows based server - you can use WHS if you want.

Other options that will work on just plain server or desktop version of windows is http://snapraid.sourceforge.net/ (free) another is http://www.flexraid.com/ (cheap!)

There are other things to look today other just standard raid 5 - that is for damn sure! Expanding your options is always a good thing!

All that being said if you want to stick with 5, there are cards out there even on soho budget that allow for expansion of the array on the fly. The intel matrix storage stuff is pretty freaking slick for example

I may review unRAID again in the future, for now I have about 500GB left on this Server so I'll clear out some of the junk that has been mounting up for a while and streamline things a little.

I guess one of the other huge bonuses of unRAID is being able to have discs spun-down when not using them, that could potentially save a lot of power when the Media Drives aren't being accessed.

Like I said, I'll research this and see what I can dig up, Ideally I'll also need AFP support and Active Directory authentication.

Thanks for all the recommendations thus far.

I don't know about the other home users here but my home server is quite beefy. 70TB of Storage, SAS Expanders + Three RAID Cards. 30 disk hot swapping in a Lian Li 343B case. Even the CPU is a power hungry Core i7 940 and I have 24GB of RAM installed, although I'm intending to put 48GB of RAM in it soon.

You asked about why would someone run RAID in the home BudMan. For me I run RAID6 on my arrays because I want redundancy. If my drives were to fail I would need to rely on my backups. What if those backups were to fail at the same time? Or what if some data that was mirrored to those backups a year ago was corrupted and I never knew? For me I don't want to lose any data and I also don't want to spend time worrying about it or managing it. And I definitely don't want to spend a weekend copying from backups to my main server.

I agree with what you're saying about parity, it is annoying spending extra money on a drive that is simply being used for parity. But to me it doesn't feel like a waste of my money, it feels more like insurance for time saved in the event that one or two drives fail simultaneously. I'm willing to incur that extra cost today for peace of mine and time saved retrieving files from my backups in the future.

Apart from just using RAID6 and having on-site backups. I also have a paid subscription to CrashPlan where my server is constantly backing up everything. They offer a great service by the way.

I can say this though it would be devastating to lose all my home movies, family pictures, my personal music collection etc these are things that are mostly not replaceable and so I'm taking multiple steps to safeguard it I'm not just going to rely on my backups that I rarely interact with to save my files in the event of a catastrophic drive failure.

"all my home movies, family pictures, my personal music collection"

So you have 70TB of "home movies" and pictures and music you created? Really?

I find that a bit difficult to believe to be honest..

And no that setup would not be a typical HOME setup ;) -- What does that cost you in power?? Do you have killawatt or ups that shows you what its drawing - just curious.

And you also have backed up all 70TB to the cloud -- what kind of internet connection do you have?

Hey more power too you - but to be honest that whole setup seems more like a hobby of yours in what you can do. Not what you actually need when on a budget ;)

I agree -- it not an option to loose your Home Movies/Pictures - these things are irreplaceable. Multiple backups, on multiple types of media in multiple locations for SURE!! But to me raid 6 seems a bit excessive to be honest. You have these files backed up do you not. To the home budget minded person running raid 6 is not very cost effective way to store media that can be replaced. What your spending money on is yes insurance from having to restore from backup. But with running that sort of hardware, I think its more a hobby of yours than actual need of insurance ;)

So you want to test Unraid virtual -- this should get you up and running

http://lime-technology.com/forum/index.php?topic=7914.0

I'll give that a miss; I'll wait on them to push an ISO before I begin messing around with Datastores etc. Plus RDM doesn't seam to work on my build of ESXi, maybe because it's free?

This topic is now closed to further replies.
  • Posts

    • UK nudity blockers are a looming privacy disaster, we must be able to see the source code by Paul Hill Image via Pexels The UK government, just like many state governments in the US and national governments around the world, has begun going on a bit of a power trip when it comes to digital safety. The major step taken so far is the introduction of the Online Safety Act, which requires users to prove their age to access adult websites (it includes more than this, too). Now, UK PM Keir Starmer is calling on Apple and Google, and presumably other mobile OS makers, to scan phones for explicit images to protect children. This potentially mandatory on-device scanning by vendor-controlled software will create unacceptable harms to individual freedoms and transparency, and introduce massive surveillance risks. In a statement on June 8, the Prime Minister stated that big tech companies, such as Apple and Google, must add features to their platforms, such as iOS and Android, that will detect and block sexually explicit or nude images involving under-18s on phones or tablets. Adults who want to take or send nudes would be required to hand over some form of identification to stop their phone from blocking these pictures, creating unnecessary privacy risks. According to the government, it wants to see these measures implemented within three months; otherwise, the government will introduce legislation to force them to introduce such technology. The legislation will include fines for companies and maybe even criminal liability for tech bosses who do not comply with the measures. In its announcement, the government said that stopping users from taking, sending, or receiving nudes without verifying their age is technically feasible, and pointed to a British firm called SafeToNet, which has made proprietary, closed-source, uninstallable software called HarmBlock and is actively selling a device with it enabled and is working with other OEMs. The fact that this software is closed source is a huge problem because it’s a black box; you do not know what it is doing on your device. The fact that it is unremovable is also a problem because you lose control of a phone that you own. Laughably, the government, just before highlighting SafeToNet, says that companies must introduce such measures “without threatening privacy or collecting any data.” It then says over-18s will still be able to view adult content by providing proof of age… Which sounds to me like data collection. SafeToNet makes some debatable claims about HarmBlock The government’s example software, HarmBlock, is a hugely alarming choice to espouse the virtues of this type of software. SafeToNet claims that HarmBlock is “ethically developed,” but this is the opposite of the truth. This black box software puts digital handcuffs on you if it’s installed in your device, taking away your freedom to control what software runs on your device, as it cannot be removed. It is not even free software, so we cannot inspect the source code to see what it is doing. For all we know, it could be acting maliciously. While that’s unlikely, we can’t verify that it’s not doing that. When Google and Apple do inevitably integrate these features on devices in the UK, they are very likely to be closed-source binaries, which will also be non-auditable. They will also have identity services built into them, which will require at least temporary collection of sensitive identity documents to verify your age. One saving grace for Android users is that this nudity blocker will very likely be implemented within the Google Play infrastructure that’s deeply tied into commercial Android devices. However, anyone with enough determination to throw out Google apps from their phone by flashing a custom ROM could find they regain control over their phone again without these digital handcuffs. Obviously, this is only how I expect Google to implement the feature; if it bakes it into the open-source Android somehow, that would be bad news for anyone looking to escape it. Outside of stripping mobile phone users of their freedom and sovereignty over their devices, these proprietary on-device machine learning or hash-matching solutions cannot be independently audited. This means that hackers could potentially exploit them because security researchers can’t investigate the code, and they could overstep their intended use case and collect even more user data without anybody knowing. We also wouldn’t know if the code is prone to detecting false positives or biased classification, because we can’t see the code. In the government’s announcement, contributing comments from the Internet Watch Foundation keep talking about “on-device protections” as if to say that users don’t need to worry about server-side processing; however, this is misleading, as data could flow from devices for the purpose of updates, remote model changes, telemetry, or server-side matching. We’ve also seen with the Online Safety Act that the government is never content with the laws it introduces; it always wants to expand the controls. If this scanning functionality arrives on devices, it might only block nudes initially, but later governments could pressure vendors for expanded access or use mandated features for other surveillance aims. The introduction of on-device scanners opens the door to massive risks in the future. Once nude blocking becomes normalized, regulators like Ofcom or politicians themselves could push for more controls over people’s devices. Very possible candidates for blocking include hate speech, misinformation, or undesirable political content. Also, there is a chance that once Apple and Google have developed this software, they might attempt to reuse the infrastructure for commercial or foreign requests, putting customers in greater danger. Just the UK's demand for this sets a precedent. What if a dictatorship decides to spy on activists by demanding that Google or Apple implement similar controls? Another concern with this scanning is that it adds compliance costs for businesses looking to get into the mobile operating system space. While Google and Apple dominate the space right now, there are lots of smaller companies creating mobile operating systems too, including community projects with very shallow pockets. How are these smaller competitors supposed to implement sophisticated nudity detectors? Simply put, they can’t. Then the government goes after them, causes them to shut down, and Google and Apple have less competition. Image via Aurora Store For us users who value sovereignty over our technology, this development will force us to seek freedom-respecting alternatives. The simplest path forward will likely be to install a custom ROM on an Android device; however, kicking Google off the phone with its black box nudity blocker could also make it harder to access apps such as banking apps, which tend to need you to pass Google's integrity checks. Thankfully, Google Play Store apps can still be obtained by storefronts such as the Aurora Store, but it just adds to the friction. To be fair to those pushing this measure to protect children, I think it will be reasonably effective, but people will still try to find ways around it, just as they’ve done with age gates on adult websites introduced under the Online Safety Act. In the effort to find circumvention methods, it could lead users to join riskier platforms that introduce new dangers. This effort also diverts resources from proven interventions such as law enforcement cooperation, targeted investigations, education, and support services to broad technical controls that have uncertain effectiveness (due to their newness). If the government is set on introducing such tools, then there ought to be safeguards in place. Any mandated code should be released as free software so that it can be audited, and the binaries should be reproducible builds so that the public knows nothing has been tampered with in the code used to create the binaries shipped out. Ideally, these tools should also be voluntary, opt-in, and even community-run. This would also allow people to have full control over their hardware while allowing parents to flip a switch to turn on these protections for children, with the knowledge that the code being run is doing exactly what it says on the tin, and nothing nefarious, like a black box solution could be doing. The government should also have a narrow legal scope where this technology stays with blocking nudes and not spreading to blocking political opinions, hate speech, and so on. Ideally, any implementation should avoid identity-linked age verification to keep user data safe, and matching should be done locally with no server telemetry to ensure it is truly on-device. While I do understand that stakeholders such as parents want to keep children safe, the potential for abuse with this type of software is colossal. It would entrench black-box surveillance and take away our freedom to use our devices as we want. There is also the acute risk that the government will demand this surveillance be expanded to block other activities, which could be particularly dangerous. If you are in the UK and don’t wish to see these measures implemented, it is still possible to write to your MP, which could lead to some better safeguards being introduced before it’s too late. Once we get more technical information about how this will be implemented, then we will be able to see if de-Googling Android devices will bypass this measure. For anyone with an iPhone, there is zero chance that you’ll be able to take off these handcuffs because Apple doesn’t let you mess with your software.
    • I'm reading the reports as EU rejecting Apple's proposal because Trusted System Agent would be an intermediary offered to third party AI's (this article is also worded as such) but Siri AI itself would not pass this intermediary. This would cause a situation where Siri AI would have more direct system access and offer it an unfair advantage. (speaking from EU regulator perspective here) Apple is citing security issues with doing what EU asked for, and I think this also supports this theory, because truly direct system access like Siri AI would make it impossible to control third party AI's running on the devices and e.g. reign them in via adjustments to Trusted System Agent. So, I _think_ this is the sticking point right now: EU saying they need to be on equal footing as Siri AI, Apple saying they can't be because Apple only trusts their own AI. Apple could of course be leaning a bit extra hard towards this because they're biased in terms of excluding competitors. One method to find an agreement would be to have Siri AI also run through Trusted System Agent and treat it as untrusted. This kind of defensive architecture design (especially when involving an AI) would honestly not be a very bad idea from a sheer engineering standpoint. But then Apple would need to swallow their pride and adapt worldwide due to EU, and make perhaps major updates delaying Siri AI once more.
    • I have not even heard of that game. will take a look
    • Chasys Photo 5.41.01 by Razvan Serea Chasys Photo is a suite of image editing applications including a layer-based image editor with adjustment layers, linked layers, timeline and frame-based animation, icon editing, image stacking and comprehensive plug-in support (Chasys Photo Editor), a fast image viewer (Chasys Photo Viewer) and a fast multi-threaded image file converter (Chasys Photo Converter) , with RAW image support in all components. It supports the native file formats of several competitors including Adobe Photoshop, Affinity Photo, ArtWeaver, Corel PhotoPaint, FireAlpaca, GIMP, Krita, Paint.NET, PaintShop Pro and Pixlr, and the whole suite is designed to make effective use of multi-core processors, touch-screens and pen-input devices. Designed under the mantra of “unique, flexible and powerful”, Chasys Photo takes a radically different approach to image editing with the aim of opening up new possibilities for those who dare to be different. Chasys Photo key features: Free-style layering with blending modes Adjustment layers with multiple adjustments per layer Linked layers (a.k.a Linked Smart Objects) Composite, Image List, Frame Animation and Object Animation image modes Animation, both frame-based and object-based (timeline animation) Animation Composer engine Image Stacking for noise reduction, super-resolution, etc. Tablet/Pen-input/Stylus support with pressure control Touch-screen support with gestures including pitch-to-zoom and multi-finger panning Support for the native formats of Adobe Photoshop, Affinity Photo, ArtWeaver, Corel PhotoPaint, FireAlpaca, GIMP, Krita, Paint.NET, PaintShop Pro and Pixlr Support for common formats such as JPEG, animated PNG, animated GIF, TIFF, PICT, WebP, HEIF, DDS, JPEG-2000, JPEG-XR, JPEG-XL, AVI video, etc. Support for the OpenRaster interchange file format and rare formats such as QOI, MNG/JNG and DPX Support for older formats such as PPM/PGM/PBM, PCX/DCX, PCD, TGA, COKE, etc. Comprehensive Camera RAW file support with live adjustment Extensive plug-in support with streamlined SDKs Support for Photoshop Filter Plug-ins (.8BF) Advanced printing and scanning engines PDF document generation Icon and cursor editing, import and export, including Vista-style and Mac-OS icons Screen Capture, including Video Screen Capture with multiple triggering modes Video capture from devices (e.g. TV/Video) Supports multi-core processors, High-DPI displays and Multiple Display setups Integrated File Browser, Bluetooth OBEX and in-built utilities (Calculator, Notepad) Shell integration with thumbnails and conflict detection Unlimited Undo/Redo and Asynchronous Auto-Save, with Just-in-time memory compression to save space Fully re-editable text with advanced styling and effects (TextArt) Full alpha channel through out the workflow with Alpha protection (a.k.a. transparency protection) Multiple language support with user-editable language files and translation assistant (Chasys Photo Language Studio) Anti-aliasing and super-sampling support in tools and paths* Smart-resizing (similar to seam-carving) Best-in-class post-edit heuristics anti-aliasing engine Physical measurement specification with display size detection via EDID Uses the latest CD5 specification with animation and multi-resolution Super-fast internal graphics engine (JpDRAW2) Full UNICODE support in all components Metadata save, restore and scale to imitate vector art Configurable Guides and Grids with Snap-to-Grid Smart-dither to custom palette Asynchronous preview rendering engine Pantone equivalent palettes for PMS 100 to 814-2x Automatic color naming ... and many more! Chasys Photo 5.41.01 changelog: New Features Layered images with multiple pages (Composite/Multi-page) Additional templates to support template-centric workflow New Layer Blend Mode: Inverse Luma Mask Horizon detection in Rotate Transform Cropping option when importing video Orientation options in QR Code Generator plug-in Solved angle ambiguities (CCW versus CW) Internal Improvements Improved graphics engine (JpDRAW2™ v26.05) Improved CD5 codec (v4.10, improved ACSC compression) Improved interpolation when downsizing images Improved motion detection in Video Capture Slightly lower memory usage (RAM is getting expensive!) File Support and Bug Fixes Improved PXZ file support (placeholders, blanks) [bug-fix] Memory leak in flt_JPEG.dll Download: Chasys Photo 5.41.01 | 46.1 MB (Freeware) View: Chasys Photo Home Page | Wikipedia Page | Screenshot Get alerted to all of our Software updates on Twitter at @NeowinSoftware
  • Recent Achievements

    • Very Popular
      Captain_Eric earned a badge
      Very Popular
    • One Month Later
      amusc earned a badge
      One Month Later
    • One Month Later
      DJC50PLUS earned a badge
      One Month Later
    • Week One Done
      DJC50PLUS earned a badge
      Week One Done
    • Proficient
      Eric Biran went up a rank
      Proficient
  • Popular Contributors

    1. 1
      +primortal
      508
    2. 2
      PsYcHoKiLLa
      220
    3. 3
      ATLien_0
      92
    4. 4
      +Edouard
      90
    5. 5
      Steven P.
      83
  • Tell a friend

    Love Neowin? Tell a friend!