I really feel that these sort of disks are starting to be seriously limited.. (Score: 1) by insulatedkiwi@pipedot.org on 2014-02-18 14:10 (#25) Even with SATA and SAS 6G connectivity, you're still looking at a lot of time for file system verification, backups, even just using dd. I think they're fine for general usage, but the size of them is making a lot of the things I suggested earlier pretty time prohibitive.. Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 2, Informative) by evilviper@pipedot.org on 2014-02-19 07:40 (#2Q) FSCK is mostly a thing of the past. Smarter backup tools can do instantaneous snapshots with deduplication and more. "dd" is the WORST way to read or write a hard drive, whatever you might be trying to accomplish. And hard drive throughput does keep getting faster as capacities increase, so it's not as big of a hit as you might expect.If you've got a 6TB drive packed with a few large files (like Blu-ray or HDTV rips) and they don't completely change from day to day, a simple rsync over the network could still be extremely fast. Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 1) by insulatedkiwi@pipedot.org on 2014-02-19 10:10 (#2T) I'm mostly in agreement with you, de-duplication and large files do make tools like rsync quite efficent, but there is a lot of "enterprise" use that doesn't fit into those categories, mailstores being a good example.. Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 1) by per@pipedot.org on 2014-02-20 08:04 (#39) For that, you'd use zfs snapshots, and send+recv. Infinitely faster than rsync on large files where only a small portion has changed, because the file system knows what has changed, while rsync has to read and compare the files.
Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 2, Informative) by evilviper@pipedot.org on 2014-02-19 07:40 (#2Q) FSCK is mostly a thing of the past. Smarter backup tools can do instantaneous snapshots with deduplication and more. "dd" is the WORST way to read or write a hard drive, whatever you might be trying to accomplish. And hard drive throughput does keep getting faster as capacities increase, so it's not as big of a hit as you might expect.If you've got a 6TB drive packed with a few large files (like Blu-ray or HDTV rips) and they don't completely change from day to day, a simple rsync over the network could still be extremely fast. Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 1) by insulatedkiwi@pipedot.org on 2014-02-19 10:10 (#2T) I'm mostly in agreement with you, de-duplication and large files do make tools like rsync quite efficent, but there is a lot of "enterprise" use that doesn't fit into those categories, mailstores being a good example.. Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 1) by per@pipedot.org on 2014-02-20 08:04 (#39) For that, you'd use zfs snapshots, and send+recv. Infinitely faster than rsync on large files where only a small portion has changed, because the file system knows what has changed, while rsync has to read and compare the files.
Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 1) by insulatedkiwi@pipedot.org on 2014-02-19 10:10 (#2T) I'm mostly in agreement with you, de-duplication and large files do make tools like rsync quite efficent, but there is a lot of "enterprise" use that doesn't fit into those categories, mailstores being a good example.. Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 1) by per@pipedot.org on 2014-02-20 08:04 (#39) For that, you'd use zfs snapshots, and send+recv. Infinitely faster than rsync on large files where only a small portion has changed, because the file system knows what has changed, while rsync has to read and compare the files.
Re: I really feel that these sort of disks are starting to be seriously limited.. (Score: 1) by per@pipedot.org on 2014-02-20 08:04 (#39) For that, you'd use zfs snapshots, and send+recv. Infinitely faster than rsync on large files where only a small portion has changed, because the file system knows what has changed, while rsync has to read and compare the files.