This provided yet another layer of efficiency to maximize storage savings.Īs data deduplication efficiency improved, new challenges arose. Appliance vendors like Data Domain further improved on storage savings by using target-based- and variable block-based techniques that only required backing up changed data segments rather than all segments. One example is Quantum’s use of file-based or fixed-block-based storage, which focused on reducing storage costs. Early breakthroughs in data deduplication were designed for the challenge of the time - reducing storage capacity and bringing more reliable data backup to servers and tape. While data deduplication is a common concept, not all deduplication techniques are the same. Data deduplication solutions evolve to meet the need for speed With data deduplication, only one instance of the attachment is actually stored each subsequent instance is referenced back to the one saved copy, reducing storage and bandwidth demand to only 1 MB. Without data duplication, if everyone backs up his email inbox, all 100 instances of the presentation are saved, requiring 100 MB of storage space. A real-world exampleĬonsider an email server that contains 100 instances of the same 1 MB file attachment, for example a sales presentation with graphics sent to everyone on the global sales staff. Reducing the amount of data to transmit across the network can save significant money in terms of storage costs and backup speed - in some cases, up to 50 percent. In some companies, 80% of corporate data is duplicated across the organization. Given that the same byte pattern may occur dozens, hundreds, or even thousands of times - think about the number of times you make only small changes to a PowerPoint file - the amount of duplicate data can be significant. Then, duplicates are replaced with a reference that points to the stored chunk. The data is analyzed to identify duplicate byte patterns and ensure the single instance is indeed the only file. In the process of deduplication, extra copies of the same data are deleted, leaving only one copy to be stored. First, the basicsĪt its simplest definition, data deduplication refers to a technique for eliminating redundant data in a data set. In this blog, we’ll be providing a clear definition of what “data duplication” means, and why it is a fundamental requirement in migrating your organization’s data to the cloud. If you work in IT and are responsible for backing up or transferring large amounts of data, you’ve probably heard the term data deduplication.
0 kommentar(er)
