Improved deduplication through parallel binning
Zhang, Zhike; Bhagwat, Deepavali; Litwin, Witold; Long, Darrell; Schwarz, Thomas (2012), Improved deduplication through parallel binning, 2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC), proceedings, IEEE, p. 130-141. 10.1109/PCCC.2012.6407746
TypeCommunication / Conférence
Conference title2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC)
Conference countryUnited States
Book title2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC), proceedings
MetadataShow full item record
Laboratoire d'analyse et modélisation de systèmes pour l'aide à la décision [LAMSADE]
Abstract (EN)Many modern storage systems use deduplication in order to compress data by avoiding storing the same data twice. Deduplication needs to use data stored in the past, but accessing information about all data stored can cause a severe bottleneck. Similarity based deduplication only accesses information on past data that is likely to be similar and thus more likely to yield good deduplication. We present an adaptive deduplication strategy that extends Extreme Binning and investigate theoretically and experimentally the effects of the additional bin accesses.
Subjects / Keywordsdeduplication optimization
Showing items related by title and author.
Constantin, Camelia; du Mouza, Cedric; Litwin, Witold; Rigaux, Philippe; Schwarz, Thomas (2016) Article accepté pour publication ou publié