Fast and efficient content-defined chunking for data deduplication. Java implementation of FastCDC as library.
-
Updated
Sep 21, 2023 - Java
Fast and efficient content-defined chunking for data deduplication. Java implementation of FastCDC as library.
DedupBench is a benchmarking tool for content-defined chunking techniques used in data deduplication. It currently supports eleven unique CDC techniques and five different vector instruction sets.
Fast content-defined chunking in Go.
CDCZip is a deduplication filter meant for use as long range match finder preprocessor for use alongside other compression algorithms.
Find (partial content) duplicate files.
Print FastCDC rolling hash chunks and checksums.
Synclet is a content-defined, chunk-based file synchronization and backup tool that detects and syncs only the actual changes—efficiently, intelligently, and reliably.
cdcgo is a Go library that implements FastCDC , a high-performance content-defined chunking algorithm for deduplication and data storage.
A Rust library for Content-Defined Chunking (CDC).
A FUSE-based filesystem implementing content-defined chunking and deduplication in Rust.
Clojure implementation of Rabin-Karp rolling hash and chunker
Open-source toolkit for lossless, reference-based reconstruction of large binary artifacts using deterministic CDC and compact SBD1 seeds.
Coldkeep is a correctness-first content-addressed cold storage with deterministic restore, audited integrity, safe GC, and built-in deduplication
Add a description, image, and links to the content-defined-chunking topic page so that developers can more easily learn about it.
To associate your repository with the content-defined-chunking topic, visit your repo's landing page and select "manage topics."