xorf | Xor filters - efficient probabilistic hashsets | Hashing library

xorf is a Rust library typically used in Security, Hashing applications. xorf has no bugs, it has no vulnerabilities, it has a Permissive License and it has low support. You can download it from GitHub.

This repository hosts a Rust library implementing xor filters -- data structures for fast approximation of set membership using little memory. Probabilistic filters like xor filters are useful when it's okay to have false positives sometimes, but it's important to be space and time efficient. In other words, they trade off accuracy for efficiency as compared to general-purpose hashsets. Filters like xor filter are often used in conjunction with larger hash-based data structures, with the filter doing a "first pass" of the work to avoid using a more expensive resource unnecessarily. For example, filters like xor filters can be used to reduce disk writes in a cache or identify malicious URLs in a browser. Xor filters are faster and smaller than Bloom and Cuckoo filters. Xor filters incur a relative time penalty in construction, but are very fast in lookups; the expectation is that construction of a filter is amortized after many queries. Daniel Lemire's go implementation provides a useful summary of xor filters' benefits and listing of other xor filter libraries.