Skip to main content
buildradar
Sign in
Topic · deduplication

deduplication

Tracked open-source repos tagged deduplication, sorted by stars.

Repos
21
Total stars
110,741
Avg. stars
5,273
Share
0.01%

Related topics

Topics that frequently appear alongside deduplication on the same repo.

Recent risers

Repos created in the last 90 days, tagged deduplication.

No new repos tagged with this topic in the last 90 days.

  • restic↗@restic

    Fast, secure, efficient backup program

    ★ 35,836+63Star change over the last 7 days
  • kopia↗@kopia

    Cross-platform backup tool for Windows, macOS & Linux with fast, incremental backups, client-side end-to-end encryption, compression and data deduplication. CLI and GUI included.

    ★ 14,022+40Star change over the last 7 days
  • borg↗@borgbackup

    Deduplicating archiver with compression and authenticated encryption.

    ★ 13,683+17Star change over the last 7 days
  • alertmanager↗@prometheus

    Prometheus Alertmanager

    ★ 8,603+4Star change over the last 7 days
  • dupeguru↗@arsenetar

    Find duplicate files

    ★ 7,812+18Star change over the last 7 days
  • libpostal↗@openvenues

    A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

    ★ 4,880+1Star change over the last 7 days
  • rustic↗@rustic-rs

    rustic - fast, encrypted, and deduplicated backups powered by Rust

    ★ 3,217+17Star change over the last 7 days
  • dwarfs↗@mhx

    A fast high-compression read-only file system for Linux, FreeBSD, macOS and Windows

    ★ 2,598+4Star change over the last 7 days
  • rmlint↗@sahib

    Extremely fast tool to remove duplicates and other lint from your filesystem

    ★ 2,416+1Star change over the last 7 days
  • splink↗@moj-analytical-services

    Fast, accurate and scalable probabilistic data linkage with support for multiple SQL backends

    ★ 2,375+6Star change over the last 7 days
  • borgmatic↗@borgmatic-collective

    Simple, configuration-driven backup software for servers and workstations

    ★ 2,315+3Star change over the last 7 days
  • plakar↗@PlakarKorp

    plakar is a backup solution powered by Kloset and ptar

    ★ 2,039+1Star change over the last 7 days
  • autorestic↗@cupcakearmy

    Config driven, easy backup cli for restic.

    ★ 1,860+1Star change over the last 7 days
  • Curator↗@NVIDIA-NeMo

    Scalable data pre processing and curation toolkit for LLMs

    ★ 1,747+7Star change over the last 7 days
  • borg-ui↗@karanhudia

    Replace complex Borg Backup terminal commands with a beautiful web UI. Create, schedule, and restore backups with just a few clicks.

    ★ 1,602+4Star change over the last 7 days
  • zingg↗@zinggAI

    Scalable master data management, identity resolution, entity resolution, and deduplication using ML

    ★ 1,243+5Star change over the last 7 days
  • recordlinkage↗@J535D165

    A powerful and modular toolkit for record linkage and duplicate detection in Python

    ★ 1,062+0Star change over the last 7 days
  • semhash↗@MinishLab

    Fast Multimodal Semantic Deduplication & Filtering

    ★ 963+2Star change over the last 7 days
  • data-prep-kit↗@data-prep-kit

    Open source project for data preparation for GenAI applications

    ★ 958+2Star change over the last 7 days
  • postgresql-patterns-library↗@rin-nas

    Коллекция готовых SQL запросов для PostgreSQL по часто возникающим задачам (получение и модификация данных, ускорение запросов, обслуживание БД)

    ★ 779+0Star change over the last 7 days
  • talisman↗@Yomguithereal

    Straightforward fuzzy matching, information retrieval and NLP building blocks for JavaScript.

    ★ 732+0Star change over the last 7 days
← Back to topics