On the recordRead 10 Oct 202623 facts
dedupe
Chicago, Illinois, United States
On the record
- API
- The former Dedupe.io web API supported matching and training against projects through REST calls, including incremental checks, matches and additions after deduplication.dedupe.io · read 4 Oct 2026
- Compliance
- The former service's FAQ states that Dedupe.io was certified FERPA compliant as of July 2019.dedupe.io · read 10 Oct 2026
- Data formats
- The former service’s FAQ says uploads accepted Excel spreadsheets and CSV files, with one record per row and column names in the first row.dedupe.io · read 4 Oct 2026
- Data privacy
- The former service's FAQ says it would not rent or sell submitted data and would not allow third-party access without signed consent.dedupe.io · read 10 Oct 2026
- Features
- Documented features include learned weights and blocking rules, laptop execution, library integration, and support for custom data types, comparators, and blocking rules.docs.dedupe.io · read 10 Oct 2026
- How it learns
- It uses human-labeled training data to learn rules for finding similar records, including in large databases.docs.dedupe.io · read 10 Oct 2026
- Input formats
- The former Dedupe.io service accepted spreadsheet files (.xls, .xslx) and comma-separated text (.csv).dedupe.io · read 10 Oct 2026
- Installation
- The documentation gives `pip install dedupe` as the installation command.docs.dedupe.io · read 10 Oct 2026
- Integrations
- The project describes dedupe as a library that can be integrated into applications or import scripts; it also documents CSV deduplication through the separate csvdedupe command-line tool.docs.dedupe.io · read 4 Oct 2026
- Intended users
- The maintainers describe the library as suitable for integration into applications or import scripts, while the former Dedupe.io service was designed as an online tool for non-developers.docs.dedupe.io · read 10 Oct 2026
- License
- The GitHub repository identifies the project as MIT licensed.github.com · read 10 Oct 2026
- Open source library
- dedupe is a Python library that uses machine learning for fuzzy matching, deduplication and entity resolution on structured data.github.com · read 4 Oct 2026
- Privacy
- The former service’s FAQ says its privacy policy prohibited renting or selling user data and third-party access without signed consent, and limited company access to debugging and service improvement.dedupe.io · read 4 Oct 2026
- Product status
- Dedupe.io, the hosted service, shut down on January 31, 2023.dedupe.io · read 10 Oct 2026
- Self-hosting
- The developer page says Python developers can run the library on local machines or servers and build self-hosted entity-resolution pipelines.dedupe.io · read 4 Oct 2026
- Support
- The library documentation directs bug reports to GitHub Issues and lists a mailing list for users.docs.dedupe.io · read 10 Oct 2026
- Training
- The library uses human-labeled examples to learn rules for finding similar records, including in very large databases.docs.dedupe.io · read 4 Oct 2026
- Training limit
- The former service required at least 10 positive and 10 negative record-pair examples during training.dedupe.io · read 4 Oct 2026
