1 repository
Awesome GitHub RepositoriesRecord Clustering
Grouping records into clusters based on similarity thresholds and assigning confidence scores for membership.
Distinct from Profile Record Deduplicators: Distinct from active record patterns or simple record existence checks; it is a grouping mechanism for entity resolution.
Explore 1 awesome GitHub repository matching data & databases · Record Clustering. Refine with filters or upvote what's useful.
Awesome Record Clustering GitHub Repositories
Găsește cele mai bune repo-uri cu AI.Vom căuta cele mai potrivite repository-uri folosind AI.
- dedupeio/dedupe
dedupeio/dedupe
4,442Vezi pe GitHubDedupe is a machine learning tool for entity resolution that identifies and merges duplicate records in structured datasets. It uses active learning to train a matching model from human-labeled examples, learning which field-level similarities are most important for detecting duplicates without requiring manual rule writing. The system combines fingerprint-based blocking to reduce pairwise comparisons, enabling efficient matching on large datasets, and groups scored record pairs into clusters using a configurable similarity threshold. The tool provides multiple interfaces for different workfl
Groups scored record pairs into clusters of records that all refer to the same entity.
Pythonclusteringdatamadede-duplicating
