5 dépôts
Mechanisms for selectively importing or syncing data from external sources based on user-defined criteria.
Distinguishing note: Focuses on the filtering logic applied during data ingestion rather than general database querying.
Explore 5 awesome GitHub repositories matching data & databases · Data Synchronization Filters. Refine with filters or upvote what's useful.
Twenty is a headless customer relationship management framework that enables developers to build, version, and deploy custom business applications using code. By utilizing a declarative approach to data modeling, the platform allows for the definition of custom objects, fields, and complex relationships directly within the source code. This schema-driven architecture automatically generates corresponding REST and GraphQL APIs, ensuring that data structures and interface components remain synchronized across development and production environments. The platform distinguishes itself through a m
Select specific email folders to sync with the database, allowing users to exclude unwanted folders from the import process.
NATS Server is a high-performance, lightweight messaging system designed for cloud-native applications, edge computing, and distributed microservices. It functions as a distributed publish-subscribe broker that routes messages using hierarchical, dot-separated subject strings, enabling decoupled communication between services without requiring centralized broker lookups. The system supports core messaging patterns including asynchronous publish-subscribe, request-reply, and load-balanced queue processing. The platform distinguishes itself through a decentralized architecture that eliminates t
Restricts the data copied during mirroring by applying subject-based filters or defining specific starting points based on sequence numbers.
Ce projet est un système de capture de données modifiées (CDC) et une couche de synchronisation qui déplace les données des bases de données MySQL vers des index Elasticsearch. Il fonctionne comme un mappeur relationnel-vers-document, transformant les tables de base de données en documents interrogeables pour permettre l'intégration de données en temps réel et la recherche plein texte. Le synchroniseur se différencie en prenant en charge la dénormalisation des données relationnelles, qui transforme les jointures un-à-plusieurs de la base de données en structures de documents parent-enfant. Il permet également l'agrégation de tables partitionnées, en utilisant des expressions régulières pour regrouper plusieurs tables de base de données dans un seul index de recherche. Le système couvre le mappage et la transformation complets des données, incluant la conversion de types de champs, le mappage de schémas et le filtrage de champs synchronisés. Il emploie un modèle de traitement basé sur un pipeline pour décoder et fusionner les champs, utilisant à la fois le chargement initial basé sur des snapshots pour les bases de référence et le streaming de logs binaires pour les mises à jour en temps réel.
Selects specific database columns for synchronization to prevent unnecessary data from entering the search index.
imapsync is an IMAP mailbox synchronization tool and data migration utility designed to copy and synchronize email messages and folder structures between two IMAP servers. It functions as a migration manager for transferring bulk email accounts between different hosting providers, preserving folder hierarchies and message metadata. The tool is distinguished by its ability to automate the transfer of multiple mailboxes sequentially from delimited lists using administrative credentials or user-specific authentication. It supports advanced authentication methods including OAuth2 and XOAUTH2, and
Provides a selection mechanism for synchronizing emails based on date ranges, age, size, or search queries.
CookieCloud is a system for synchronizing encrypted browser cookies and local storage across multiple devices using a self-hosted server. Its primary purpose is to maintain authenticated session states across different browser installations without the need for repeated manual authentication. The project employs a client-side end-to-end encryption model, ensuring that sensitive data is encrypted and decrypted locally on the device so the synchronization server only handles ciphertext. It distinguishes itself by providing automated session maintenance, which periodically refreshes specific web
Limits the synchronization of cookies to specific domains using user-defined keyword filters.