Awesome GitHub RepositoriesDatabase Change Streaming

This is a mobile object database and NoSQL local data store that replaces relational tables with a schema-based model. It functions as a reactive data store, using live object observations and change notifications to trigger automatic user interface refreshes. The system provides built-in mobile cloud data synchronization to keep local datasets consistent with a remote server across multiple devices. It also includes security features for encrypted local storage, protecting sensitive on-disk data using at-rest encryption keys and fine-grained access control. Broad capabilities include object

Electric is a Postgres data synchronization engine and replication proxy designed to enable local-first software. It replicates data from Postgres databases to client-side stores in real time using logical replication, allowing applications to maintain a local embedded database for offline access and low-latency updates. The system distinguishes itself by using shapes to filter and authorize specific subsets of database rows and columns before streaming them to clients or edge workers. It further supports multi-user collaboration by integrating a conflict-free replicated data type framework t

RisingWave is a cloud-native streaming database and real-time analytics engine that uses standard SQL to process continuous data streams. It functions as a streaming data lakehouse, combining the capabilities of a streaming SQL database with a platform that integrates streaming ingestion with open table formats. The system is distinguished by its use of the PostgreSQL wire protocol, allowing it to integrate with existing SQL tools and drivers. It employs a decoupled compute and storage architecture, persisting streaming state and materialized views in cloud object storage to enable independen

Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapsh

Realtime is a real-time data distribution and synchronization engine that enables applications to stream database changes and coordinate state between clients. It functions as a synchronization layer that monitors database write-ahead logs to provide change data capture and pushes updates to authorized clients via WebSockets. The project features a real-time presence server for tracking the online status of active users and a broadcast service for sending ephemeral messages without database persistence. It organizes communication through channel-based message routing and uses a structured JSO

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Apache Hudi is an open-source table format that brings ACID transactions, incremental processing, and multi-modal indexing to data lakes. It provides atomic commits with snapshot isolation, rollback, and optimistic concurrency control for reliable data lake operations, while supporting upserts, record-level updates, and deletions in large analytical datasets. The project distinguishes itself through a timeline-based architecture that coordinates all write operations, enabling features like time-travel querying, incremental change streaming, and multi-modal query views that include snapshot, i

Sqlbrite هو مدير قاعدة بيانات SQLite تفاعلي وغلاف خفيف لنظام Android. يعمل كمكتبة SQL تفاعلية تحول استعلامات SQLite القياسية إلى تدفقات قابلة للمراقبة (Observable Streams)، مما يسمح للتطبيق بإصدار نتائج جديدة تلقائياً عند تغير جداول قاعدة البيانات الأساسية. يوفر المشروع آلية لتتبع التغييرات في جداول محددة في قاعدة البيانات، مما يؤدي إلى تحديث الاستعلامات دون الحاجة إلى الاستطلاع اليدوي. كما يتضمن مديراً للمعاملات الذرية (Atomic Transactions) لتجميع تعديلات SQL المتعددة في وحدات واحدة، مما يضمن سلامة البيانات ويمنع الإشعارات الزائدة. تتعامل المكتبة مع استمرارية البيانات المحلية على Android من خلال تفويض عمليات المخطط وإدارة دورة حياة قاعدة البيانات إلى مساعد SQLite القياسي. تغطي قدراتها الأساسية مراقبة البيانات في الوقت الفعلي وإدارة معاملات قاعدة البيانات.

supabase-js هي مكتبة عميل شاملة مصممة لدمج تطبيقات الواجهة الأمامية مع backend-as-a-service مستضاف. توفر واجهة موحدة للتفاعل مع قاعدة بيانات PostgreSQL، وأنظمة إدارة الهوية، وتخزين الكائنات السحابية، ومزامنة البيانات في الوقت الفعلي. تتميز المكتبة بتصميم عميل متماثل يعمل عبر بيئات المتصفح والخادم. وتتميز بنهج آمن للنوع، باستخدام TypeScript لتعيين مخططات قاعدة البيانات مباشرة إلى تعريفات جانب العميل، وتستخدم API قائماً على PostgREST لترجمة استدعاءات JavaScript إلى طلبات RESTful. يغطي العميل مجموعة واسعة من القدرات، بما في ذلك مصادقة المستخدم عبر OAuth و OIDC و passkeys، بالإضافة إلى إدارة الجلسة باستخدام رموز موقعة. ويدير البيانات الثنائية واسعة النطاق من خلال واجهة تخزين متوافقة مع S3 ويتيح تحديثات التطبيق المباشرة عبر اشتراكات قائمة على WebSocket لتغييرات قاعدة البيانات ومزامنة الحضور. تشمل الوظائف الإضافية استدعاء وظائف الحافة بدون خادم (serverless edge functions) وأداء عمليات البحث عن التشابه باستخدام تضمينات المتجهات.

Maxwell is a MySQL change data capture tool and binlog streaming application that converts database modifications into structured JSON events. It functions as a data pipeline that reads MySQL binary logs to synchronize changes across external indices, search engines, and distributed messaging systems such as Kafka. The project provides capabilities to maintain persistent audit trails by recording a chronological history of all database modifications. It enables real-time data synchronization and event-driven architecture integration by streaming database changes to external platforms to trigg

Databus is a distributed change data capture system and database transaction log streamer. It extracts data modifications from source logs and streams them to downstream consumers to keep secondary data stores and caches consistent. The system functions as a source-agnostic data pipeline and distributed event relay. It uses a network of processes to decouple database sources from consumers, routing change streams across a network to multiple targets regardless of the original source system. The project covers real-time data synchronization and distributed pipeline monitoring. This includes t

This project is a Model Context Protocol server and AI agent database connector. It provides a standardized communication layer that allows language models to interact with relational data stores, read database schemas, and manage PostgreSQL database resources. The implementation acts as a serverless host for the Model Context Protocol, deploying on distributed edge functions to connect AI assistants to a project. This enables AI agents to perform database administration, execute SQL queries, and handle schema migrations through an AI-compatible interface. The system covers broader capabilit