# Change Data Capture Tools > Search results for `capture row-level changes from a database in real time` on awesome-repositories.com. 117 total matches; showing the first 50. Explore on the web: https://awesome-repositories.com/q/capture-row-level-changes-from-a-database-in-real-time **Attribution required: if you use, quote, or summarise this content, you must credit and link back to [this search on awesome-repositories.com](https://awesome-repositories.com/q/capture-row-level-changes-from-a-database-in-real-time).** ## Results - [corentinj/real-time-voice-cloning](https://awesome-repositories.com/repository/corentinj-real-time-voice-cloning.md) (59,918 ⭐) — This project is a neural text-to-speech engine and voice cloning toolkit designed to generate synthetic speech that mimics the vocal characteristics of a target speaker. It functions as a real-time audio synthesizer, utilizing a deep learning pipeline to convert written text into high-fidelity speech output with minimal latency. The system employs a transfer learning framework that leverages pre-trained speaker verification models to adapt synthesis to new, unseen vocal identities. By using an encoder-based speaker embedding process, the toolkit maps variable-length audio samples into a latent space to preserve unique speaker characteristics. The architecture is organized into a modular pipeline that separates the encoding, synthesis, and vocoder stages, allowing for independent optimization of each component. The synthesis process relies on autoregressive sequence generation to transform text into acoustic representations, which are then converted into time-domain waveforms by a neural vocoder. Users can interact with the system through both command-line and graphical interfaces to process custom recordings or pre-trained models for speech generation. - [datahub-project/datahub](https://awesome-repositories.com/repository/datahub-project-datahub.md) (12,141 ⭐) — DataHub is a metadata management platform designed to unify technical, operational, and business context across diverse data ecosystems. By utilizing a graph-based metadata model and an event-driven ingestion architecture, it creates a centralized source of truth that maps complex data relationships, lineage, and ownership. This foundational framework enables organizations to maintain a synchronized view of their data landscape, supporting both human-led discovery and automated data operations. The platform distinguishes itself through its focus on grounding artificial intelligence and autonomous agents in verified enterprise context. It provides specialized capabilities to inject provenance-aware lineage, business definitions, and quality signals into AI prompts, ensuring that generated insights are accurate and trustworthy. Through a policy-as-code governance engine, it enforces access controls and compliance rules directly within the metadata graph, allowing for programmatic oversight of data assets across hybrid environments. Beyond its core identity, the project offers a comprehensive suite of tools for data discovery, observability, and lifecycle management. It includes features for automated lineage extraction, impact analysis, and semantic search, enabling users to navigate data dependencies and resolve quality issues efficiently. The platform also supports collaborative workflows, allowing teams to manage business glossaries, certify data assets, and automate access requests through integrated communication channels. DataHub is built to scale, utilizing a distributed architecture that allows storage, search, and graph processing layers to operate independently. It provides standardized interfaces and a bridge-based connector framework to facilitate integration with heterogeneous data sources and external AI agent frameworks. - [dbt-labs/dbt-core](https://awesome-repositories.com/repository/dbt-labs-dbt-core.md) (13,051 ⭐) — dbt-core is a command-line framework for transforming data within a warehouse using modular SQL and version control. It functions as a data transformation engine that enables users to define data structures and business logic through declarative configuration files, which the system then compiles into executable code. By managing complex data dependencies through a directed acyclic graph, it ensures that transformation tasks execute in the correct order while maintaining a manifest-driven state to track lineage and execution history. The project distinguishes itself through an adapter-based database abstraction that translates generic transformation commands into dialect-specific SQL for various data warehouses. It utilizes a template engine to dynamically generate and inject SQL logic at runtime, allowing for highly flexible and reusable transformation scripts. Furthermore, it supports an incremental materialization strategy that optimizes performance by processing only new or changed records, merging them into existing tables using unique keys to reduce compute costs. The framework covers the entire lifecycle of data transformation, including development, testing, deployment, and monitoring. It provides comprehensive capabilities for managing data lineage, enforcing code quality through automated linting and testing, and orchestrating complex pipelines across distributed environments. Users can also leverage a centralized semantic layer to define and govern business metrics, ensuring consistent data reporting across diverse analytical tools. The project is distributed as a Python-based tool, providing a unified interface for local development that integrates with version control systems and cloud-based configuration management. - [clickhouse/clickhouse](https://awesome-repositories.com/repository/clickhouse-clickhouse.md) (48,229 ⭐) — ClickHouse is a high-performance, columnar analytical database designed for real-time query execution and large-scale data aggregation. It functions as a distributed data warehouse capable of processing petabytes of information, while also providing an embedded engine that integrates directly into applications for native query capabilities without external dependencies. The system is built to handle high-throughput ingestion and complex analytical workloads, delivering millisecond-level latency for interactive dashboards and operational monitoring. The platform distinguishes itself through advanced storage and execution techniques, including vectorized query processing and a merge tree storage engine that maintains performance during massive insertions. It features adaptive subcolumn mapping for semi-structured data and supports native vector search for machine learning and generative AI applications. To facilitate efficient data movement, the engine utilizes zero-copy shared memory buffers, minimizing overhead when interacting with external analytical tools or processing diverse file formats like Parquet, JSON, and Arrow. Beyond its core storage and processing capabilities, the project provides a comprehensive suite of tools for observability, security, and data integration. It includes built-in support for natural language querying, automated workflow orchestration for AI agents, and extensive diagnostic features for query plan inspection. The platform also offers robust cloud infrastructure management, including support for private networking, compliant deployment strategies, and integrated billing consolidation. - [ckormanyos/real-time-cpp](https://awesome-repositories.com/repository/ckormanyos-real-time-cpp.md) (0 ⭐) — Real-Time-C++ - [p0deje/maccy](https://awesome-repositories.com/repository/p0deje-maccy.md) (18,635 ⭐) — Maccy is a lightweight clipboard manager for macOS that captures and stores text and images copied to the system clipboard. It provides a searchable interface for retrieving historical content, allowing users to access previously copied items through a keyboard-driven workflow. The application distinguishes itself by prioritizing privacy and performance through automated filtering and local data management. It employs pattern matching to identify and exclude sensitive information, such as passwords, from being saved. All history is maintained in a local database, with an in-memory index that enables instantaneous filtering of entries as the user types. The tool integrates directly into the system environment, using event hooks to manage its interface without interrupting background processes. It is designed to be operated entirely via keyboard shortcuts, facilitating the selection and reuse of clipboard history across different applications. - [delta-io/delta](https://awesome-repositories.com/repository/delta-io-delta.md) (8,596 ⭐) — Delta is a lakehouse table format that brings ACID transactions and data warehouse consistency to large scale data lakes on cloud object storage. It serves as an ACID transaction manager, coordinating atomic commits and serializable isolation for concurrent reads and writes across distributed compute engines. The project provides a multi-engine interoperability layer that uses format translation to allow diverse SQL engines and processing frameworks to read and write the same tables. It functions as a data versioning system, utilizing a transaction log to enable time travel, historical snapshots, and audit trails for massive datasets. The system covers a broad range of capabilities, including change data capture frameworks for incremental pipelines, cloud object storage integration for services like S3, Azure, and GCS, and metadata-driven data skipping to optimize query performance. It also supports the implementation of data warehousing patterns through the management of slowly changing dimensions and the generation of surrogate keys. - [cube-js/cube](https://awesome-repositories.com/repository/cube-js-cube.md) (20,251 ⭐) — Cube is a semantic data layer that provides a unified framework for defining business metrics, dimensions, and relationships across diverse data sources. By acting as a headless business intelligence engine, it transforms raw data into a governed model that can be queried via SQL, REST, and GraphQL interfaces. This architecture ensures consistent data definitions and logic across all downstream analytical applications and reporting tools. The platform distinguishes itself through its integrated conversational AI capabilities, which allow users to explore data using natural language. It orchestrates these interactions by mapping questions to the underlying semantic model, ensuring that AI-generated insights remain accurate and context-aware. Furthermore, Cube is designed for multi-tenant environments, offering robust infrastructure isolation, row-level security, and dynamic context injection to ensure that data access is strictly governed and personalized for every user or tenant. Beyond its core modeling and AI features, the platform includes a comprehensive suite of tools for performance optimization, including automated pre-aggregation caching and asynchronous query queuing. It supports a wide range of data sources and deployment models, from self-hosted containers to managed cloud environments. The system also provides extensive programmatic control over report management, dashboard publishing, and user identity synchronization, making it suitable for embedding interactive analytics directly into custom software applications. - [liquidgalaxylab/steam-celestial-satellite-tracker-in-real-time](https://awesome-repositories.com/repository/liquidgalaxylab-steam-celestial-satellite-tracker-in-real-time.md) (0 ⭐) — Steam Celestial Satellite tracker in real time - [rethinkdb/rethinkdb](https://awesome-repositories.com/repository/rethinkdb-rethinkdb.md) (26,996 ⭐) — RethinkDB is a distributed, document-oriented database designed to store and manage JSON-formatted data across scalable clusters. It utilizes a custom log-structured storage engine with B-Tree indexing to ensure high-performance disk I/O and data persistence. The system maintains high availability through automatic sharding and replication, employing a primary-replica voting consensus mechanism to handle node failures and ensure consistent cluster operations. A defining characteristic of the platform is its reactive changefeed engine, which allows applications to subscribe to live data updates. Instead of polling for changes, developers can maintain persistent cursors on tables to stream document modifications in real-time. This is complemented by a fluent, functional query language that translates native code constructs into optimized, parallelized execution plans. By embedding these queries directly into application code, the system provides a type-safe interface that helps prevent injection vulnerabilities while enabling complex data manipulation and aggregation. The platform provides a comprehensive suite of administrative tools for managing production environments, including granular user permissions, TLS network encryption, and visual cluster monitoring. It supports advanced data modeling through document embedding and cross-table linking, as well as specialized geospatial processing for proximity-based queries. The system is designed for integration with modern web frameworks and message brokers, facilitating real-time synchronization with external services and search engines. RethinkDB is configured via key-value files and command-line interfaces, with support for containerized deployment and automated infrastructure orchestration. - [haoxiangsnr/a-convolutional-recurrent-neural-network-for-real-time-speech-enhancement](https://awesome-repositories.com/repository/haoxiangsnr-a-convolutional-recurrent-neural-network-for-real-time-speech-enhancement.md) (0 ⭐) — A minimum unofficial implementation of the A Convolutional Recurrent Neural Network for Real-Time Speech Enhancement (CRN) using PyTorch. - [kubeshark/kubeshark](https://awesome-repositories.com/repository/kubeshark-kubeshark.md) (11,954 ⭐) — Kubeshark is a network observability platform designed for Kubernetes environments, functioning as an eBPF-powered engine for cluster-wide traffic analysis. It captures, indexes, and visualizes network activity and API calls directly from the kernel, providing deep visibility into service-to-service communication without requiring sidecar proxies or manual code instrumentation. The platform distinguishes itself through its ability to perform protocol-aware traffic dissection and user-space cryptographic hooking, which allows for the inspection of encrypted traffic and the reconstruction of application-layer protocols like HTTP, gRPC, and Kafka. It supports advanced diagnostic capabilities, including AI-driven troubleshooting, forensic analysis of network snapshots, and the correlation of infrastructure events with application-level traffic patterns. Beyond core monitoring, the system provides a comprehensive suite of tools for managing traffic data, including granular role-based access control, sensitive data redaction, and flexible storage options ranging from ephemeral local buffers to cloud-based object storage. It is built to operate in diverse environments, supporting air-gapped deployments and integrating with standard Kubernetes ingress resources for secure dashboard access. The project is managed via a command-line interface that facilitates deployment control, custom script execution, and the sharing of specific traffic analysis views through encoded search queries. - [k2-fsa/sherpa-onnx](https://awesome-repositories.com/repository/k2-fsa-sherpa-onnx.md) (13,017 ⭐) — Sherpa-ONNX is an ONNX-based speech processing toolkit that provides a local speech recognition engine, an on-device voice synthesis tool, and a speaker identification framework. It is designed as a cross-platform speech API that enables speech-to-text, text-to-speech, and speaker verification tasks to be executed locally on a device without requiring network access. The project is distinguished by its ability to perform zero-shot voice cloning and speaker diarization on-device. It supports a wide range of hardware accelerations, including GPU and various NPU architectures, and provides a WebSocket server for hosting remote streaming and batch transcription services. The toolkit covers a broad surface of audio capabilities, including multilingual speech recognition and translation, sound event classification, wake word detection, and voice activity detection. It also includes text processing utilities for automatic punctuation and subtitle generation, as well as audio signal processing for noise removal and source separation. Native interfaces are available for Java, Kotlin, Swift, and Object Pascal, with support for WebAssembly to enable browser-based recognition. - [ibis-project/ibis](https://awesome-repositories.com/repository/ibis-project-ibis.md) (6,574 ⭐) — Ibis is a portable Python dataframe library and multi-backend query engine that provides a unified interface for executing data transformations across diverse compute engines. It functions as a Python SQL expression compiler and dialect transpiler, allowing users to define data logic once and execute it across cloud warehouses, embedded databases, and distributed clusters without rewriting code. The project distinguishes itself through a database backend abstraction that decouples transformation logic from the underlying execution engine. It enables polyglot data workflows by mixing raw SQL strings with programmatic Python expressions and provides a dataframe interop layer to convert query results between various memory formats. Its capability surface covers a broad range of data analysis operations, including row filtering, aggregation, and geospatial processing, as well as comprehensive schema and database hierarchy management. The system also supports data streaming via a unified batch and streaming API, as well as integration with cloud storage and various file formats for data import and export. - [thomasloven/lovelace-fold-entity-row](https://awesome-repositories.com/repository/thomasloven-lovelace-fold-entity-row.md) (706 ⭐) — 🔹 A foldable row for entities card, containing other rows - [ashishpatel26/real-time-ml-project](https://awesome-repositories.com/repository/ashishpatel26-real-time-ml-project.md) (762 ⭐) — A curated list of applied machine learning and data science notebooks and libraries across different industries. - [gofr-dev/gofr](https://awesome-repositories.com/repository/gofr-dev-gofr.md) (21,321 ⭐) — Gofr is a comprehensive framework for building production-ready microservices in Go. It provides a unified toolkit for developing RESTful APIs and gRPC services, offering built-in support for observability, database management, and distributed system communication. The framework distinguishes itself through its focus on developer productivity and system resilience. It automates common backend tasks such as CRUD handler generation, schema-driven code creation, and database migration orchestration, while preventing race conditions in clustered environments. To maintain stability, it includes integrated resilience patterns like circuit breakers, request throttling, and automatic retry logic for network calls. Beyond core service development, the project covers a broad range of infrastructure needs including asynchronous messaging, background task scheduling, and cloud storage connectivity. It simplifies local development by providing orchestration tools to manage containerized dependencies and environment-specific configurations. The framework is designed for observability, featuring built-in support for distributed trace propagation, health monitoring, and performance metrics export. It includes standardized middleware for enforcing security policies and managing request pipelines across both HTTP and gRPC endpoints. - [arroyosystems/arroyo](https://awesome-repositories.com/repository/arroyosystems-arroyo.md) (4,819 ⭐) — Arroyo is a high-performance stream processing platform built in Rust. It executes continuous SQL queries on streaming data with event-time semantics, enabling accurate windowed aggregations, joins, and stateful computations on unbounded event streams. The platform uses native Rust execution for high throughput and low latency, with periodic checkpointing for exactly-once fault tolerance and horizontal scaling across distributed workers. The system integrates deeply with Kafka for reading and writing topics with exactly-once delivery and supports change data capture (CDC) from MySQL and Postgres databases via Debezium. A wide range of source and sink connectors covers systems such as Kinesis, Redis, Delta Lake, Iceberg, MQTT, NATS, and more. SQL pipelines can be defined ad hoc or as derived streams, with support for user-defined functions written in Rust or Python for custom transformation logic. Deployment is managed through a web UI, CLI, and REST API, with options for single-node, multi-node, or Kubernetes clusters using Helm. Event-time processing includes watermarking to handle out-of-order data and supports tumbling, sliding, and session windows. The engine provides comprehensive SQL functions for string manipulation, timestamp arithmetic, JSON and array operations, data type conversion, and mathematical computations. Additional operational features include anomaly detection by counting events over time windows, synthetic data generation for testing, and authentication and TLS encryption for secure access. - [graphiteeditor/graphite](https://awesome-repositories.com/repository/graphiteeditor-graphite.md) (24,258 ⭐) — Graphite is a node-based visual design environment that integrates vector illustration, raster image processing, and motion graphics generation into a single platform. It utilizes a functional reactive pipeline and a data-flow execution model to propagate state changes through a graph of interconnected nodes, allowing users to construct complex, automated design workflows. The platform distinguishes itself through a context-aware evaluation engine that injects runtime metadata—such as coordinate data and loop indices—directly into the node graph. This enables the creation of procedural geometry and dynamic, position-dependent design logic that responds to real-time inputs. By combining these mathematical operations with time-based animation primitives, the system allows for the creation of interactive visual effects and motion graphics that synchronize with system clocks or pointer movement. The software provides a comprehensive suite of tools for both vector and raster manipulation, including layer-based composition, procedural texture generation, and advanced color management. Users can perform non-destructive image adjustments, apply clipping masks, and generate complex patterns through algorithmic definitions. The environment also supports external integration by fetching remote data and serializing graphical properties into standardized formats. - [aws/aws-cdk](https://awesome-repositories.com/repository/aws-aws-cdk.md) (12,817 ⭐) — The AWS Cloud Development Kit is an infrastructure-as-code framework that enables developers to define and provision cloud resources using familiar programming languages. By utilizing construct-based synthesis, it translates high-level, object-oriented code into declarative templates, allowing for the automated management of complex cloud environments through a centralized, code-driven control plane. The framework distinguishes itself through its ability to model infrastructure as a dependency-aware resource graph, ensuring that components are provisioned and updated in the correct order. It employs a language-agnostic intermediate representation to synthesize these definitions into platform-specific configurations, while supporting aspect-oriented policy injection to apply security and compliance rules across infrastructure definitions during the synthesis phase. Beyond core provisioning, the project provides a modular component registry for distributing and reusing pre-configured infrastructure building blocks. It supports multi-account orchestration, allowing for the deployment of consistent resource sets across different regions and accounts from a single template, and includes capabilities for detecting infrastructure drift to ensure deployed environments remain aligned with their defined state. The project is distributed as a software development kit, providing programmatic interfaces to manage the full lifecycle of cloud resources and integrate infrastructure definitions directly into application codebases. - [gausby/level](https://awesome-repositories.com/repository/gausby-level.md) (5 ⭐) — Level for Elixir implements various helper functions and data types for working with Googles Level data store. - [boto/boto3](https://awesome-repositories.com/repository/boto-boto3.md) (9,834 ⭐) — Boto3 is the AWS SDK for Python, providing a programmatic interface for managing and automating AWS cloud infrastructure and services. It serves as a cloud management API client and resource manager for provisioning, configuring, and scaling virtual servers, databases, and storage. The library enables the implementation of infrastructure-as-code through declarative templates and scripts, allowing for the deployment of identical resource stacks across multiple accounts and geographic regions. It also provides a framework for coordinating distributed workflows, serverless functions, and containerized applications within the cloud ecosystem. The toolkit covers a broad range of operational capabilities, including generative AI orchestration, identity and access control, and detailed cloud resource monitoring. It further extends to data lifecycle management, including automated backups and migrations, as well as comprehensive billing and cost optimization tools. - [level/levelup](https://awesome-repositories.com/repository/level-levelup.md) (4,072 ⭐) — Superseded by abstract-level. A wrapper for abstract-leveldown compliant stores, for Node.js and browsers. - [cockroachdb/cockroach](https://awesome-repositories.com/repository/cockroachdb-cockroach.md) (32,207 ⭐) — Cockroach is a distributed SQL database designed to scale horizontally across multiple nodes while maintaining strict ACID compliance and global data consistency. It functions as a relational database engine that automatically partitions data into ranges, rebalancing them across a cluster to accommodate growing storage and throughput requirements. By utilizing a distributed consensus protocol, the system ensures that all nodes agree on the order of operations, providing fault tolerance and continuous availability even in the event of hardware failures. The system distinguishes itself through a layered architecture that separates the relational SQL abstraction from a distributed key-value store. It achieves global consistency without requiring perfectly synchronized hardware clocks by employing a hybrid logical clock synchronization mechanism. To support high-concurrency environments, it utilizes multi-version concurrency control and lock-free transaction execution, which allow for consistent snapshots and efficient conflict resolution. Furthermore, the engine is built for compatibility, implementing the standard wire protocol to support existing relational database drivers and tools. Beyond its core transactional capabilities, the platform includes comprehensive tooling for cluster orchestration, security, and performance diagnostics. It supports a variety of deployment models, ranging from self-hosted on-premises configurations to fully managed cloud services. The system provides a command-line interface for session management and query execution, ensuring that administrators can monitor cluster health and manage workloads through standard relational interfaces. - [ovi3/burp-menu-level](https://awesome-repositories.com/repository/ovi3-burp-menu-level.md) (31 ⭐) — 一个用于修改右键插件菜单层级的Burpsuite插件。A simple BurpSuite extension to change extension context menu level. - [rqlite/rqlite](https://awesome-repositories.com/repository/rqlite-rqlite.md) (17,586 ⭐) — rqlite is a distributed relational database that replicates SQLite data across a cluster using the Raft consensus algorithm. It functions as a fault-tolerant storage system that provides high availability and a web API for executing SQL queries and managing relational data without requiring native database drivers. The system distinguishes itself by using an HTTP SQL interface to expose database operations and cluster management. It features a real-time change data capture stream that pushes database mutations to external HTTP endpoints via webhooks and supports the scaling of read throughput through non-voting read replicas. The project covers a broad range of distributed capabilities, including automated cluster discovery via DNS or Consul, TLS-encrypted transport for inter-node communication, and atomic request execution. It also includes tools for point-in-time snapshot backups, node health monitoring, and cluster leadership transfer. - [electric-sql/electric](https://awesome-repositories.com/repository/electric-sql-electric.md) (9,909 ⭐) — Electric is a Postgres data synchronization engine and replication proxy designed to enable local-first software. It replicates data from Postgres databases to client-side stores in real time using logical replication, allowing applications to maintain a local embedded database for offline access and low-latency updates. The system distinguishes itself by using shapes to filter and authorize specific subsets of database rows and columns before streaming them to clients or edge workers. It further supports multi-user collaboration by integrating a conflict-free replicated data type framework to ensure consistent state synchronization across different users. The project covers a broad range of capabilities, including reactive state management and real-time data streaming to client interfaces and server-side renders. It provides tools for data shaping and transformation, database integration across various cloud and serverless Postgres providers, and security primitives such as token-based authorization and end-to-end encryption. The service can be deployed as a containerized web service on cloud platforms with support for rolling deployment management. - [nationalsecurityagency/timely](https://awesome-repositories.com/repository/nationalsecurityagency-timely.md) (392 ⭐) — Accumulo backed time series database - [dragonflydb/dragonfly](https://awesome-repositories.com/repository/dragonflydb-dragonfly.md) (30,688 ⭐) — Dragonfly is a high-performance, multi-model in-memory data store designed to serve as a drop-in replacement for existing database infrastructures. By utilizing a multi-threaded, shared-nothing architecture and a fiber-based concurrency model, it maximizes CPU utilization and minimizes latency for read and write operations. The system supports a wide range of data structures, including strings, hashes, lists, sets, sorted sets, and JSON documents, while maintaining full compatibility with standard industry wire protocols and client libraries. What distinguishes Dragonfly is its focus on efficiency and scalability through advanced memory management and request processing. It employs a lock-free, cache-friendly hash table structure and zero-copy serialization to reduce overhead during high-throughput operations. For durability, the system utilizes asynchronous, snapshot-based persistence that captures the state of the dataset without blocking active requests. Furthermore, it provides built-in support for horizontal scaling and cluster management, allowing for the distribution of large datasets across multiple nodes to ensure high availability. Beyond core storage, the platform includes a comprehensive suite of operational and analytical capabilities. It features integrated support for geospatial data management, real-time message brokering via publish-subscribe patterns, and full-text search. To handle massive datasets efficiently, the engine incorporates probabilistic data structures for cardinality estimation, frequency tracking, and membership testing. These features are complemented by robust administrative tools, including access control, request rate limiting, and detailed server monitoring. - [pubkey/rxdb](https://awesome-repositories.com/repository/pubkey-rxdb.md) (23,048 ⭐) — This project is a reactive, offline-first NoSQL database engine designed for JavaScript applications. It provides a robust framework for managing application state by synchronizing data across browsers, mobile devices, and server-side runtimes. By treating local storage as the primary source of truth, it enables applications to remain functional without network connectivity, automatically reconciling changes with remote backends once a connection is restored. The database distinguishes itself through a modular architecture that supports cross-environment synchronization and high-performance data management. It features a bidirectional replication protocol that handles conflict resolution and state convergence, alongside a pluggable storage abstraction that allows developers to swap between engines like IndexedDB, SQLite, or in-memory stores without altering application logic. To ensure responsiveness, the system offloads storage operations to background worker threads and coordinates database access across multiple browser tabs through a leader election mechanism. The platform offers a comprehensive suite of capabilities for data integrity, performance, and security. It enforces strict data validation through schema-based definitions and optimizes storage footprints using transparent key compression. Developers can bind database query results directly to user interface components, enabling reactive state management where the UI automatically updates in response to local or remote data changes. The project is built for extensibility, offering a wide range of plugins for encryption, full-text search, and integration with various backend protocols including GraphQL, REST, and peer-to-peer channels. It provides extensive documentation and standardized interfaces to facilitate integration into diverse application architectures. - [javascript-tutorial/en.javascript.info](https://awesome-repositories.com/repository/javascript-tutorial-en-javascript-info.md) (25,344 ⭐) — This project is a comprehensive JavaScript programming tutorial and language reference. It serves as a web development education resource providing instruction on modern language fundamentals, object-oriented design, and advanced asynchronous programming patterns. The resource functions as both a frontend development guide and a technical reference. It covers core language features such as closures, prototypes, promises, and typed arrays, while providing practical lessons on managing browser data and handling network requests. The content spans several key capability areas, including browser API integration, data structure manipulation, and frontend web development. It specifically covers the manipulation of the document object model, the handling of browser events, and the creation of reusable web components. The documentation is delivered as a collection of static-site generated pages created from markdown files. - [real-time-finance/finance-websocket-api](https://awesome-repositories.com/repository/real-time-finance-finance-websocket-api.md) (114 ⭐) — Public websocket API to get datas from financial markets - [eyaltoledano/claude-task-master](https://awesome-repositories.com/repository/eyaltoledano-claude-task-master.md) (27,567 ⭐) — This project is an autonomous, multi-model orchestrator designed to manage the full software development lifecycle through a command-line interface. It functions as an intelligent agent that decomposes high-level product goals into actionable, prioritized subtasks, manages dependency graphs, and executes development cycles. By automating requirement parsing, technical research, and task tracking, it maintains project alignment and momentum throughout the implementation process. The system distinguishes itself through a provider-agnostic abstraction layer that allows users to assign specific artificial intelligence models to primary, research, or fallback roles. It supports both cloud-based services for broad reasoning capabilities and local model execution to ensure data privacy and offline functionality. Furthermore, the platform integrates live web research directly into the task management workflow, enabling agents to generate complexity scores and validate technical decisions against current industry patterns before writing code. Beyond core orchestration, the tool provides a comprehensive framework for managing task metadata, parallel workstreams, and team collaboration. It includes features for real-time task monitoring, automated documentation generation, and integration with development environments through standardized communication protocols and editor extensions. The system is configured via local environment files, which handle secure credential management and allow for the optimization of active tools to balance context window usage. - [benthosdev/benthos](https://awesome-repositories.com/repository/benthosdev-benthos.md) (8,681 ⭐) — Benthos is a stream processing engine and data integration pipeline used for routing, transforming, and connecting data streams between diverse sources and sinks. It functions as event routing middleware and a change data capture tool, streaming real-time database modifications as discrete events for downstream processing. The system utilizes a declarative pipeline configuration, where data flow and processing logic are defined in a single static file. It features a specialized domain-specific language for mapping, filtering, and enriching data payloads, allowing for complex transformations without custom code. The platform provides an observability-driven data plane with integrated telemetry, performance metrics, and message flow tracing. Reliability is managed through a transaction model that ensures at-least-once delivery guarantees to prevent data loss during system crashes. The engine is extensible through a plugin architecture that supports loading external binary modules to add new source and sink connectors. - [d-wasserman/shared-row](https://awesome-repositories.com/repository/d-wasserman-shared-row.md) (0 ⭐) — This is an open data specification for describing the right-of-way (ROW) for street centerline networks. It is intended to establish a common set of attributes (schema) to describe how space is allocated along a streets right of way from sidewalk edge to sidewalk edge. Its goal is to enable a… - [rtos-from-scratch/rtos-from-scratch](https://awesome-repositories.com/repository/rtos-from-scratch-rtos-from-scratch.md) (0 ⭐) — Real time operating system made with love ♥. - [firerpa/lamda](https://awesome-repositories.com/repository/firerpa-lamda.md) (7,834 ⭐) — This project is an Android RPA framework designed for automating user interfaces and system tasks on rooted Android devices using Python and ADB. It provides a suite of tools for rooted device management, allowing for programmatic control of system settings, application lifecycles, and shell command execution via a remote API. The framework distinguishes itself through a combination of dynamic instrumentation and AI integration. It can inject scripts into running processes to hook Java interfaces and modifies application behavior in real time. Additionally, it supports large language model integration through a standardized protocol, enabling the translation of natural language prompts into executable device actions. The system covers a broad range of capabilities, including network traffic analysis via man-in-the-middle proxies, remote administration with real-time screen streaming and touch simulation, and a comprehensive security analysis toolset for binary patching and disassembly. It also provides an emulated Debian runtime environment for native code compilation and a variety of UI automation primitives such as optical character recognition and image-based element location. The framework supports remote connectivity through VPNs, port forwarding, and a WebSocket-based control interface. - [pingcap/tidb](https://awesome-repositories.com/repository/pingcap-tidb.md) (40,166 ⭐) — TiDB is a horizontally scalable, distributed SQL database designed to provide consistent transactional storage and high-performance analytical processing within a single unified architecture. It utilizes a decoupled compute-storage design and a distributed key-value storage layer to ensure horizontal scalability and efficient range-based queries. By employing a consensus-based replication algorithm, the system maintains high availability and automatic failover across multiple nodes and geographical regions. The platform distinguishes itself through its hybrid transactional and analytical processing capabilities, which allow complex SQL queries to run against replicated columnar data without disrupting primary transactional workloads. It also integrates high-dimensional vector search functionality, enabling semantic similarity queries directly alongside traditional relational data. To support diverse operational needs, the system provides native tools for real-time data streaming, seamless migration from external database systems, and multi-region disaster recovery. The database is built for cloud-native environments, offering comprehensive lifecycle management through Kubernetes operators that automate deployment, scaling, and rolling upgrades. It maintains compatibility with standard SQL interfaces, allowing applications to connect using common drivers while managing complex concurrency through pessimistic transaction handling. Detailed documentation and command-line utilities are available to assist with cluster orchestration, performance troubleshooting, and the configuration of production-grade topologies. - [macrozheng/mall](https://awesome-repositories.com/repository/macrozheng-mall.md) (83,878 ⭐) — This project is an enterprise-grade Java framework designed for building scalable, full-stack e-commerce applications. It provides a comprehensive foundation for microservice-based distributed architectures, enabling the development of complex retail platforms that include product management, order processing, and secure user authentication. By leveraging modular service patterns and centralized API gateways, the framework supports the construction of resilient systems that decompose monolithic business logic into independent, manageable services. The platform distinguishes itself through a robust suite of infrastructure and operational tools that facilitate high-scale deployments. It features integrated support for container-orchestrated environments, event-driven message brokering, and centralized security via token-based authentication. To ensure operational visibility, the framework includes a centralized log aggregation pipeline, real-time health monitoring, and distributed system observability, allowing teams to maintain stability across complex service boundaries. Beyond its core architecture, the platform offers extensive developer tooling and data management capabilities. It supports advanced database operations, including read-write splitting, query routing, and data synchronization, alongside integration with distributed search engines and object storage systems. The development environment is further enhanced by utilities for code quality enforcement, automated entity generation, dependency management, and architectural visualization, providing a complete ecosystem for the lifecycle of enterprise-grade web applications. - [encode/databases](https://awesome-repositories.com/repository/encode-databases.md) (4,002 ⭐) — Async database support for Python. 🗄 - [lightpanda-io/browser](https://awesome-repositories.com/repository/lightpanda-io-browser.md) (31,168 ⭐) — This project is a high-performance headless browser engine designed for scalable web automation, data extraction, and AI agent integration. It provides a specialized environment that allows autonomous agents and testing frameworks to interact with web content through standardized remote control protocols. By executing pages in a lightweight, headless state, the engine minimizes resource consumption while maintaining the ability to perform complex navigation and dynamic content rendering. The platform distinguishes itself through deep integration with AI-centric communication layers and advanced traffic management. It converts complex web pages into simplified, machine-readable formats like markdown and accessibility trees, specifically tailored for consumption by language models. Furthermore, it includes built-in capabilities for network traffic interception, proxy management, and cryptographic request signing, allowing users to manage connectivity and verify bot identity at the network layer. The framework supports a broad range of operational requirements, including concurrent session isolation for parallel workflows and snapshot-based startup optimization to reduce initialization latency. It provides administrative tools for monitoring historical automation activity and configuring telemetry, while ensuring compliance through the automatic enforcement of website exclusion directives. The system is designed for deployment across diverse operating systems and containerized environments to ensure consistent performance in production. - [redpanda-data/connect](https://awesome-repositories.com/repository/redpanda-data-connect.md) (8,681 ⭐) — Connect is a Kafka data integration platform and stream processing engine used to build declarative pipelines that move and transform messages between Kafka topics and external sources. It functions as a Kafka Connect framework and a change data capture tool, streaming real-time database modifications to synchronize data across distributed environments. The project differentiates itself through a dedicated mapping language for mutating and reshaping message payloads and the ability to execute custom processing logic within a sandboxed WebAssembly runtime. It also provides an observability pipeline that exports metrics and execution traces using the OpenTelemetry standard. The system covers a broad range of integration capabilities, including cloud data warehousing for services like BigQuery and Iceberg, as well as SQL data management and cloud storage integration. It supports advanced data operations such as Grok text processing, schema registry integration, and broker message routing for distributing data to multiple outputs. Configuration is managed through structured files, with available utilities for configuration schema validation and natural language pipeline generation. - [mail-in-a-box/mailinabox](https://awesome-repositories.com/repository/mail-in-a-box-mailinabox.md) (15,343 ⭐) — Mail-in-a-Box is a self-hosted email server appliance that automates the deployment of SMTP, IMAP, and POP3 services on Linux. It functions as a complete suite including a DNS management server, a spam and abuse filter, and a web-based administrative control panel for managing users, aliases, and storage quotas. The project distinguishes itself through a high degree of automation for email security and authenticity. It automatically provisions and maintains SPF, DKIM, DMARC, and DNSSEC records to prevent domain spoofing, while managing the installation and rotation of TLS certificates and enforcing secure transport policies like DANE and MTA-STS. The system includes integrated tools for server health monitoring, network-level brute-force mitigation, and policy-driven spam filtering using greylisting and IP blacklists. It also provides data management capabilities such as system backups to S3-compatible object storage and the ability to serve static website content over HTTPS. - [leonardomso/33-js-concepts](https://awesome-repositories.com/repository/leonardomso-33-js-concepts.md) (66,467 ⭐) — This project is a comprehensive educational repository designed to help developers master the core mechanics, runtime behaviors, and browser-native capabilities of the JavaScript language. It provides a structured knowledge base that covers fundamental language features, such as prototype-based inheritance and event-loop-based concurrency, alongside advanced topics like JIT-compiled execution and memory management. The repository distinguishes itself by offering deep-dive technical guides that bridge the gap between abstract language concepts and practical browser implementation. It features detailed explorations of complex topics including property-descriptor-based metadata, binary data manipulation via blob abstractions, and transactional client-side storage using IndexedDB. These resources are designed to clarify nuanced behaviors, such as the intricacies of the keyword used for function execution context and the complexities of asynchronous error handling. Beyond core language mechanics, the project provides a robust framework for understanding algorithmic efficiency and functional programming. It includes visual references for Big O complexity, implementation examples for common search and sort algorithms, and tutorials on higher-order array methods. The documentation is organized into modular learning paths, making it a central reference library for developers seeking to improve their technical proficiency in modern web development. - [ariya/phantomjs](https://awesome-repositories.com/repository/ariya-phantomjs.md) (29,489 ⭐) — PhantomJS is a scriptable, headless browser engine based on WebKit that provides a programmatic interface for automating web page interactions. It operates without a graphical user interface, allowing for the execution of JavaScript to navigate pages, manipulate the document object model, and perform functional testing of web applications. The tool distinguishes itself by providing low-level control over the browser rendering lifecycle and network stack. It enables real-time interception and modification of network traffic, alongside the ability to generate visual snapshots and document exports from pages that rely on complex dynamic content. By maintaining a virtual display buffer and running the engine in an isolated memory space, it ensures consistent layout calculations and stability during automated sessions. Beyond its core rendering capabilities, the project supports complex automation workflows through command-line configuration and inter-process communication. These features facilitate the integration of browser-based tasks into larger software systems, enabling automated data extraction, performance analysis, and the verification of web application behavior. - [apache/seatunnel](https://awesome-repositories.com/repository/apache-seatunnel.md) (9,427 ⭐) — SeaTunnel is a distributed data integration engine designed to synchronize structured and unstructured data across diverse sources and sinks. It functions as a multi-engine execution framework that can run data integration tasks across different distributed computing backends to optimize workload performance. The project is distinguished by a visual data pipeline designer for configuring workflows without manual code and a specialized change data capture tool for streaming incremental database updates. It also includes an enrichment pipeline that integrates large language models and embedding models to add semantic vectors to data records. The engine provides broad capabilities for large-scale data integration, including SQL-based transformations, data quality validation, and multimodal synchronization. It manages reliability through fault-tolerant checkpointing, distributed data consistency, and a plugin architecture for custom connector development. Operational oversight is supported by real-time synchronization progress monitoring, metric tracking, and a REST API for programmatic job submission. - [nscala-time/nscala-time](https://awesome-repositories.com/repository/nscala-time-nscala-time.md) (866 ⭐) — A new Scala wrapper for Joda Time based on scala-time - [clj-time/clj-time](https://awesome-repositories.com/repository/clj-time-clj-time.md) (737 ⭐) — A date and time library for Clojure, wrapping the Joda Time library. - [alibaba/otter](https://awesome-repositories.com/repository/alibaba-otter.md) (8,127 ⭐) — Otter is a distributed database synchronization system and change data capture tool designed to replicate data between databases across multiple geographic regions. It functions as a synchronization orchestrator and ETL data pipeline that mirrors records and associated files in real time. The system employs incremental log parsing to capture database changes and utilizes a consistency-based convergence algorithm and loop-avoidance logic to manage bi-directional replication. It processes data through a pipeline of selection, extraction, transformation, and loading to handle joins and format conversions before delivering records to target tables. The platform includes a distributed coordination layer to manage worker node state and schedule large-scale synchronization tasks across remote data centers. Supporting capabilities cover synchronization health monitoring for tracking replication lag and throughput, as well as administrative access control for managing system configurations. - [avelino/awesome-go](https://awesome-repositories.com/repository/avelino-awesome-go.md) (175,576 ⭐) — This project serves as a comprehensive language ecosystem index, functioning as a centralized, community-curated directory for the Go programming language. It organizes a vast landscape of software components, libraries, and development tools into a structured, navigable hierarchy, enabling developers to efficiently discover resources tailored to specific functional domains. The repository distinguishes itself through a decentralized contribution model, where community-driven updates ensure the index remains current with the rapidly evolving software landscape. Beyond simple resource listing, it acts as a technical knowledge repository, aggregating professional literature, style guides, and best practices to support developer onboarding and professional growth across the entire software development lifecycle. The directory covers a broad capability surface, including essential utilities for distributed systems engineering, application security, data processing, and development productivity. It provides access to specialized tools for database management, web framework integration, testing, and build automation, alongside educational materials that help developers master language-specific architectural patterns. The project is maintained as a static resource aggregation, providing a holistic view of external links and documentation to orient developers within the Go ecosystem.