awesome-repositories.com
博客
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目关于排名机制媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

22 个仓库

Awesome GitHub RepositoriesPartitioning Algorithms

Mathematical strategies for distributing data across partitions, such as hash-based or range-based.

Distinguishing note: Focuses on the algorithms used for partitioning, distinct from the general concept of partitioning.

Explore 22 awesome GitHub repositories matching data & databases · Partitioning Algorithms. Refine with filters or upvote what's useful.

Awesome Partitioning Algorithms GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • karanpratapsingh/system-designkaranpratapsingh 的头像

    karanpratapsingh/system-design

    44,051在 GitHub 上查看↗

    This project is a comprehensive educational resource focused on the principles, patterns, and trade-offs required to design scalable, reliable, and high-performance distributed systems. It provides a structured curriculum that covers the fundamental architectural strategies necessary for building modern software infrastructure, ranging from high-level system decomposition to low-level networking and data management. The repository distinguishes itself by offering deep dives into complex architectural patterns, such as microservices-based decomposition, event-driven communication, and command-

    Details strategies like hash-based partitioning for distributing data.

    architecturedistributed-systemsengineering
    在 GitHub 上查看↗44,051
  • kodecocodes/swift-algorithm-clubkodecocodes 的头像

    kodecocodes/swift-algorithm-club

    29,099在 GitHub 上查看↗

    This project is a comprehensive collection of common computer science algorithms and data structures implemented in Swift. It serves as an educational reference and library for studying computational complexity, algorithmic logic, and data structure engineering through practical code examples. The repository provides a wide suite of data structure implementations, including various types of linked lists, heaps, hash tables, and an extensive range of hierarchical trees such as Red-Black, B-Tree, and Splay trees. It also covers diverse sorting and searching techniques, from basic bubble sort to

    Implements efficient array partitioning around pivots to facilitate sorting operations.

    Swiftalgorithmsdata-structuresswift
    在 GitHub 上查看↗29,099
  • oi-wiki/oi-wikiOI-wiki 的头像

    OI-wiki/OI-wiki

    26,176在 GitHub 上查看↗

    This project is a comprehensive, community-maintained knowledge base and toolkit designed for competitive programming. It serves as a centralized repository for algorithmic theory, data structures, and mathematical techniques, providing a structured reference for informatics and collegiate programming competitions. The project distinguishes itself by integrating educational content with a robust suite of automation utilities. It provides a complete workflow for competitive programming, including tools for automated test case generation, solution verification, and direct interaction with onlin

    Organizes elements by recursively partitioning a sequence around a pivot value to ensure sub-sequences are ordered.

    TypeScriptacm-icpcacm-icpc-handbookalgorithms
    在 GitHub 上查看↗26,176
  • timescale/timescaledbtimescale 的头像

    timescale/timescaledb

    21,876在 GitHub 上查看↗

    TimescaleDB is an open-source PostgreSQL extension that adds native time-series capabilities to the database. At its core, it transforms standard PostgreSQL tables into hypertables—automatically partitioned by time intervals—so data is stored in fixed-size chunks without manual sharding. The extension includes a library of over 200 built-in SQL functions purpose-built for time-series workloads, such as time bucketing, gap filling, percentile estimation, and time-weighted averages. What distinguishes TimescaleDB from generic PostgreSQL is its set of integrated time-series features that work th

    Splits large tables into smaller partitions based on time or a key to improve query performance.

    Canalyticsdatabasefinancial-analysis
    在 GitHub 上查看↗21,876
  • samber/losamber 的头像

    samber/lo

    21,333在 GitHub 上查看↗

    This library is a collection of generic utilities for the Go programming language designed to simplify the manipulation of slices and maps. It provides a functional toolkit that enables developers to perform data transformations, such as filtering, mapping, and reducing, while maintaining strict type safety through the use of language-level generics. The project distinguishes itself by offering a dual approach to data processing that balances functional programming patterns with performance-oriented execution. It supports both immutable functional pipelines for predictable state transitions a

    Provides utilities for grouping, chunking, and partitioning complex data collections.

    Goconstraintscontractfilterable
    在 GitHub 上查看↗21,333
  • bulletphysics/bullet3bulletphysics 的头像

    bulletphysics/bullet3

    14,243在 GitHub 上查看↗

    Bullet3 is a professional physics simulation engine designed for calculating rigid body, soft body, and collision dynamics within 3D environments and robotics applications. It functions as a computational framework for determining complex geometric intersections and contact manifolds between objects in simulated space. The library distinguishes itself through a distributed rendering framework that scales heavy graphical workloads and scene generation tasks across large clusters of machines. This capability enables the production of massive datasets by distributing complex scene generation acr

    Groups independent clusters of interacting objects into isolated islands to allow parallel processing of physics updates.

    C++computer-animationgame-developmentkinematics
    在 GitHub 上查看↗14,243
  • dask/daskdask 的头像

    dask/dask

    13,746在 GitHub 上查看↗

    Dask 是一个并行计算框架和分布式任务调度器,旨在将 Python 数据科学工作流从单机扩展到大型集群。它作为一个集群资源管理器,通过将任务及其依赖项表示为有向无环图来编排计算逻辑。这种架构允许系统在管理复杂执行要求的同时,自动将工作负载分配到可用硬件上。 该项目通过一个延迟评估引擎脱颖而出,该引擎将数据操作推迟到明确请求时才执行,从而实现全局图优化和高效的资源分配。它结合了内存感知数据溢出功能,以防止在处理超过可用内存的数据集时系统崩溃,并利用任务图融合将操作序列组合成单个执行步骤,从而最大限度地减少调度开销和节点间通信。 该平台为大规模数据分析提供了全面的功能面,包括对分布式机器学习、高性能计算集成和并行数据处理的支持。它提供了用于集群生命周期管理、性能分析和任务执行实时监控的广泛工具。用户可以在各种基础设施上部署这些环境,包括本地硬件、云提供商、容器化系统和高性能计算集群。

    Adjusts the number of output partitions during grouping operations to balance memory usage and computational efficiency.

    Pythondasknumpypandas
    在 GitHub 上查看↗13,746
  • citusdata/cituscitusdata 的头像

    citusdata/citus

    12,562在 GitHub 上查看↗

    Citus is a PostgreSQL extension that transforms a standard database into a distributed system. It functions as a sharding framework and distributed SQL engine, enabling horizontal scaling by partitioning tables across a cluster of nodes. By utilizing a coordinator-worker topology, the system manages metadata and routes queries to the appropriate nodes, allowing for parallel execution of complex operations across distributed data shards. The platform distinguishes itself through its specialized support for multi-tenant architectures and real-time analytical processing. It enables tenant-based

    Automates the creation and removal of time-based table partitions using scheduled maintenance tasks to ensure continuous data ingestion and efficient retention.

    Ccituscitus-extensiondatabase
    在 GitHub 上查看↗12,562
  • sveinbjornt/slothsveinbjornt 的头像

    sveinbjornt/Sloth

    8,914在 GitHub 上查看↗

    Mac app that shows all open files, directories, sockets, pipes and devices in use by all running processes. Nice GUI for lsof.

    Filters the displayed list by name, access mode, volume, type, location, or regular expression to narrow results.

    Objective-Cdirectoriesdomain-socketsfilter
    在 GitHub 上查看↗8,914
  • dimitri/pgloaderdimitri 的头像

    dimitri/pgloader

    6,295在 GitHub 上查看↗

    pgloader is a command-line tool that automates the migration of data and schema from various source databases and file formats into PostgreSQL. It combines schema discovery, parallel data pipelines, and type casting into a single, declarative workflow, using PostgreSQL's COPY protocol for high-throughput bulk loading. The tool distinguishes itself by compiling a dedicated command language into concurrent reader-writer pipelines that handle schema introspection, data transformation, and error-resilient batch processing. It supports migrating entire databases from MySQL, MS SQL, SQLite, and Pos

    Selectively includes or excludes tables from migration using name lists or regular expressions.

    Common Lispclozure-clcommon-lispcsv
    在 GitHub 上查看↗6,295
  • mirrornetworking/mirrorMirrorNetworking 的头像

    MirrorNetworking/Mirror

    6,218在 GitHub 上查看↗

    Implements spatial hashing and distance-based interest management to reduce network traffic in multiplayer games.

    C#gameshlapikcp
    在 GitHub 上查看↗6,218
  • greptimeteam/greptimedbGreptimeTeam 的头像

    GreptimeTeam/greptimedb

    5,968在 GitHub 上查看↗

    GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without

    Lists tables in a database with optional name filtering for discovery.

    Rustanalyticscloud-nativedatabase
    在 GitHub 上查看↗5,968
  • codeigniter4/codeigniter4codeigniter4 的头像

    codeigniter4/CodeIgniter4

    5,924在 GitHub 上查看↗

    CodeIgniter is a PHP web framework built on the Model-View-Controller pattern, designed for building full-stack web applications. It provides a lightweight toolkit with minimal configuration, organizing application logic into controllers, models, and views for clean separation of concerns. The framework includes a fluent query builder for constructing SQL statements programmatically, PSR-4 autoloading with namespace mapping, and a service-based dependency injection container for managing shared class instances. The framework distinguishes itself through its comprehensive set of built-in tools

    Provides a utility method to enumerate all table names in the currently connected database.

    PHPcodeignitercodeigniter4framework-php
    在 GitHub 上查看↗5,924
  • cortexproject/cortexcortexproject 的头像

    cortexproject/cortex

    5,751在 GitHub 上查看↗

    Cortex is an open-source, horizontally scalable metrics platform that ingests, stores, and queries Prometheus-compatible time-series data with multi-tenant isolation. It accepts metrics via Prometheus remote write and OpenTelemetry, executes PromQL queries against both recent and historical data, and provides a Prometheus-compatible alerting and recording rule engine with an integrated Alertmanager. The system is built as a set of independently scalable microservices that use hash-ring-based sharding, gossip-based cluster membership, and tenant-aware object storage to distribute workloads acro

    Divides timeseries across multiple sub-blocks using a hash of their labels for parallel compaction.

    Gocncfhacktoberfestkubernetes
    在 GitHub 上查看↗5,751
  • airtai/faststreamairtai 的头像

    airtai/faststream

    5,234在 GitHub 上查看↗

    FastStream is an asynchronous Python framework designed for building event-driven microservices. It provides a unified abstraction layer for interacting with various message brokers, enabling developers to manage event production and consumption through a consistent interface while maintaining access to native provider-specific features. The framework centers on a decorator-based routing model that binds application logic directly to broker topics, supported by a built-in dependency injection container that resolves resources at runtime. The framework distinguishes itself through its deep int

    Supports routing messages by partition keys to ensure data grouping and processing order.

    Python
    在 GitHub 上查看↗5,234
  • walkccc/clrswalkccc 的头像

    walkccc/CLRS

    5,060在 GitHub 上查看↗

    This repository is a comprehensive collection of fully worked solutions to exercises and problems from the standard algorithms textbook by Cormen, Leiserson, Rivest, and Stein (CLRS). It serves as an educational reference for algorithm design and analysis, providing step-by-step reasoning, pseudocode, and mathematical proofs for a wide range of topics. The content spans core computer science areas: algorithm analysis with asymptotic notation, recurrence solving, and amortized cost analysis; data structure implementation and operations for binary search trees, red-black trees, B-trees, Fibonac

    Illustrates the quicksort partition subroutine including pivot selection and array rearrangement.

    Markdownclrsintroduction-to-algorithmssolutions
    在 GitHub 上查看↗5,060
  • jitsucom/jitsujitsucom 的头像

    jitsucom/jitsu

    4,782在 GitHub 上查看↗

    Jitsu 是一个客户数据平台,旨在收集、转换并将应用程序事件路由到数据仓库和营销工具。它作为一个事件摄取引擎和数据仓库路由器,通过 API 和 SDK 捕获行为数据以进行实时处理和存储。 该平台具有可编程的 JavaScript 数据流水线,允许在传输过程中对事件数据进行过滤、丰富和重塑。它包含一个客户身份拼接器,可合并匿名和已知的用户标识符,以在仓库中维护持久的客户画像。 系统涵盖了广泛的功能,包括来自 Web 和移动环境的多源事件收集、目标仓库的自动模式演进,以及到 SaaS 平台和 SQL 数据库的多目标路由。它为开发人员提供了一套用于测试转换逻辑的工具,并支持通过 Kubernetes 或自托管 Docker 环境进行部署。

    Organizes records into time-based segments using a timestamp column to speed up analytical queries and reduce data scanned during lookups.

    TypeScriptbigqueryclickhousedata-collection
    在 GitHub 上查看↗4,782
  • gam-team/gamGAM-team 的头像

    GAM-team/GAM

    4,206在 GitHub 上查看↗

    GAM is a command-line tool for administering Google Workspace and Cloud Identity. It translates command-line arguments into structured API calls, enabling administrators to manage users, groups, organizational units, and domain settings across a Google Workspace environment. The tool handles authentication through OAuth2 flows, service accounts, and workload identity federation, and supports multi-tenant configurations for managing multiple domains or cloud projects from a single installation. GAM distinguishes itself through its batch processing and automation capabilities. It can process la

    Filters users, groups, files, or messages using regular expressions based on name or email.

    Pythongamgooglegoogle-admin-sdk
    在 GitHub 上查看↗4,206
  • chanda-abdul/several-coding-patterns-for-solving-data-structures-and-algorithms-problems-during-interviewsChanda-Abdul 的头像

    Chanda-Abdul/Several-Coding-Patterns-for-Solving-Data-Structures-and-Algorithms-Problems-during-Interviews

    4,129在 GitHub 上查看↗

    This repository is a curated guide and implementation library of coding patterns used to solve data structures and algorithms problems. It serves as a technical interview study resource, providing a comprehensive set of strategies and computational logic examples for optimizing time and space complexity. The project focuses on standardized algorithmic patterns, including sliding windows, two pointers, and dynamic programming. It features specific implementations for a wide range of challenges, such as LeetCode problem solutions and specialized techniques like cyclic sort and bitwise XOR opera

    Implements array partitioning that organizes three distinct values into separate zones in a single pass.

    algorithmscoding-interviewsdata-structures
    在 GitHub 上查看↗4,129
  • pingfangushi/screwpingfangushi 的头像

    pingfangushi/screw

    3,966在 GitHub 上查看↗

    Screw 是一个数据库模式分析工具,用于自动生成技术文档和 Java 数据对象。它扫描数据库表以导出其定义,将模式元数据转换为结构化报告和应用程序代码。 该项目根据现有的数据库表结构生成普通 Java 对象 (POJO) 以实现数据建模自动化。它还生成 HTML、Word 和 Markdown 格式的数据库模式文档。 该系统包括使用名称模式进行表导出过滤、基于 JDBC 的模式提取,以及将数据库列类型映射到 Java 语言类型的模板化代码生成功能。

    Provides the ability to include or exclude specific database tables from the export process using name patterns.

    Java
    在 GitHub 上查看↗3,966
上一个12下一个
  1. Home
  2. Data & Databases
  3. Partitioning Algorithms

探索子标签

  • Aggregation Partitioning ControlsSettings for adjusting output partitions during grouping operations to balance memory and efficiency. **Distinct from Partitioning Algorithms:** Distinct from Partitioning Algorithms: focuses on user-controlled partition sizing for aggregations rather than the underlying distribution logic.
  • Efficient Array Partitioning1 个子标签Algorithms for partitioning sequences around pivots to facilitate sorting. **Distinct from Partitioning Algorithms:** Distinct from general partitioning: focuses on array partitioning for sorting algorithms.
  • Hybrid PartitioningStrategies for combining row-based and columnar storage formats within a single partitioned table structure. **Distinct from Partitioning Algorithms:** Distinct from Partitioning Algorithms: focuses on the storage format composition within partitions rather than the distribution logic.
  • Simulation Island PartitionersAlgorithms for grouping interacting objects into isolated islands for parallel processing. **Distinct from Partitioning Algorithms:** Distinct from general partitioning algorithms: focuses on physics-based island grouping for parallel simulation.
  • Time-Based Partition Automation2 个子标签Automated creation and removal of time-based table partitions using scheduled maintenance tasks. **Distinct from Partitioning Algorithms:** Distinct from Partitioning Algorithms: focuses on the lifecycle management of time-based partitions rather than the distribution algorithm.