awesome-repositories.com
Blog
awesome-repositories.com

Découvrez les meilleurs dépôts open-source grâce à notre recherche par IA.

ExplorerRecherches sélectionnéesAlternatives open sourceLogiciels auto-hébergésBlogPlan du site
ProjetÀ proposNotre méthodologiePresseServeur MCP
Mentions légalesConfidentialitéConditions d'utilisation
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

22 dépôts

Awesome GitHub RepositoriesPartitioning Algorithms

Mathematical strategies for distributing data across partitions, such as hash-based or range-based.

Distinguishing note: Focuses on the algorithms used for partitioning, distinct from the general concept of partitioning.

Explore 22 awesome GitHub repositories matching data & databases · Partitioning Algorithms. Refine with filters or upvote what's useful.

Awesome Partitioning Algorithms GitHub Repositories

Trouvez les meilleurs dépôts grâce à l'IA.Nous recherchons les dépôts les plus pertinents grâce à l'IA.
  • karanpratapsingh/system-designAvatar de karanpratapsingh

    karanpratapsingh/system-design

    44,051Voir sur GitHub↗

    This project is a comprehensive educational resource focused on the principles, patterns, and trade-offs required to design scalable, reliable, and high-performance distributed systems. It provides a structured curriculum that covers the fundamental architectural strategies necessary for building modern software infrastructure, ranging from high-level system decomposition to low-level networking and data management. The repository distinguishes itself by offering deep dives into complex architectural patterns, such as microservices-based decomposition, event-driven communication, and command-

    Details strategies like hash-based partitioning for distributing data.

    architecturedistributed-systemsengineering
    Voir sur GitHub↗44,051
  • kodecocodes/swift-algorithm-clubAvatar de kodecocodes

    kodecocodes/swift-algorithm-club

    29,099Voir sur GitHub↗

    This project is a comprehensive collection of common computer science algorithms and data structures implemented in Swift. It serves as an educational reference and library for studying computational complexity, algorithmic logic, and data structure engineering through practical code examples. The repository provides a wide suite of data structure implementations, including various types of linked lists, heaps, hash tables, and an extensive range of hierarchical trees such as Red-Black, B-Tree, and Splay trees. It also covers diverse sorting and searching techniques, from basic bubble sort to

    Implements efficient array partitioning around pivots to facilitate sorting operations.

    Swiftalgorithmsdata-structuresswift
    Voir sur GitHub↗29,099
  • oi-wiki/oi-wikiAvatar de OI-wiki

    OI-wiki/OI-wiki

    26,176Voir sur GitHub↗

    This project is a comprehensive, community-maintained knowledge base and toolkit designed for competitive programming. It serves as a centralized repository for algorithmic theory, data structures, and mathematical techniques, providing a structured reference for informatics and collegiate programming competitions. The project distinguishes itself by integrating educational content with a robust suite of automation utilities. It provides a complete workflow for competitive programming, including tools for automated test case generation, solution verification, and direct interaction with onlin

    Organizes elements by recursively partitioning a sequence around a pivot value to ensure sub-sequences are ordered.

    TypeScriptacm-icpcacm-icpc-handbookalgorithms
    Voir sur GitHub↗26,176
  • timescale/timescaledbAvatar de timescale

    timescale/timescaledb

    21,876Voir sur GitHub↗

    TimescaleDB is an open-source PostgreSQL extension that adds native time-series capabilities to the database. At its core, it transforms standard PostgreSQL tables into hypertables—automatically partitioned by time intervals—so data is stored in fixed-size chunks without manual sharding. The extension includes a library of over 200 built-in SQL functions purpose-built for time-series workloads, such as time bucketing, gap filling, percentile estimation, and time-weighted averages. What distinguishes TimescaleDB from generic PostgreSQL is its set of integrated time-series features that work th

    Splits large tables into smaller partitions based on time or a key to improve query performance.

    Canalyticsdatabasefinancial-analysis
    Voir sur GitHub↗21,876
  • samber/loAvatar de samber

    samber/lo

    21,333Voir sur GitHub↗

    This library is a collection of generic utilities for the Go programming language designed to simplify the manipulation of slices and maps. It provides a functional toolkit that enables developers to perform data transformations, such as filtering, mapping, and reducing, while maintaining strict type safety through the use of language-level generics. The project distinguishes itself by offering a dual approach to data processing that balances functional programming patterns with performance-oriented execution. It supports both immutable functional pipelines for predictable state transitions a

    Provides utilities for grouping, chunking, and partitioning complex data collections.

    Goconstraintscontractfilterable
    Voir sur GitHub↗21,333
  • bulletphysics/bullet3Avatar de bulletphysics

    bulletphysics/bullet3

    14,243Voir sur GitHub↗

    Bullet3 is a professional physics simulation engine designed for calculating rigid body, soft body, and collision dynamics within 3D environments and robotics applications. It functions as a computational framework for determining complex geometric intersections and contact manifolds between objects in simulated space. The library distinguishes itself through a distributed rendering framework that scales heavy graphical workloads and scene generation tasks across large clusters of machines. This capability enables the production of massive datasets by distributing complex scene generation acr

    Groups independent clusters of interacting objects into isolated islands to allow parallel processing of physics updates.

    C++computer-animationgame-developmentkinematics
    Voir sur GitHub↗14,243
  • dask/daskAvatar de dask

    dask/dask

    13,746Voir sur GitHub↗

    Dask est un framework de calcul parallèle et un planificateur de tâches distribué conçu pour mettre à l'échelle les flux de travail de science des données Python, des machines uniques aux grands clusters. Il fonctionne comme un gestionnaire de ressources de cluster qui orchestre la logique computationnelle en représentant les tâches et leurs dépendances sous forme de graphes acycliques dirigés. Cette architecture permet au système d'automatiser la distribution des charges de travail sur le matériel disponible tout en gérant des exigences d'exécution complexes. Le projet se distingue par un moteur d'évaluation paresseuse qui diffère les opérations sur les données jusqu'à ce qu'elles soient explicitement demandées, permettant une optimisation globale du graphe et une allocation efficace des ressources. Il intègre le déversement de données conscient de la mémoire pour éviter les plantages du système lors du traitement de jeux de données dépassant la mémoire disponible, et il utilise la fusion de graphes de tâches pour combiner des séquences d'opérations en étapes d'exécution uniques, minimisant la surcharge de planification et la communication entre nœuds. La plateforme fournit une surface de capacités complète pour l'analyse de données à grande échelle, incluant le support pour l'apprentissage automatique distribué, l'intégration du calcul haute performance et le traitement de données parallèle. Elle offre des outils étendus pour la gestion du cycle de vie des clusters, le profilage des performances et la surveillance en temps réel de l'exécution des tâches. Les utilisateurs peuvent déployer ces environnements sur diverses infrastructures, incluant le matériel local, les fournisseurs cloud, les systèmes conteneurisés et les clusters de calcul haute performance.

    Adjusts the number of output partitions during grouping operations to balance memory usage and computational efficiency.

    Pythondasknumpypandas
    Voir sur GitHub↗13,746
  • citusdata/citusAvatar de citusdata

    citusdata/citus

    12,562Voir sur GitHub↗

    Citus is a PostgreSQL extension that transforms a standard database into a distributed system. It functions as a sharding framework and distributed SQL engine, enabling horizontal scaling by partitioning tables across a cluster of nodes. By utilizing a coordinator-worker topology, the system manages metadata and routes queries to the appropriate nodes, allowing for parallel execution of complex operations across distributed data shards. The platform distinguishes itself through its specialized support for multi-tenant architectures and real-time analytical processing. It enables tenant-based

    Automates the creation and removal of time-based table partitions using scheduled maintenance tasks to ensure continuous data ingestion and efficient retention.

    Ccituscitus-extensiondatabase
    Voir sur GitHub↗12,562
  • sveinbjornt/slothAvatar de sveinbjornt

    sveinbjornt/Sloth

    8,914Voir sur GitHub↗

    Mac app that shows all open files, directories, sockets, pipes and devices in use by all running processes. Nice GUI for lsof.

    Filters the displayed list by name, access mode, volume, type, location, or regular expression to narrow results.

    Objective-Cdirectoriesdomain-socketsfilter
    Voir sur GitHub↗8,914
  • dimitri/pgloaderAvatar de dimitri

    dimitri/pgloader

    6,295Voir sur GitHub↗

    pgloader is a command-line tool that automates the migration of data and schema from various source databases and file formats into PostgreSQL. It combines schema discovery, parallel data pipelines, and type casting into a single, declarative workflow, using PostgreSQL's COPY protocol for high-throughput bulk loading. The tool distinguishes itself by compiling a dedicated command language into concurrent reader-writer pipelines that handle schema introspection, data transformation, and error-resilient batch processing. It supports migrating entire databases from MySQL, MS SQL, SQLite, and Pos

    Selectively includes or excludes tables from migration using name lists or regular expressions.

    Common Lispclozure-clcommon-lispcsv
    Voir sur GitHub↗6,295
  • mirrornetworking/mirrorAvatar de MirrorNetworking

    MirrorNetworking/Mirror

    6,218Voir sur GitHub↗

    Implements spatial hashing and distance-based interest management to reduce network traffic in multiplayer games.

    C#gameshlapikcp
    Voir sur GitHub↗6,218
  • greptimeteam/greptimedbAvatar de GreptimeTeam

    GreptimeTeam/greptimedb

    5,968Voir sur GitHub↗

    GreptimeDB is a distributed, open-source time-series database built for unified observability. It stores and queries metrics, logs, and traces together in a single columnar engine, supporting both SQL and PromQL for analysis. The database is designed as a Kubernetes-native operator with a decoupled compute and storage architecture, enabling horizontal scaling and multi-region deployment. What distinguishes GreptimeDB is its role as a multi-protocol ingestion gateway, accepting data through OpenTelemetry, Prometheus Remote Write, InfluxDB, Loki, Elasticsearch, Kafka, and MQTT protocols without

    Lists tables in a database with optional name filtering for discovery.

    Rustanalyticscloud-nativedatabase
    Voir sur GitHub↗5,968
  • codeigniter4/codeigniter4Avatar de codeigniter4

    codeigniter4/CodeIgniter4

    5,924Voir sur GitHub↗

    CodeIgniter is a PHP web framework built on the Model-View-Controller pattern, designed for building full-stack web applications. It provides a lightweight toolkit with minimal configuration, organizing application logic into controllers, models, and views for clean separation of concerns. The framework includes a fluent query builder for constructing SQL statements programmatically, PSR-4 autoloading with namespace mapping, and a service-based dependency injection container for managing shared class instances. The framework distinguishes itself through its comprehensive set of built-in tools

    Provides a utility method to enumerate all table names in the currently connected database.

    PHPcodeignitercodeigniter4framework-php
    Voir sur GitHub↗5,924
  • cortexproject/cortexAvatar de cortexproject

    cortexproject/cortex

    5,751Voir sur GitHub↗

    Cortex is an open-source, horizontally scalable metrics platform that ingests, stores, and queries Prometheus-compatible time-series data with multi-tenant isolation. It accepts metrics via Prometheus remote write and OpenTelemetry, executes PromQL queries against both recent and historical data, and provides a Prometheus-compatible alerting and recording rule engine with an integrated Alertmanager. The system is built as a set of independently scalable microservices that use hash-ring-based sharding, gossip-based cluster membership, and tenant-aware object storage to distribute workloads acro

    Divides timeseries across multiple sub-blocks using a hash of their labels for parallel compaction.

    Gocncfhacktoberfestkubernetes
    Voir sur GitHub↗5,751
  • airtai/faststreamAvatar de airtai

    airtai/faststream

    5,234Voir sur GitHub↗

    FastStream is an asynchronous Python framework designed for building event-driven microservices. It provides a unified abstraction layer for interacting with various message brokers, enabling developers to manage event production and consumption through a consistent interface while maintaining access to native provider-specific features. The framework centers on a decorator-based routing model that binds application logic directly to broker topics, supported by a built-in dependency injection container that resolves resources at runtime. The framework distinguishes itself through its deep int

    Supports routing messages by partition keys to ensure data grouping and processing order.

    Python
    Voir sur GitHub↗5,234
  • walkccc/clrsAvatar de walkccc

    walkccc/CLRS

    5,060Voir sur GitHub↗

    This repository is a comprehensive collection of fully worked solutions to exercises and problems from the standard algorithms textbook by Cormen, Leiserson, Rivest, and Stein (CLRS). It serves as an educational reference for algorithm design and analysis, providing step-by-step reasoning, pseudocode, and mathematical proofs for a wide range of topics. The content spans core computer science areas: algorithm analysis with asymptotic notation, recurrence solving, and amortized cost analysis; data structure implementation and operations for binary search trees, red-black trees, B-trees, Fibonac

    Illustrates the quicksort partition subroutine including pivot selection and array rearrangement.

    Markdownclrsintroduction-to-algorithmssolutions
    Voir sur GitHub↗5,060
  • jitsucom/jitsuAvatar de jitsucom

    jitsucom/jitsu

    4,782Voir sur GitHub↗

    Jitsu est une plateforme de données client conçue pour collecter, transformer et router les événements d'application vers des entrepôts de données et des outils marketing. Il fonctionne comme un moteur d'ingestion d'événements et un routeur d'entrepôt de données, capturant les données comportementales via des API et des SDK pour un traitement et un stockage en temps réel. La plateforme dispose d'un pipeline de données JavaScript programmable qui permet le filtrage, l'enrichissement et le remodelage des données d'événement pendant le transit. Elle inclut un outil de réconciliation d'identité client qui fusionne les identifiants d'utilisateurs anonymes et connus pour maintenir des profils clients persistants au sein d'un entrepôt. Le système couvre un large éventail de fonctionnalités, incluant la collecte d'événements multi-sources depuis des environnements web et mobiles, l'évolution automatique des schémas pour les entrepôts de destination et le routage multi-destination vers des plateformes SaaS et des bases de données SQL. Il fournit une suite d'outils développeur pour tester la logique de transformation et prend en charge le déploiement via Kubernetes ou des environnements Docker auto-hébergés.

    Organizes records into time-based segments using a timestamp column to speed up analytical queries and reduce data scanned during lookups.

    TypeScriptbigqueryclickhousedata-collection
    Voir sur GitHub↗4,782
  • gam-team/gamAvatar de GAM-team

    GAM-team/GAM

    4,206Voir sur GitHub↗

    GAM is a command-line tool for administering Google Workspace and Cloud Identity. It translates command-line arguments into structured API calls, enabling administrators to manage users, groups, organizational units, and domain settings across a Google Workspace environment. The tool handles authentication through OAuth2 flows, service accounts, and workload identity federation, and supports multi-tenant configurations for managing multiple domains or cloud projects from a single installation. GAM distinguishes itself through its batch processing and automation capabilities. It can process la

    Filters users, groups, files, or messages using regular expressions based on name or email.

    Pythongamgooglegoogle-admin-sdk
    Voir sur GitHub↗4,206
  • chanda-abdul/several-coding-patterns-for-solving-data-structures-and-algorithms-problems-during-interviewsAvatar de Chanda-Abdul

    Chanda-Abdul/Several-Coding-Patterns-for-Solving-Data-Structures-and-Algorithms-Problems-during-Interviews

    4,129Voir sur GitHub↗

    This repository is a curated guide and implementation library of coding patterns used to solve data structures and algorithms problems. It serves as a technical interview study resource, providing a comprehensive set of strategies and computational logic examples for optimizing time and space complexity. The project focuses on standardized algorithmic patterns, including sliding windows, two pointers, and dynamic programming. It features specific implementations for a wide range of challenges, such as LeetCode problem solutions and specialized techniques like cyclic sort and bitwise XOR opera

    Implements array partitioning that organizes three distinct values into separate zones in a single pass.

    algorithmscoding-interviewsdata-structures
    Voir sur GitHub↗4,129
  • pingfangushi/screwAvatar de pingfangushi

    pingfangushi/screw

    3,966Voir sur GitHub↗

    Screw est un outil d'analyse de schéma de base de données utilisé pour produire automatiquement de la documentation technique et des objets de données Java. Il scanne les tables de base de données pour exporter leurs définitions, transformant les métadonnées de schéma en rapports structurés et en code applicatif. Le projet génère des objets Java simples (POJO) basés sur les structures de tables existantes pour automatiser la modélisation des données. Il produit également une documentation de schéma de base de données aux formats HTML, Word et Markdown. Le système inclut des fonctionnalités d'exportation de tables avec filtrage par nom, l'extraction de schéma via JDBC, et la génération de code basée sur des templates pour mapper les types de colonnes de base de données aux types du langage Java.

    Provides the ability to include or exclude specific database tables from the export process using name patterns.

    Java
    Voir sur GitHub↗3,966
Préc.12Suivant
  1. Home
  2. Data & Databases
  3. Partitioning Algorithms

Explorer les sous-tags

  • Aggregation Partitioning ControlsSettings for adjusting output partitions during grouping operations to balance memory and efficiency. **Distinct from Partitioning Algorithms:** Distinct from Partitioning Algorithms: focuses on user-controlled partition sizing for aggregations rather than the underlying distribution logic.
  • Efficient Array Partitioning1 sous-tagAlgorithms for partitioning sequences around pivots to facilitate sorting. **Distinct from Partitioning Algorithms:** Distinct from general partitioning: focuses on array partitioning for sorting algorithms.
  • Hybrid PartitioningStrategies for combining row-based and columnar storage formats within a single partitioned table structure. **Distinct from Partitioning Algorithms:** Distinct from Partitioning Algorithms: focuses on the storage format composition within partitions rather than the distribution logic.
  • Simulation Island PartitionersAlgorithms for grouping interacting objects into isolated islands for parallel processing. **Distinct from Partitioning Algorithms:** Distinct from general partitioning algorithms: focuses on physics-based island grouping for parallel simulation.
  • Time-Based Partition Automation2 sous-tagsAutomated creation and removal of time-based table partitions using scheduled maintenance tasks. **Distinct from Partitioning Algorithms:** Distinct from Partitioning Algorithms: focuses on the lifecycle management of time-based partitions rather than the distribution algorithm.