19 Repos
Configures hardware and memory requirements for data processing tasks.
Distinguishing note: Focuses on resource sizing, distinct from environment or cluster management.
Explore 19 awesome GitHub repositories matching data & databases · Resource Allocation. Refine with filters or upvote what's useful.
Polars is a high-performance columnar data processing library designed for efficient analytical workflows. It functions as a structured data library that organizes information into typed columns, utilizing the Apache Arrow memory format to enable zero-copy data sharing and cache-friendly, vectorized operations. The engine is built to handle large-scale tabular datasets, providing both local and distributed analytical runtimes that scale from single-machine environments to multi-node clusters. The project distinguishes itself through a sophisticated lazy query engine that constructs abstract e
Sets hardware requirements for remote query execution by specifying CPU and memory needs.
This project is a machine learning array framework and tensor computation library designed for high-performance numerical computing. It provides a comprehensive suite of tools for constructing and training neural networks, featuring an automatic differentiation engine that facilitates gradient-based optimization and complex mathematical modeling. The library distinguishes itself through a unified memory architecture that allows data to be shared across CPU and GPU devices without explicit copies, significantly reducing data movement overhead. Its execution model relies on a lazy evaluation en
Directs array operations and memory allocation to specific hardware accelerators for consistent execution.
This project is a collection of educational resources and reference implementations for the Apache Flink stream processing framework. It provides a learning resource focused on mastering distributed stream processing through implementation guides, performance tuning tutorials, and practical examples. The repository features detailed walkthroughs for building real-time data pipelines using the DataStream and Table APIs. It includes specific integration examples for connecting Apache Flink with Kafka brokers and Elasticsearch indices, as well as reference implementations for real-time deduplica
Configures hardware and memory requirements, including task slots, to distribute workloads across compute nodes.
STF is a web-based Android device management platform used to organize and control fleets of Android hardware. It functions as a device farm orchestrator and inventory manager, providing a centralized system for monitoring battery health, hardware specifications, and system versions across multiple devices. The platform distinguishes itself through a web-based screen streamer that allows for real-time interaction and application installation via a browser. It includes a remote ADB controller for executing shell commands and establishing port tunnels, as well as a booking system for time-limit
Provides a booking system to track and lock device availability, preventing simultaneous multi-user access.
PlantUML is a text-to-diagram generator that translates human-readable markup into structured graphical representations. It functions as a diagram-as-code tool, allowing users to create and maintain technical documentation, architectural models, and flowcharts by decoupling diagram content from visual layout. The project distinguishes itself through a comprehensive rendering pipeline that processes domain-specific markup into various output formats, including vector and raster graphics. It utilizes a graph-based layout engine to calculate spatial positioning, while a declarative styling layer
Task resource allocation allows users to assign tasks to specific resources with capacity percentages and manage resource availability or time-off periods.
RisingWave is a cloud-native streaming database and real-time analytics engine that uses standard SQL to process continuous data streams. It functions as a streaming data lakehouse, combining the capabilities of a streaming SQL database with a platform that integrates streaming ingestion with open table formats. The system is distinguished by its use of the PostgreSQL wire protocol, allowing it to integrate with existing SQL tools and drivers. It employs a decoupled compute and storage architecture, persisting streaming state and materialized views in cloud object storage to enable independen
Assigns dedicated nodes for ingestion or batch execution to prevent resource competition in production.
UFO is a multi-device task orchestrator and LLM agent orchestration framework designed to decompose natural language requests into executable task graphs. It functions as a cross-platform UI automation tool capable of performing interactions on Windows and mobile devices while routing tasks to distributed agents based on their hardware and software capabilities. The system is distinguished by its RAG-enhanced agent architecture, which integrates external documentation and previous execution traces to improve decision-making. It employs a hybrid UI detection approach that combines computer vis
Assigns tasks to the most suitable device based on platform capabilities, resource monitoring, and performance history.
Apache Beam is a distributed data pipeline framework and unified data processing model designed to handle both bounded batch data and unbounded real-time streams. It provides a system for building scalable, data-parallel workflows that operate across compute clusters using a single programming model. The framework utilizes a cross-runner pipeline abstraction that decouples the data processing logic from the underlying execution backend, allowing the same pipeline to run on different distributed compute engines. It supports multi-language pipeline development by translating high-level code fro
Allows specifying hardware or runtime requirements for pipeline stages to optimize execution performance and resource allocation.
Flyte is a Kubernetes-based machine learning orchestrator and containerized pipeline manager designed for coordinating AI workflows and data pipelines. It functions as an engine for defining and executing resilient pipelines, utilizing a data lineage tracker to maintain immutable execution states and ensure reproducible outputs. The platform distinguishes itself by packaging individual tasks into separate containers to ensure dependency isolation and environment consistency. It provides specialized capabilities for machine learning, including the transformation of trained models into scalable
Dynamically assigns CPU and GPU resources at the task level, including support for spot and preemptible instances.
Flyte is a distributed machine learning pipeline manager and MLOps workflow engine. It functions as a Kubernetes-native orchestrator used to coordinate data, models, and compute resources for executing machine learning pipelines and autonomous agents at scale. The platform provides specialized infrastructure for the full machine learning lifecycle, including a dedicated model serving platform to deploy trained models as scalable production-ready inference services. It also enables the coordination and state management of autonomous AI agents. The system manages scalable pipeline execution th
Adjusts CPU and memory limits for individual tasks based on specific workload requirements.
Tailwind CSS Typography is a plugin for the Tailwind CSS framework that provides hand-tuned typographic defaults for blocks of vanilla HTML content, such as content from Markdown or a CMS. It applies beautiful prose styles to HTML content using a single class, eliminating the need for custom CSS to style rich text. The plugin distinguishes itself by offering deep customization and control over typography. Users can adjust the overall font size of prose content across five predefined sizes, select from five built-in gray-scale palettes to match a project's color scheme, and seamlessly adapt ty
Applies styles based on device capabilities like pointer type and orientation using variants.
Warp is a Python framework that JIT-compiles Python functions into CUDA kernels for GPU-accelerated parallel computation, with built-in automatic differentiation and multi-framework array interoperability. At its core, it provides a GPU kernel compilation system that enables writing and executing custom GPU kernels directly from Python, while supporting automatic gradient computation through those kernels for integration with machine learning pipelines. The framework also includes tile-based cooperative computing, where thread blocks partition into tiles for shared-memory and tensor-core opera
Switches the default compute device for allocations and kernel launches within a code block.
Countly is a self-hosted product analytics and engagement platform that tracks user behavior across mobile, web, and desktop applications. It collects and analyzes device properties, user actions, and session lifecycle data to understand engagement patterns, while also providing crash reporting, push notification delivery, and A/B testing capabilities. The platform is designed for privacy-first deployment, with built-in consent management and the ability to run entirely on private infrastructure. The platform distinguishes itself through its comprehensive feature set that combines analytics w
Allows overriding device properties like OS version in analytics data.
Koloda ist eine iOS-Gesteninteraktionsbibliothek und SwiftUI-View-Komponente, die zum Erstellen von Swipeable-Card-Interfaces verwendet wird. Sie bietet eine stapelbasierte View-Komponente, die überlappende Views verwaltet und sicherstellt, dass nur das oberste Element aktiv interaktiv bleibt. Die Bibliothek ermöglicht die Anpassung des Erscheinungsbildes der Karten, einschließlich der Konfiguration von Overlays und Animationen, die bestimmen, wie sich Hintergrundkarten während eines Swipes bewegen. Sie verwaltet das Drag-Verhalten und die Swipe-Richtungen und löst spezifische Logik aus, wenn Karten gewischt, angetippt oder vollständig aufgebraucht werden. Die Komponente deckt die Implementierung gestengesteuerter View-Transformationen und das Rendern von Kartenstapeln ab, die Benutzer durch ein gängiges Auswahl-Interaktionsmuster verwerfen.
Tracks availability and project assignments via a calendar to staff projects and plan capacity.
Apache Mesos ist ein Kernel für verteilte Systeme und ein Cluster-Ressourcenmanager, der CPU, Arbeitsspeicher und Speicher über einen Pool von Knoten hinweg abstrahiert. Es fungiert als Orchestrator für verteilte Infrastruktur und bietet eine Schicht, um mehrere Orchestrierungs-Frameworks auf einer gemeinsamen Menge physischer oder virtueller Maschinen auszuführen. Das System agiert als Ressourcen-Isolations-Engine, die einen gemeinsamen Cluster in isolierte Container unterteilt, um diverse Workloads gleichzeitig auszuführen. Es ermöglicht Multi-Framework-Orchestrierung, wodurch verschiedene Frameworks für verteilte Anwendungen eine einzige Infrastruktur teilen können, um die Hardwareauslastung zu maximieren. Das Projekt deckt die Verteilung von Rechenleistung im großen Maßstab und das Management verteilter Cluster ab. Die Funktionen umfassen die Verwaltung verteilter Ressourcen und die Isolierung von Rechenleistung über mehrere Anwendungen hinweg, um Interferenzen zu verhindern und eine stabile Leistung auf gemeinsam genutzten Servern sicherzustellen.
Distributes cluster resources by offering available CPU and memory to frameworks for acceptance or rejection.
Side-Menu.Android ist eine wiederverwendbare UI-Komponente für Android-Anwendungen, die eine ausziehbare Navigationsleiste (Slide-out Navigation Drawer) bereitstellt. Sie wurde entwickelt, um Entwicklern dabei zu helfen, Anwendungsbereiche und Benutzeroptionen in einem strukturierten, verborgenen Panel zu organisieren, das eine saubere Schnittstelle für den primären Inhaltsbereich beibehält. Die Komponente zeichnet sich durch ihre visuelle Präsentation aus, die den Material Design-Richtlinien folgt, um eine konsistente und intuitive Benutzererfahrung zu gewährleisten. Sie verfügt über eine datengesteuerte Menühierarchie, die eine logische Gruppierung von Navigationselementen ermöglicht, und integriert flüssige kreisförmige Reveal-Animationen, um polierte visuelle Übergänge beim Öffnen oder Schließen des Menüs zu bieten. Durch die Kapselung komplexer Layout- und Interaktionslogik in eine einzige, modulare Klasse vereinfacht die Bibliothek die Implementierung der Navigation über mehrere Bildschirme hinweg. Sie unterstützt ereignisgesteuerte Übergänge, was es Entwicklern ermöglicht, Menüinteraktionen von Inhaltsaktualisierungen zu entkoppeln, um eine saubere und reaktionsschnelle Anwendungsarchitektur zu wahren.
Provides mechanisms for assigning tasks to resources with capacity and availability constraints.
Mayhem-Firmware is a custom firmware for the PortaPack add-on that transforms a HackRF software-defined radio into a standalone handheld device capable of receiving, transmitting, and analyzing radio signals across a wide frequency range. The firmware provides a complete operational environment with an event-driven touchscreen interface, a menu-driven application launcher, and a real-time sample streaming pipeline that connects the hardware abstraction layer to a suite of modular applications. All user data, including frequency presets, captures, and configuration files, are stored on a remova
Provides on-screen menus to configure SDR hardware parameters, display, and calibration settings.
Phoenix ist eine Pull-to-Refresh-UI-Komponente und eine JavaScript-Gestenbibliothek, die für mobile und Web-Ansichten entwickelt wurde. Sie bietet ein wiederverwendbares Interaktionsmuster, das Datenaktualisierungen auslöst, wenn ein Benutzer den Bildschirm nach unten zieht. Das Projekt bietet anpassbare visuelle Indikatoren und themenbezogene Animationen, die auf den Status des Pull-Vorgangs reagieren. Es enthält Mechanismen zur manuellen Statuskoordination, die es externen Controllern ermöglichen, Aktualisierungssequenzen programmgesteuert unabhängig von Benutzereingaben auszulösen oder abzubrechen. Um eine reibungslose Benutzererfahrung zu gewährleisten, integriert sich die Bibliothek in Mobile-First-Ansichten, indem sie Scroll-Ereignisse abfängt, um widersprüchliche native Browser-Verhaltensweisen zu verhindern.
Tracks availability and project assignments through a visual calendar to streamline staffing.
Worklenz is a project management platform and professional services automation tool designed for planning work, tracking tasks via Kanban boards, and managing team collaboration. It functions as a combined resource management tool and time tracking software, providing a centralized workspace to analyze team capacity, balance workloads, and log work hours. The platform is distinguished by its deep integration with GitHub and Slack, allowing for the synchronization of repository activity and the delivery of real-time project notifications to external communication channels. It further streamlin
Analyzes member capacity across projects to prevent overloading and balance resource distribution.