9 repositorios
Configuration parameters for adjusting thread counts and parallel processing behavior.
Distinguishing note: Focuses on performance tuning via concurrency, distinct from infrastructure provisioning.
Explore 9 awesome GitHub repositories matching devops & infrastructure · Parallel Execution Settings. Refine with filters or upvote what's useful.
Trufflehog is a security tool designed to continuously monitor code repositories and cloud environments to detect, verify, and remediate exposed sensitive credentials and API keys. It functions as a comprehensive secret scanning engine that integrates directly into deployment pipelines and version control systems to intercept sensitive data before it is committed or pushed. By utilizing read-only operations and volatile memory processing, the system ensures that discovered credentials are never stored persistently, maintaining strict data privacy throughout the scanning lifecycle. The platfor
Adjusts parallel worker threads to balance scan speed against system resource usage.
This project is a deep learning framework designed for constructing, training, and deploying neural networks across diverse hardware environments. It functions as a high-performance tensor computation library that provides both imperative and symbolic programming interfaces, allowing developers to balance flexible, step-by-step model building with the efficiency of compiled computation graphs. The framework distinguishes itself through a hybrid execution engine that integrates declarative graph compilation with imperative runtime logic. It supports scalable, distributed training across multip
Provides configuration parameters for adjusting thread counts and parallel processing behavior to optimize performance.
This project is a collection of educational resources and reference implementations for the Apache Flink stream processing framework. It provides a learning resource focused on mastering distributed stream processing through implementation guides, performance tuning tutorials, and practical examples. The repository features detailed walkthroughs for building real-time data pipelines using the DataStream and Table APIs. It includes specific integration examples for connecting Apache Flink with Kafka brokers and Elasticsearch indices, as well as reference implementations for real-time deduplica
Provides guides for configuring parallel execution settings to optimize stream processing speed.
100 Go Mistakes is a reference book and code review companion that catalogues frequent Go programming anti-patterns and provides corrected implementations for each one. It covers a wide range of common pitfalls, from range loop variable capture and interface nil handling to error wrapping and map iteration randomization, helping developers recognize and avoid these issues in their own code. The project distinguishes itself by offering a structured, example-driven approach to learning idiomatic Go. It covers core design decisions such as when to use pointer versus value receivers, how to apply
Defines a minimum workload size below which goroutine creation overhead outweighs parallel speed gains, preventing slowdowns.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Tunes thread counts for query processing and data aggregation to maximize throughput.
Pueue is a task queue manager for shell commands, built as a daemon and command-line interface. It accepts shell commands into a managed queue and executes them with configurable parallel execution limits, supporting both global and per-group concurrency controls. The daemon persists its entire state—task queue, logs, and configuration—to disk, ensuring survival across crashes and system restarts. The project distinguishes itself through a dependency graph that lets tasks declare prerequisites, forming a directed acyclic graph that controls execution order. Tasks can be organized into named g
Adjust the maximum number of tasks that run concurrently at runtime without restarting the daemon.
hnswlib es una librería C++ header-only y motor de indexación vectorial diseñado para la búsqueda aproximada de vecinos más cercanos en alta dimensión. Organiza grandes colecciones de embeddings en una estructura de grafo consultable para permitir consultas de proximidad rápidas y cálculos de distancia. El sistema utiliza grafos Hierarchical Navigable Small World para lograr una búsqueda de similitud vectorial rápida. Se distingue por permitir la definición de métricas de distancia y funciones de similitud personalizadas para adaptar los cálculos a requisitos de datos específicos. El motor cubre el ciclo de vida completo de indexación, incluyendo la construcción incremental del índice y la gestión de puntos de datos mediante adiciones y eliminación de elementos. Las capacidades de consulta incluyen búsqueda de vecinos más cercanos tanto aproximada como exacta, complementada por filtrado de búsqueda booleana para excluir candidatos basados en etiquetas de elementos. La librería soporta la persistencia del índice mediante serialización de archivos binarios y proporciona configuraciones para ejecución paralela para distribuir tareas de consulta e indexación a través de múltiples núcleos de CPU.
Provides configurations to tune the number of CPU threads used for indexing and querying to optimize throughput.
This project is a Rust interface for the PyTorch C++ library, serving as a deep learning framework and tensor computing library. It functions as a C++ API wrapper that enables the manipulation of multi-dimensional arrays and the execution of neural network architectures across CPU and GPU hardware accelerators. The library provides a TorchScript inference engine to load and execute just-in-time compiled models. It also supports Rust and Python interoperability, allowing for the creation of Python extensions that share tensor data through a common interface. The system covers deep learning mo
Allows configuration of processing thread counts to optimize hardware utilization.
This project is a high-performance tabular data processing framework for R, designed to handle massive datasets with memory efficiency and speed. It provides an enhanced data structure that utilizes reference semantics and in-place modification to perform complex transformations without the overhead of unnecessary object copying. The library distinguishes itself through its low-level architectural optimizations, including multi-threaded parallel processing, radix-based sorting, and memory-mapped file parsing. By offloading critical data manipulation and aggregation routines to compiled C code
Allows configuration of the number of CPU threads used for parallel data processing tasks.