Awesome GitHub RepositoriesCloud Batch Processing

CleanRL is a reinforcement learning library and PyTorch framework providing a suite of reproducible implementations for online reinforcement learning algorithms. It serves as a deep reinforcement learning benchmark suite and experiment orchestrator designed for research and agent development across both discrete and continuous action spaces. The project is distinguished by its single-file algorithm implementation approach, which encapsulates each algorithm in a standalone script to eliminate complex class hierarchies. This structure is paired with a system for scheduling and executing large-s

Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer

This is an educational repository that teaches container orchestration fundamentals through hands-on guides and practical examples. It covers core Kubernetes concepts including Pods, Services, Deployments, and Namespaces, providing step-by-step exercises that demonstrate how to manage containerized applications across a cluster. The tutorials walk through essential Kubernetes capabilities such as decoupling configuration from application code using ConfigMaps and Secrets, exposing Pods with stable network endpoints via Services, and routing external traffic with Ingress controllers. The mater

ZenML is an orchestration platform designed for building, deploying, and monitoring reproducible machine learning pipelines and agentic workflows. It provides a unified framework that manages the entire lifecycle of machine learning assets, from data processing and model training to the deployment of persistent inference services. By decoupling pipeline logic from underlying compute and storage, the platform enables teams to transition workflows seamlessly from local development environments to production-grade cloud infrastructure. The platform distinguishes itself through a service-oriented

This project is a comprehensive guide and collection of best practices for testing Node.js backend applications. It provides a curated set of patterns and reference examples for writing reliable unit, integration, and component tests. The project distinguishes itself through specific strategies for backend integration, including detailed methods for API contract testing against OpenAPI specifications and shared schemas. It offers specialized guidance on managing message queue testing, focusing on idempotency, resilience, and asynchronous event synchronization. The guide covers a broad range

GAM is a command-line tool for administering Google Workspace and Cloud Identity. It translates command-line arguments into structured API calls, enabling administrators to manage users, groups, organizational units, and domain settings across a Google Workspace environment. The tool handles authentication through OAuth2 flows, service accounts, and workload identity federation, and supports multi-tenant configurations for managing multiple domains or cloud projects from a single installation. GAM distinguishes itself through its batch processing and automation capabilities. It can process la

This project is a Python software development kit and framework for building applications that integrate with large language models. It serves as a multimodal content generator and vector embedding library, enabling the production and editing of text, images, audio, and video. The toolkit provides specialized capabilities for adapting base models through supervised and reinforcement training. It further distinguishes itself by offering tools for orchestrating complex workflows, including stateful chat sessions, the enforcement of structured output via schemas, and the integration of external

Good Job es un procesador de trabajos en segundo plano para Ruby on Rails que utiliza una base de datos PostgreSQL como su motor de almacenamiento principal. Al aprovechar las transacciones de bases de datos relacionales, garantiza una ejecución de tareas persistente y confiable, integrándose directamente con el framework Active Job para manejar operaciones asíncronas y la programación de trabajos recurrentes dentro de entornos de aplicación existentes. El sistema se distingue por un modelo de ejecución en proceso que permite que los trabajadores en segundo plano se ejecuten dentro del mismo proceso que el servidor web, simplificando el despliegue al eliminar la necesidad de servicios de trabajo separados. Emplea la ejecución de trabajadores multihilo y bloqueos de asesoramiento a nivel de base de datos para coordinar tareas a través de procesos distribuidos, asegurando una ejecución única para trabajos recurrentes y una utilización eficiente de los recursos. La biblioteca ofrece controles operativos integrales, incluyendo la capacidad de agrupar tareas relacionadas en lotes para el seguimiento colectivo del ciclo de vida y el uso de inserción masiva para optimizar la ingesta de tareas de alta frecuencia. Los administradores pueden gestionar límites de concurrencia, asignar pools de hilos dedicados para colas específicas y monitorear la salud del sistema a través de un dashboard web integrado y personalizable. El proyecto incluye una interfaz incorporada para inspeccionar, pausar y solucionar problemas de tareas en tiempo real, junto con la retención de historial configurable para auditoría y análisis de rendimiento.

Map-anything is a 3D scene reconstruction framework and neural geometry estimator designed to transform two-dimensional images into metric three-dimensional spatial representations using feed-forward neural networks. It provides a specialized toolkit for predicting camera intrinsics and ray directions from single images without requiring external geometric metadata. The project includes a 3D model benchmarking suite that utilizes a unified model wrapper to standardize outputs from diverse reconstruction models. This allows for consistent evaluation and accuracy measurement across various spat