awesome-repositories.com
المدونة
awesome-repositories.com

اكتشف أفضل مستودعات المصادر المفتوحة باستخدام بحث مدعوم بالذكاء الاصطناعي.

استكشفعمليات بحث منسقةبدائل مفتوحة المصدربرمجيات ذاتية الاستضافةالمدونةخريطة الموقع
المشروعحولكيفية ترتيب النتائجالصحافةخادم MCP
قانونيالخصوصيةالشروط
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

5 مستودعات

Awesome GitHub RepositoriesBatch Processing Jobs

Executes finite data processing tasks to completion for repetitive reporting or analysis.

Distinct from Kubernetes Batch Jobs: Distinct from Kubernetes Batch Jobs: focuses on the platform's internal batch execution capability, not Kubernetes-native resources.

Explore 5 awesome GitHub repositories matching data & databases · Batch Processing Jobs. Refine with filters or upvote what's useful.

Awesome Batch Processing Jobs GitHub Repositories

اعثر على أفضل المستودعات باستخدام الذكاء الاصطناعي.سنبحث عن أفضل المستودعات المطابقة باستخدام الذكاء الاصطناعي.
  • hazelcast/hazelcastالصورة الرمزية لـ hazelcast

    hazelcast/hazelcast

    6,570عرض على GitHub↗

    Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis

    Processes finite datasets to perform repetitive tasks like report generation.

    Javabig-datacachingdata-in-motion
    عرض على GitHub↗6,570
  • apache/pinotالصورة الرمزية لـ apache

    apache/pinot

    6,098عرض على GitHub↗

    Pinot is a distributed, columnar analytical database designed for high-concurrency, low-latency query processing. It functions as a real-time OLAP datastore, enabling interactive, user-facing analytics by ingesting and querying massive datasets from both streaming and batch sources. The system architecture relies on a centralized controller for cluster coordination and a distributed segment-based storage model to ensure horizontal scalability. The platform distinguishes itself through a hybrid ingestion pipeline that unifies real-time event streams and historical batch data into a single quer

    Launches a standalone job that builds segments from source data and pushes them to the cluster.

    Java
    عرض على GitHub↗6,098
  • goldbergyoni/nodejs-testing-best-practicesالصورة الرمزية لـ goldbergyoni

    goldbergyoni/nodejs-testing-best-practices

    4,365عرض على GitHub↗

    هذا المشروع عبارة عن دليل شامل ومجموعة من أفضل الممارسات لاختبار تطبيقات الواجهة الخلفية لـ Node.js. يوفر مجموعة منسقة من الأنماط وأمثلة مرجعية لكتابة اختبارات الوحدة والتكامل والمكونات الموثوقة. يتميز المشروع باستراتيجيات محددة لتكامل الواجهة الخلفية، بما في ذلك طرق مفصلة لاختبار عقد API مقابل مواصفات OpenAPI والمخططات المشتركة. ويقدم توجيهاً متخصصاً حول إدارة اختبار طابور الرسائل، مع التركيز على التكرار (idempotency)، والمرونة، ومزامنة الأحداث غير المتزامنة. يغطي الدليل نطاقاً واسعاً من مجالات القدرات، بما في ذلك عزل حالة قاعدة البيانات والتنظيف، ومحاكاة التبعيات الخارجية عبر معترضات الشبكة (network interceptors) والبدائل المكتوبة (type-safe stubs)، وأتمتة البنية التحتية للاختبار المعبأة (containerized). كما يتناول تحسين الأداء لمجموعات الاختبار من خلال استخدام أقراص RAM ومحركات الذاكرة لتخزين البيانات.

    Provides methods to test message queue consumers using batches with mixed failures to ensure system resilience.

    JavaScriptbackendbest-practicescomponent-testing
    عرض على GitHub↗4,365
  • googleapis/python-genaiالصورة الرمزية لـ googleapis

    googleapis/python-genai

    3,819عرض على GitHub↗

    This project is a Python software development kit and framework for building applications that integrate with large language models. It serves as a multimodal content generator and vector embedding library, enabling the production and editing of text, images, audio, and video. The toolkit provides specialized capabilities for adapting base models through supervised and reinforcement training. It further distinguishes itself by offering tools for orchestrating complex workflows, including stateful chat sessions, the enforcement of structured output via schemas, and the integration of external

    Implements batch processing jobs for handling large volumes of requests with configurable dataset inputs and outputs.

    Python
    عرض على GitHub↗3,819
  • bensheldon/good_jobالصورة الرمزية لـ bensheldon

    bensheldon/good_job

    2,975عرض على GitHub↗

    Good Job is a background job processor for Ruby on Rails that utilizes a PostgreSQL database as its primary storage engine. By leveraging relational database transactions, it ensures persistent and reliable task execution, integrating directly with the Active Job framework to handle asynchronous operations and recurring job scheduling within existing application environments. The system distinguishes itself through an in-process execution model that allows background workers to run within the same process as the web server, simplifying deployment by removing the need for separate worker servi

    Allows grouping multiple tasks into a single collection to track collective progress and trigger lifecycle callbacks.

    Rubyactivejobactivejob-backendhacktoberfest
    عرض على GitHub↗2,975
  1. Home
  2. Data & Databases
  3. Data Processing Pipelines
  4. Batch Processing Systems
  5. Batch Processing Utilities
  6. Cloud Batch Processing
  7. Cluster Batch Processing
  8. Kubernetes Batch Jobs
  9. Batch Processing Jobs

استكشف الوسوم الفرعية

  • Batch Ingestion Job LaunchersStandalone jobs that build and push data segments to the cluster. **Distinct from Batch Processing Jobs:** Distinct from Batch Processing Jobs: focuses on the specific task of building and pushing segments for ingestion, not general batch processing.
  • Batch Processing Test ScenariosTest cases specifically designed to validate how systems handle batches of mixed success and failurees. **Distinct from Batch Processing Jobs:** Focuses on testing the robustness of batch processing logic rather than the operational execution of batch jobs.