23 रिपॉजिटरी
Coordination of scheduled tasks across a cluster to ensure exactly-once execution using shared locks.
Distinct from Distributed Leader Election: Distinct from Distributed Leader Election as it can manage locks for individual jobs rather than just a single primary node.
Explore 23 awesome GitHub repositories matching devops & infrastructure · Distributed Lock Coordination. Refine with filters or upvote what's useful.
This project is a remote file transfer server and asynchronous download orchestrator. It functions as a backend service that manages a queue of remote file transfer requests to coordinate the download of files from the web to a remote storage destination. The system operates as a distributed download coordinator, scheduling and tracking the progress of file transfers across different network nodes. It routes data requests from a client to a remote file system and utilizes asynchronous task execution to process heavy file operations in the background. The server includes capabilities for queu
Coordinates distributed download tasks across network nodes to optimize file acquisition.
Jeesite is a full-stack low-code development framework designed for building enterprise administrative portals using Spring Boot, MyBatis, and Vue. It functions as a comprehensive platform for creating administrative dashboards with integrated role-based access control and organizational data permission systems. The framework distinguishes itself through a combination of automated CRUD code generation and an integrated RAG platform that connects large language models to enterprise data via vector stores. It further incorporates a BPMN-based workflow engine to automate complex business process
Coordinates task triggers across cluster instances to prevent duplicate executions and ensure resource isolation.
This project is an Android RPA framework designed for automating user interfaces and system tasks on rooted Android devices using Python and ADB. It provides a suite of tools for rooted device management, allowing for programmatic control of system settings, application lifecycles, and shell command execution via a remote API. The framework distinguishes itself through a combination of dynamic instrumentation and AI integration. It can inject scripts into running processes to hook Java interfaces and modifies application behavior in real time. Additionally, it supports large language model in
Coordinates task execution across multiple Android devices using a distributed task system and P2P bridge.
gocron is a task scheduling library for Go designed to automate recurring tasks using crontab expressions, fixed durations, and specific calendar dates. It functions as a concurrent job manager and execution monitor that tracks task lifecycles and performance. The project provides distributed task scheduling through leader election and distributed locking to prevent duplicate job execution across multiple nodes. It further distinguishes itself with a concurrency management system that implements singleton constraints and global execution quotas to protect system resources. The scheduler cove
Prevents duplicate execution across multiple nodes using leader election and distributed locking.
Quartz is a Java job scheduling framework and task execution engine designed to manage and execute scheduled tasks within application environments. It functions as an enterprise job scheduler that persists job state and execution history to maintain reliability across system restarts. The system distinguishes itself through a decoupled architecture that separates the definition of a job's action from the trigger logic that determines when it runs. It supports distributed task coordination across multiple server nodes to provide high availability and load balancing. The framework covers a bro
Coordinates job triggering across multiple server nodes to provide high availability and load balancing.
Hazelcast is a distributed data platform that combines an in-memory data grid with a stream processing engine to support real-time analytics and event-driven applications. It functions as a partitioned, distributed key-value store that replicates data across cluster nodes to provide low-latency access and high availability. The platform also serves as a distributed SQL query engine, allowing users to execute standard SQL statements against both in-memory datasets and external data sources. What distinguishes Hazelcast is its use of a distributed consensus subsystem to maintain strongly consis
Provides synchronization primitives like locks and semaphores to manage concurrent access across nodes.
Certmagic, TLS प्रमाणपत्रों के जारी करने और नवीनीकरण को ऑटोमेट करने के लिए एक Go लाइब्रेरी है। यह एक स्वचालित HTTPS प्रोविज़नर और ACME क्लाइंट के रूप में कार्य करता है जो मैन्युअल हस्तक्षेप के बिना सुरक्षित कनेक्टिविटी सुनिश्चित करने के लिए प्रमाणपत्रों के पूर्ण जीवनचक्र को संभालता है। लाइब्रेरी ऑन-डिमांड TLS प्रोविज़निंग के लिए अपने सपोर्ट के लिए जानी जाती है, जो सर्वर नाम के आधार पर TLS हैंडशेक के दौरान डायनामिक रूप से प्रमाणपत्र उत्पन्न करती है। यह DNS चैलेंज सत्यापन के माध्यम से वाइल्डकार्ड प्रमाणपत्रों के लिए ऑटोमेशन भी प्रदान करती है और प्रमाणपत्र अधिग्रहण के लिए ZeroSSL API के साथ इंटीग्रेट होती है। प्रोजेक्ट ACME चैलेंज रिज़ॉल्यूशन, स्वचालित नवीनीकरण शेड्यूलिंग, और प्रमाणपत्र निरसन सहित क्षमताओं की एक विस्तृत श्रृंखला को कवर करता है। यह प्लगेबल स्टोरेज बैकएंड के माध्यम से डेटा पर्सिस्टेंस को मैनेज करता है और सर्वर क्लस्टर्स में प्रमाणपत्र प्रबंधन को समन्वयित करने के लिए डिस्ट्रीब्यूटेड लॉकिंग और सिंक्रोनाइज़ेशन लागू करता है। अतिरिक्त कार्यक्षमता में OCSP स्टेपलिंग, इन-मेमोरी कैशिंग, और कस्टम सर्वर्स के लिए TLS कॉन्फ़िगरेशन का निर्माण शामिल है।
Synchronizes operations across a cluster using shared locks to prevent duplicate work during certificate issuance.
Superalgos एक क्रिप्टोकरेंसी एल्गोरिथम ट्रेडिंग प्लेटफॉर्म है जिसका उपयोग स्वचालित ट्रेडिंग बॉट्स को डिज़ाइन करने, बैकटेस्ट करने और तैनात करने के लिए किया जाता है। यह एक विजुअल स्ट्रेटेजी डिज़ाइनर पर केंद्रित है जो उपयोगकर्ताओं को मैन्युअल कोड लिखने के बजाय ग्राफिकल इंटरफेस के माध्यम से इंडिकेटर्स और ट्रेडिंग लॉजिक बनाने की अनुमति देता है। प्लेटफॉर्म में एक टोकन-गेटेड सिग्नल नेटवर्क है जो ट्रेडिंग इंटेलिजेंस को प्रसारित और मुद्रीकृत करने के लिए एक विकेंद्रीकृत बाज़ार को सक्षम बनाता है। इन सिग्नल्स और भविष्यवाणियों तक पहुंच डिजिटल टोकन और प्रतिष्ठा स्कोर के माध्यम से मैनेज की जाती है, जबकि एक वितरित ट्रेडिंग इंफ्रास्ट्रक्चर उपयोगकर्ताओं को कई सर्वरों के नेटवर्क पर डेटा माइनिंग और उच्च-वॉल्यूम निष्पादन का समन्वय करने की अनुमति देता है। सिस्टम ऐतिहासिक बैकटेस्टिंग इंजन, स्वचालित मार्केट डेटा माइनिंग और लाइव ट्रेड निष्पादन सहित क्षमताओं की एक विस्तृत श्रृंखला को कवर करता है। यह पैटर्न पहचान के लिए मशीन लर्निंग को शामिल करता है और सक्रिय बॉट्स की आंतरिक रनटाइम स्थिति को ट्रैक करने के लिए विजुअल डिबगिंग टूल्स प्रदान करता है। इंफ्रास्ट्रक्चर सेल्फ-होस्टेड परिनियोजन का समर्थन करता है, जिससे उपयोगकर्ता फंड्स, कीज़ और रणनीतियों पर नियंत्रण बनाए रखने के लिए स्थानीय परिसर में वातावरण चला सकते हैं।
Coordinates data mining and trading execution tasks across a network of multiple machines to scale workloads.
Okdownload is a multi-threaded HTTP download engine and transfer library designed for concurrent file downloading. It functions as a resumable file downloader that splits single files into multiple blocks for simultaneous processing to increase network throughput and transfer speeds. The system distinguishes itself through a builder-based component injection framework and a strategy pattern that allows for custom download engines. Developers can replace default storage and connection modules or override the logic used for block splitting and filename generation. The library provides comprehe
Provides a coordination layer to start, cancel, and track the operational states of download tasks.
Dramatiq is a distributed task queue and workload manager used to offload function execution to background workers. It functions as an asynchronous task orchestrator that enables the distribution of computational tasks across a cluster using a pluggable transport layer supporting RabbitMQ and Redis. The framework provides specialized tools for complex task orchestration, including the ability to link background jobs into sequences, pipelines, and barriers. It further manages distributed concurrency through the use of shared mutexes, rate limiters, and exponential backoff retries to prevent re
Uses shared locks and barriers to coordinate task execution and prevent resource exhaustion across a cluster.
Consul Template is a configuration renderer and dynamic configuration manager that generates files by populating templates with data from Consul and Vault. It functions as a service discovery template engine and secrets management integrator, transforming cluster catalog and health data into formatted configuration files. The tool distinguishes itself by acting as a process supervisor and notifier, capable of executing shell commands or restarting applications automatically after templates are updated. It features a long-polling watcher to monitor remote key-value stores and employs a shared
Prevents simultaneous configuration updates across multiple instances using a shared distributed locking mechanism.
Athens is a Go module proxy server and dependency cache that provides a persistent storage system for Go dependencies. It acts as a mirror and datastore to ensure reproducible build environments by storing immutable copies of external packages, protecting against upstream deletions or outages. The project distinguishes itself by serving as a secure gateway for private Go module hosting, utilizing authentication tokens, SSH keys, and GitHub Apps to retrieve dependencies from private version control systems. It further enables software dependency compliance through request filtering and checksu
Uses shared locking mechanisms to prevent redundant downloads across multiple server instances.
YDB एक डिस्ट्रीब्यूटेड SQL डेटाबेस और एनालिटिकल इंजन है जिसे हॉरिजॉन्टल स्केलेबिलिटी और मजबूत स्थिरता के लिए डिज़ाइन किया गया है। यह एक मल्टी-मॉडल सिस्टम के रूप में कार्य करता है जो सीरियलाइज़ेबल ACID ट्रांजेक्शन प्रदान करने वाले डिस्ट्रीब्यूटेड आर्किटेक्चर के माध्यम से ट्रांजेक्शनल और एनालिटिकल वर्कलोड का समर्थन करता है। यह सिस्टम अपनी व्यापक प्रोटोकॉल संगतता द्वारा प्रतिष्ठित है, जो स्टैंडर्ड SQL ड्राइवर्स के लिए PostgreSQL वायर प्रोटोकॉल और मैसेजिंग और स्ट्रीमिंग के लिए Kafka प्रोटोकॉल को लागू करता है। यह आगे एक वेक्टर डेटाबेस के रूप में कार्य करता है, जो सिमेंटिक सर्च और एम्बेडिंग्स के लिए वेक्टर इंडेक्स और अनुमानित निकटतम पड़ोसी खोजों का समर्थन करता है। यह प्लेटफ़ॉर्म रो-ओरिएंटेड और कॉलम-ओरिएंटेड फॉर्मेट्स दोनों के साथ एक हाइब्रिड स्टोरेज मॉडल का उपयोग करके डेटा को मैनेज करता है, जो पेटाबाइट-स्केल एनालिटिक्स के लिए वेक्टरराइज़्ड क्वेरी निष्पादन का उपयोग करता है। इसकी परिचालन सतह में चेंज डेटा कैप्चर स्ट्रीमिंग, एक्जेक्टली-वन्स पर्सिस्टेंट क्यूज़ और मल्टी-ज़ोन उच्च उपलब्धता शामिल है। डिप्लॉयमेंट और लाइफसाइकिल मैनेजमेंट का समर्थन Kubernetes ऑपरेटर और इंफ्रास्ट्रक्चर-एज़-कोड प्रोविज़निंग के माध्यम से किया जाता है।
Synchronizes activities across distributed client applications using semaphores and coordination nodes.
Dkron is a distributed, fault-tolerant system designed for scheduling and executing recurring tasks across a cluster of nodes. It functions as a cron-based orchestrator that manages job lifecycles, including automatic retries, timeouts, and complex dependencies, while ensuring state consistency through a consensus protocol. By coordinating remote task execution across infrastructure, it enables the automation of background operations and the management of distributed workflows. The system distinguishes itself through a modular architecture that supports pluggable storage backends and a plugin
A cluster-aware engine that coordinates remote task execution and maintains state consistency across multiple servers using pluggable storage backends.
Jupiter is a comprehensive suite for task scheduling, performance observability, service governance, project bootstrapping, and dependency analysis within service meshes. It provides a microservice governance framework to manage service discovery, load balancing, and communication across distributed systems. The project distinguishes itself through a service mesh management tool that analyzes service dependencies and manages multi-data center registration and runtime configuration. It includes a dedicated microservice project bootstrapper via a command-line tool to generate standardized proje
Coordinates and synchronizes the execution of timed tasks across multiple server instances for consistent reliability.
ShedLock is a distributed lock manager designed to prevent scheduled tasks from running concurrently across multiple nodes in a distributed system. It acts as a task coordinator that ensures a single execution of timed jobs by managing lock lifespans and utilizing external lock providers. The system utilizes database-backed providers to store task execution states in external databases, synchronizing locks across active cluster nodes. It includes a clock-drift tolerant synchronizer that handles time discrepancies between distributed nodes through the use of shared timestamps and flexible lock
Coordinates scheduled tasks across a cluster to ensure exactly-once execution using shared locks in external stores.
Redsync is a distributed lock manager and Go Redis client extension designed to ensure exclusive access to shared resources. It implements mutual exclusion across multiple processes by using a Redis backend to coordinate synchronization and prevent race conditions in distributed environments. The library maintains lock validity through quorum-based consensus, requiring successful writes to a majority of independent Redis nodes. It utilizes Lua-scripted atomic operations for acquisition and release, while employing value-based ownership validation and time-to-live expiration to prevent deadloc
Uses Redis to synchronize tasks and state between decoupled components to prevent resource exhaustion and race conditions.
This library provides a task scheduling framework for Node.js applications, enabling the automation of recurring operations using standard cron syntax. It functions as a background task manager that maintains a stateful registry of jobs, allowing for runtime inspection, modification, and lifecycle control of scheduled operations. The project distinguishes itself through support for distributed environments and resource management. It includes mechanisms to coordinate tasks across multiple application instances, ensuring that scheduled work executes exactly once to prevent overlap or resource
Coordinates tasks across multiple instances to ensure exactly-once execution and prevent resource contention.
This project is a distributed scraping engine designed to extract business details, customer reviews, and lead information from Google Maps. It functions as a business scraper and data extractor that can be deployed as a permanent system or as on-demand serverless functions. The system utilizes a proxy-routed web crawler to manage request origins via SOCKS5, HTTP, and HTTPS proxies. To locate contact information, it includes an email extraction tool that recursively crawls business websites linked within map listings. The software supports coordinate-based radius searches for efficient data
Coordinates distributed scraping tasks across multiple instances using a shared database to prevent race conditions.
nq is a daemonless job orchestrator and POSIX shell task manager that manages asynchronous command execution on Unix systems. It functions as a command line job queue using directories and file-system locks to coordinate background processes across multiple terminal sessions. The system distinguishes itself by utilizing file-system-based locking to ensure sequential job execution without requiring a resident background daemon. It enables shared queue coordination, allowing different terminal sessions to synchronize work by directing tasks to specific directories. The project covers backgroun
Coordinates shared queues across multiple terminal sessions using file system locks to prevent concurrent execution.