Awesome GitHub RepositoriesTasks and Scheduling

This project is a Python-based proxy pool manager that collects, validates, and serves free proxy IP addresses through an HTTP API. It consists of an automated scraper to gather addresses from multiple online sources, a persistent database-backed store for organization, and a delivery interface for retrieving validated proxies. The system features a pluggable scraper architecture that allows for the integration of custom discovery methods and source expansion via generator functions. It employs decorator-based validation logic, enabling the definition of custom connectivity and HTTPS criteria

30dayMakeOS is an educational hobby operating system project designed for the x86 architecture. It implements a monolithic kernel and a custom bootloader that transitions the CPU from real mode to 32-bit protected mode to enable flat memory addressing. The project focuses on low-level system development, featuring a custom graphics driver for direct pixel-buffer rendering and window management without an existing operating system. It includes an x86 bootloader that loads the kernel from disk into memory. The system covers core kernel capabilities including round-robin task scheduling for pro

Pixi is a conda environment manager that creates reproducible, lock-file-backed environments with cross-platform support and multi-language dependency resolution. It combines package management from both conda-forge and PyPI simultaneously, coordinating their dependency graphs to prevent conflicts, while pinning every transitive dependency to exact versions in a cross-platform lock file for bit-for-bit identical environments across machines. The project distinguishes itself by also functioning as a cross-platform task runner that executes user-defined commands and multi-step pipelines inside

ProxyPool is a proxy pool manager that automatically collects, validates, and serves HTTP proxies from multiple sources through a web API. At its core, it runs scheduled background processes that scrape free and paid proxy websites, test each proxy's availability against configurable target URLs using asynchronous HTTP clients, and store the results in a Redis-backed sorted set where proxies are scored and ranked by reliability. The system distinguishes itself through a pluggable crawler architecture that allows users to add new proxy sources by writing a simple class with target URLs and a p

DataX Web is a web-based management platform for scheduling, building, executing, and monitoring distributed data synchronization jobs powered by DataX. It provides a visual console for creating and managing DataX tasks without manual JSON configuration, with a distributed executor cluster that auto-registers worker nodes and supports configurable routing and blocking strategies for task distribution. The platform offers cron-based task scheduling with dynamic start, stop, and immediate status changes, along with incremental sync capabilities that pass dynamic parameters to extract only new o

CppGuide is a curated collection of educational resources and practical guides focused on C++ server development, Linux kernel internals, concurrent programming, network protocols, and security exploitation. It provides structured learning paths for backend developers, covering everything from interview preparation to building high-performance network servers and understanding operating system fundamentals. The guide distinguishes itself by offering in-depth, hands-on tutorials that walk through real-world implementations, including building a Redis-like server from scratch, designing custom

Swarm is a container clustering system that pools multiple Docker hosts into a single virtual host, enabling transparent container scheduling and management across the cluster. It exposes the standard Docker API so existing Docker-compatible tools and clients can operate on the cluster without any modifications. The system uses a distributed key-value store to maintain cluster state, enabling consistent scheduling decisions across nodes. A Docker-API proxy layer translates standard API calls into cluster-wide operations, while a host-pool abstraction hides individual host details from the cli

seL4 is a formally verified microkernel whose C implementation is backed by machine-checked mathematical proofs of correctness, confidentiality, integrity, and availability. It enforces strict isolation between processes through hardware-enforced address space separation and a capability-based access control system, where each process holds explicit rights only to the resources it has been granted. The kernel exposes hardware resources through a minimal API of system calls that manage threads, address spaces, and inter-process communication, with synchronous IPC supporting sender-identifying b

rllm is an asynchronous reinforcement learning framework for training language agents. It provides a unified pipeline that runs the same agent code for both evaluation and training, automatically capturing traces for gradient computation. The framework supports distributed reinforcement learning across multiple GPUs and nodes using pluggable backends, and executes agents in isolated sandboxes—either locally or in the cloud—for safe and scalable rollout collection. It trains agents built with LangGraph, SmolAgents, OpenAI Agents SDK, or custom frameworks without requiring core logic changes. T

This project is a collection of technical documentation and guides designed as a computer architecture explainer. It provides educational resources on how processors and operating systems execute programs, focusing on the fetch-execute cycle and the fundamental relationship between hardware and the kernel. The documentation covers a wide range of low-level system operations, including detailed guides on the executable and linkable binary format, virtual memory management, and kernel-level operations. It specifically explores the mechanics of CPU scheduling, preemptive multitasking, and the us

Laravel Mix هو خط أنابيب أصول واجهة أمامية وأداة بناء JavaScript تعمل كغلاف لـ Webpack. يوفر نظام تهيئة تصريحي لتبسيط تجميع وحزم أصول JavaScript وCSS. تركز الأداة على تبسيط سير عمل Webpack، مما يسمح للمستخدمين بإدارة خطوط أنابيب بناء معقدة دون كتابة ملفات تهيئة واسعة النطاق من الصفر. يستخدم واجهة برمجة تطبيقات سلسة لتعريف خطوات البناء وقواعد تحويل الأصول. يغطي النظام حزم أصول الويب الحديثة، بما في ذلك ترجمة وحدات JavaScript ودمج معالج CSS المسبق لـ Sass وLess. كما يدير تجميع الأصول الجاهزة للإنتاج من خلال المعالجة القائمة على الإضافات ورسم خرائط المصدر التلقائي.

tqsdk-python هو SDK وإطار عمل للتداول الكمي مصمم لتطوير استراتيجيات آلية للعقود الآجلة، والخيارات، والأسهم باستخدام Python. يعمل كمحرك تداول خوارزمي وAPI لبيانات السوق المالية، ويوفر الأدوات اللازمة لاختبار الاستراتيجيات، وتحليل البيانات التاريخية، وتنفيذ التداولات الحية عبر حسابات وساطة متعددة. يتميز المشروع بمكتبة تحليلات خيارات متخصصة تحسب اليونانيات (Greeks)، والتقلب الضمني، وأسطح التقلب باستخدام نموذج Black-Scholes. كما يدعم أنماط تنفيذ أوامر معقدة، مثل TWAP، وIceberg، وPOV، لتقليل تأثير السوق أثناء دخول وخروج المراكز. يغطي الـ SDK سطح قدرات واسع بما في ذلك استرجاع بيانات السوق في الوقت الفعلي والتاريخية، وإدارة المخاطر الكمية، ومراقبة المحفظة. يدمج نموذج تنفيذ غير متزامن لبث البيانات وجدولة المهام، إلى جانب أدوات لمحاكاة التداول متعدد الأصول وتحليل الأداء. توفر المكتبة واجهة رسومية قائمة على الويب لمراقبة الاستراتيجية وتصور البيانات.

هذا المشروع عبارة عن توزيعة OpenJDK مخصصة ومحسنة للتطبيقات الموزعة ذات الإنتاجية العالية. يتميز بمحرك تشغيل coroutine يستبدل خيوط النواة (kernel threads) بـ coroutines متماثلة خفيفة الوزن لزيادة التزامن وتقليل عبء الجدولة مع الحفاظ على توافق واجهة Java القياسية. يتميز وقت التشغيل بمدير موارد متعدد المستأجرين ومزودي شبكات متخصصين. ينفذ عزل الموارد لوحدة المعالجة المركزية والذاكرة لمنع التداخل بين المستأجرين، ويدمج الوصول المباشر للذاكرة عن بُعد (RDMA) لنقل البيانات بإنتاجية عالية وزمن وصول منخفض. يغطي النظام نطاقاً واسعاً من قدرات الأداء والتشخيص، بما في ذلك تجميع الإحماء الموجه بالملفات الشخصية (profile-guided warmup) لتسريع بدء التشغيل، واستعادة ذاكرة الكومة (heap) الديناميكية، وتحسينات متخصصة لمعالجة البيانات الضخمة والحسابات الرقمية. تتضمن مجموعة المراقبة الخاصة به بث أحداث مسجل الرحلات (flight recorder)، وتحليل تفريغ الكومة، وفحص حالة الـ coroutine. يتم توفير دعم طويل الأمد عبر تحديثات أمنية وصيانة ربع سنوية، مع توفر أدوات نشر للبيئات المعتمدة على الحاويات.

IPProxyPool is an HTTP proxy pool manager that crawls, validates, and serves a rotating list of functional proxy addresses via a programmatic API. It integrates proxy scraping, connectivity validation, and persistent database storage to provide a managed source of IP addresses for network requests. The system uses a plugin-based scraping architecture to collect IP addresses from multiple external websites and an asynchronous validation queue to test these candidates in parallel. It differentiates its pool by assigning numeric stability scores to proxies through periodic health checks and conn

ProxyBroker هي أداة لكشط عناوين وكلاء HTTP وSOCKS العامة، والتحقق من اتصالها، وإدارة مجموعة من الوكلاء الوظيفيين. تتكون من كاشط وكلاء للاكتشاف، ومحرك تحقق للتحقق من إخفاء الهوية وأوقات الاستجابة، ومدير مجموعة للحفاظ على قائمة انتظار مصفاة من الخوادم. يتضمن المشروع خادم وكيل دوار محلي يعمل كنقطة دخول واحدة، ويوزع تلقائياً حركة مرور الشبكة الواردة عبر مجموعة من الوكلاء الخارجيين المعتمدين. تسمح هذه البنية التحتية بتدوير عناوين IP للحفاظ على المرونة أثناء جمع بيانات الويب. يغطي النظام تقييم جودة الوكيل، بما في ذلك التحقق من دعم ملفات تعريف الارتباط، ورؤوس الإحالة، وطلبات POST. كما يوفر تصفية قائمة على السمات حسب الجغرافيا والبروتوكول، بالإضافة إلى أدوات لتصدير قوائم الوكلاء المكتشفة إلى ملفات خارجية.

This project is an educational framework and toolkit designed for developing and testing operating system kernels. It provides a structured environment for implementing fundamental system primitives, including virtual memory management, preemptive process scheduling, and filesystem organization, using Rust and C. The framework is specifically oriented toward RISC-V and x86 architectures, serving as a laboratory for learning how to build core system software from the ground up. The project distinguishes itself by supporting both bare-metal deployment and hardware emulation, allowing developers

This project is a technical programming guide and educational resource focused on Go internals, runtime mechanisms, and advanced language features. It provides detailed conceptual analysis of the language's execution model, including its scheduler, memory escape analysis, and garbage collection mechanisms. The material distinguishes itself through deep dives into high-concurrency system design, exploring the implementation of worker pools and communication channels. It also covers low-level network programming with a focus on I/O multiplexing and TCP state management, alongside a study of dis

This project is a public proxy aggregator and directory providing curated lists of validated HTTP and SOCKS proxy servers. It features a machine-readable API service and tools designed for anonymous network routing and the automated rotation of outgoing IP addresses. The system distinguishes itself through a proxy rotation tool used to bypass rate limits and prevent detection by automated security systems. It provides a programmatic interface for retrieving and filtering verified proxies by country and protocol, delivering this data in JSON and text formats for integration into custom applica

lmms-eval is a benchmarking system and performance analysis suite designed to measure the capabilities of large multimodal models. It provides a framework for evaluating models across text, image, audio, and video datasets, serving as a multimodal dataset orchestrator and benchmarking tool to quantify accuracy and efficiency. The project distinguishes itself through a unified multimodal message protocol that structures diverse media inputs for consistent model consumption. It features specialized benchmarking for audio, video, visual, document, and spatial reasoning, alongside tools for model