13 مستودعات
Architectures that distribute recursive search workloads across multiple CPU threads to increase analysis depth.
Distinct from Computational Parallelization: Distinct from Computational Parallelization: focuses on the specific application of parallelization to tree-based search algorithms.
Explore 13 awesome GitHub repositories matching web development · Parallel Search Engines. Refine with filters or upvote what's useful.
The Silver Searcher is a high-performance text search utility and regex code search tool designed to locate strings and regular expressions within plain text and source code. It functions as a codebase pattern matcher that provides highlighted results with surrounding line context and respects standard ignore files. The utility includes specialized capabilities for searching inside zlib and lzma compressed archives. It implements high-throughput processing via parallel-threaded file scanning and just-in-time regular expression compilation. The tool's search and indexing surface covers output
Distributes file reading and pattern matching across multiple CPU cores to minimize total search time.
Stockfish is a high-performance chess engine designed to evaluate board positions and calculate optimal moves. It functions as a command-line tool that utilizes neural network-based search algorithms to assess complex game states and determine strategic advantages. The engine is fully compliant with the Universal Chess Interface, allowing it to exchange commands and move data with external graphical user interfaces and professional analysis software. The engine distinguishes itself through advanced computational strategies that maximize hardware efficiency and search depth. It employs multi-t
Distributes computational workloads across multiple CPU threads to accelerate move evaluation and increase analysis depth.
NNI is an AutoML toolkit designed to automate machine learning lifecycles. It functions as a hyperparameter optimization framework, a neural architecture search tool, and a model compression suite. The project provides a distributed training orchestrator to manage machine learning workloads across local machines, remote servers, and cloud platforms. It enables the discovery of efficient model structures through reinforcement learning and one-shot optimization methods, while utilizing Bayesian and evolutionary algorithms to automate hyperparameter tuning. Additional capabilities include tools
Implements architectures that distribute hyperparameter optimization trials across multiple processes or machines.
Optuna is a Python-based hyperparameter optimization framework designed to automate the search for optimal machine learning model configurations. It functions as a Bayesian optimization library that systematically tests parameter combinations to maximize or minimize objective functions, streamlining the model development process through iterative evaluation. The project distinguishes itself through a define-by-run dynamic construction model, which allows users to build complex, conditional search spaces using standard programming logic. Its architecture is highly modular, featuring a pluggabl
Distributes parameter search trials across multiple processes or machines to accelerate the discovery of optimal configurations.
gosec is a static analysis security tool designed to scan Go source code for vulnerabilities and common coding flaws. It functions as a security analyzer that inspects the abstract syntax tree to identify insecure function calls, API usage, and potential security risks. The tool distinguishes itself by mapping detected vulnerabilities to Common Weakness Enumeration identifiers for standardized reporting and integrating with external AI models to suggest code fixes for identified issues. Its capabilities cover the detection of injection vulnerabilities, hardcoded credentials, weak cryptograph
Distributes filesystem traversal and scanning across multiple CPU cores to reduce analysis time.
This is a scikit-learn automated machine learning framework designed to optimize model selection and hyperparameters. It functions as an automated model selector and hyperparameter optimization tool for classification and regression tasks, utilizing an automated ensemble builder to combine high-performing models for increased predictive accuracy. The system features a distributed search engine that uses Dask for parallel machine learning optimization across CPU cores or clusters. It implements a budget-based evaluation strategy through successive halving to prioritize promising model configur
Utilizes Dask to distribute model optimization trials across multiple CPU cores or clusters.
Hyperopt is a Python library for hyperparameter optimization designed to minimize scalar-valued objective functions. It operates as a stochastic search space engine that finds optimal input parameters by searching through real-valued, discrete, and conditional spaces. The framework distinguishes itself through its support for complex search space configurations, allowing for conditional parameter hierarchies where specific hyperparameters are sampled only if their parent parameters meet certain criteria. It is built as an asynchronous optimization framework, decoupling the generation of searc
Runs multiple optimization trials across different machines or clusters to find optimal parameters faster.
Komga is a self-hosted digital comics and eBook server that organizes, serves, and streams CBZ, CBR, PDF, and EPUB files through a web interface. Built as a Java Spring Boot application with SQLite-based metadata storage, it provides multi-user access controls with individual reading progress tracking and supports the OPDS protocol for compatibility with third-party reader applications. The server distinguishes itself through comprehensive authentication options, including OAuth2 and OpenID Connect support with automatic account creation and email verification, alongside traditional cookie an
Scans configured library directories to detect new, changed, or removed files and updates metadata.
FAST_LIO هو نظام SLAM في الوقت الفعلي وحزمة قياس المسافة بالقصور الذاتي LiDAR مصممة للتوطين ورسم الخرائط المتزامن. يعمل كمحرك لتقدير الحالة وأداة رسم خرائط ثلاثية الأبعاد تدمج سحب نقاط LiDAR مع بيانات وحدة قياس القصور الذاتي لتوفير تقدير قوي لحالة الروبوت. يستخدم النظام نهج دمج مستشعرات مقترن بإحكام مع مرشح Kalman تكراري لتقدير الموقع والاتجاه. يتميز بمطابقة النقطة إلى المستوى المباشرة، والتي تحسب قياس المسافة عن طريق مطابقة نقاط lidar الخام بسطح الخريطة دون استخراج ميزات هندسية يدوية. للحفاظ على سرعات معالجة عالية، يستخدم رسم خرائط KD-tree تزايدي وأشجار بحث مكانية متوازية. يغطي إطار العمل مجموعة واسعة من الإمكانيات بما في ذلك إزالة تشويه الحركة لتصحيح الالتواء المكاني ومزامنة الطابع الزمني للمستشعر. كما يوفر أدوات لمعايرة المستشعرات الخارجية، وتهيئة محاذاة المستشعر، وتصدير سحب النقاط العالمية المتراكمة. تم تنفيذ المشروع بلغة C++ ويوفر واجهات لدمج تدفقات بيانات مستشعر IMU وLiDAR الخارجية.
Employs parallel spatial search trees to minimize computational overhead during 3D map queries.
FLAML هو إطار عمل للتعلم الآلي المؤتمت، وأداة لتحسين المعلمات الفائقة، ومنسق لوكلاء النماذج اللغوية الكبيرة. يوفر نظاماً لاختيار النماذج وضبطها عبر مختلف المتعلمين ومجموعات البيانات، مع تقديم مجموعة أدوات لتحسين معلمات الاستدلال وإعدادات الضبط الدقيق للنماذج اللغوية الكبيرة. يتميز المشروع بنظام ضبط للتعلم الفوقي (meta-learning) يحلل بيانات المهام التاريخية لتوليد تكوينات افتراضية تعتمد على البيانات، مما يسرع تقارب النموذج. كما يتيح تصميم أنظمة تعاونية متعددة الوكلاء من خلال سير عمل محادثي وتنسيق قائم على الأحداث. تغطي القدرات بحثاً فعالاً في الموارد عن المعلمات الفائقة لنماذج التعلم الآلي ودوال Python التعسفية، مع دعم مساحات البحث الهرمية وتحسين الهدف المعجمي. يتضمن إطار العمل أيضاً أدوات لاختيار النموذج المؤتمت، وبناء المجموعات المكدسة (stacked ensemble)، والتكوين بدون أمثلة (zero-shot)، وفرض قيود العدالة. يدعم النظام توسيع نطاق الضبط الموزع وتنفيذ التجارب المتزامنة عبر عناقيد الحوسبة لتقليل مدة البحث الإجمالية.
Distributes parameter search workloads across multiple processes or machines to shorten total search duration.
Memories is a self-hosted photo and video management system designed for organizing, indexing, and sharing media libraries from a private server. It functions as an AI-powered media organizer that uses artificial intelligence for face recognition and object tagging to automatically categorize large collections. The system distinguishes itself through deep metadata integration and specialized processing, featuring a geographic photo viewer that plots media on a map using GPS data and reverse geocoding. It also includes a self-hosted video transcoder that converts files into adaptive HLS stream
Distributes filesystem traversal and pattern matching across multiple CPU cores to index media files.
Minigo is a TensorFlow-based reinforcement learning engine designed to master the game of Go. It functions as a comprehensive system for training neural networks to predict board policies and game outcomes, utilizing a model trainer to generate self-play data and optimize weights. The project is distinguished by its ability to perform large-scale game simulations using Kubernetes to distribute worker nodes across CPU, GPU, and TPU hardware. It employs a Monte Carlo Tree Search implementation to identify optimal moves and supports specialized hardware acceleration, including inference on Edge
Prevents multiple threads from exploring the same branch during search by temporarily penalizing visited nodes.
ScanCode Toolkit is a software composition analysis tool and scanning framework designed to identify open-source licenses and copyright statements in source code and binary files. It functions as an open-source license detector, a dependency vulnerability scanner, and a generator for standardized software bills of materials in SPDX and CycloneDX formats. The project is built as a plugin-based scanning framework, allowing the integration of custom detection logic, specialized analyzers, and modified scanning behaviors at runtime. It distinguishes itself through the ability to produce formal le
Implements multithreaded file system traversal to accelerate the analysis of large source code repositories.