Awesome GitHub RepositoriesModel Comparison Interfaces

Odysseus is a self-hosted AI workspace and autonomous agent framework designed for deploying and managing large language models. It serves as a centralized platform for orchestrating agentic tasks, utilizing a model context protocol server to connect AI models to external system utilities, browser automation, and local hardware. The system distinguishes itself through a combination of retrieval-augmented generation and a RAG knowledge base, using vector stores and local embeddings to provide persistent semantic memory. It further integrates AI-driven communication management to triage email i

Unsloth is a high-performance training and inference platform designed to optimize the lifecycle of large language and multimodal models. It provides a comprehensive engine for fine-tuning, executing, and managing models locally, with a focus on reducing memory consumption and increasing compute speed on consumer-grade hardware. The platform distinguishes itself through hand-optimized kernels and automated computational graph techniques that maximize hardware throughput. It supports advanced training methodologies, including reinforcement learning for reasoning and efficient adapter-based fin

Deepagents is an LLM agent orchestration platform and stateful application server designed for deploying and managing AI agents built with computational graphs. It provides a containerized runtime environment that handles agent execution, state persistence, and the versioning of AI assistants. The platform distinguishes itself through deep integration with the Model Context Protocol, allowing agents to function as servers that expose tools and capabilities to external clients. It features a sophisticated observability suite for capturing execution traces, performing LLM-based evaluations agai

promptfoo is an evaluation framework for measuring the performance of large language model prompts, agents, and retrieval augmented generation pipelines. It provides a suite of tools for conducting comparative benchmarking and executing automated quality and security regressions. The system features a benchmarking suite for running identical prompts across different model providers to compare output quality side-by-side. It also includes a dedicated red teaming tool for identifying security vulnerabilities and prompt injection risks through automated penetration testing. The framework suppor

ExplainShell is a shell command explainer and syntax analyzer that matches command line arguments to manual page documentation. It functions as a man page parser and documentation extraction tool, converting roff-formatted manual pages into a structured database of command options and metadata. The project uses a combination of large language models and roff-macro parsing to identify specific line ranges that define flags and arguments. It employs a command syntax analyzer to deconstruct shell commands into tokens, which are then mapped against documented entries to provide plain language exp

This project serves as a comprehensive reference tool for prompt engineering within generative image models. It provides a structured guide for exploring artistic styles, technical parameters, and keyword combinations to assist in achieving specific aesthetic outcomes and consistent visual themes. The resource distinguishes itself by enabling direct comparisons between different model versions, allowing users to observe how specific keywords and settings influence output quality over time. By organizing visual examples and technical data into a hierarchical taxonomy, it facilitates the iterat

Promptfoo is an evaluation framework designed for testing, benchmarking, and red-teaming language models and agentic workflows. It provides a unified environment to run prompts against multiple providers, allowing developers to systematically validate model outputs against objective assertions, semantic similarity metrics, and custom grading rubrics. The platform distinguishes itself through a provider-agnostic execution layer and a stateful orchestrator capable of simulating multi-turn conversations and complex tool-use trajectories. It includes a dedicated adversarial mutation pipeline that

This project is a curated knowledge repository providing theoretical guides, practical challenge banks, and professional handbooks for technical interview preparation in data science and machine learning. It serves as a comprehensive study resource that combines theoretical knowledge with algorithmic practice. The repository features specialized study resources including a probability and statistics handbook, a machine learning reference for algorithms and neural network architectures, and a coding and SQL challenge bank designed to simulate recruitment assignments. It also includes a technic

AutoGluon is an automated machine learning framework and multimodal library designed to automate the end-to-end pipeline from data preprocessing to high-accuracy model training and validation. It functions as an automated model trainer for tabular, image, text, and time series data, as well as a tool for time series forecasting and foundation model finetuning. The project is distinguished by its ability to jointly process and fuse different data types, allowing for the construction of multimodal neural networks that integrate images, text, and structured tables. It supports zero-shot inferenc

PDF-Extract-Kit is a document extraction toolkit designed to convert PDF documents into structured formats such as Markdown, HTML, and LaTeX. It functions as a multi-stage parsing framework that combines a document layout analyzer, a formula recognition engine, an OCR text extractor, and a table extraction system. The project focuses on recovering complex document elements by translating images of mathematical formulas and tabular structures into editable source code. It utilizes model-driven layout analysis to identify structural elements in reports and textbooks while ignoring noise like wa

This project is an AI-powered IDE extension and LLM coding assistant that provides a conversational interface for generating, refactoring, and debugging code. It functions as an AI agent framework and a Model Context Protocol client, connecting AI models to external data sources and tools to automate complex development tasks. The system is distinguished by its use of autonomous AI agents capable of multi-step task execution, including the ability to read files, modify code, and run terminal commands iteratively. It supports recursive agent orchestration through subagent delegation and employ

BrowserOS is an AI agent browser orchestrator and automation framework designed to manage browser state and execute complex web workflows. It functions as a local AI browser assistant and a Model Context Protocol controller, enabling the control of browser tabs, windows, and navigation through programmable AI agents and standardized context protocols. The system distinguishes itself through a graph-based visual workflow builder for creating repeatable automation sequences and the use of markdown-based files to define agent personalities and task recipes. It supports multi-provider orchestrati

LanceDB is a vector database and columnar data store designed to function as a versioned dataset manager and vector search engine. It serves as a high-performance backend for indexing and retrieving high-dimensional embeddings, providing the foundation for machine learning data pipelines. The system distinguishes itself through a combination of cloud-native object storage and immutable version tracking, allowing for data time-travel and reproducible AI experiments. It integrates hybrid search capabilities, merging dense vector similarity with BM25 full-text search and SQL-like scalar filters

G0DM0D3 is a static web client and multi-model chat gateway designed for AI research, prompt optimization, and red teaming. It provides a unified interface to query numerous AI models in parallel, allowing for the simultaneous evaluation of different prompt variations and sampling parameters to identify the most successful outputs. The project features specialized tooling for probing safety filters and bypassing model constraints through an input perturbation engine that applies text obfuscation and character substitution. It includes a composite scoring system to rank model performance and a

big-AGI is a self-hosted AI frontend and multi-model client that provides a unified workspace for interacting with various large language models. It functions as an orchestration dashboard, allowing users to connect to cloud-based AI providers, aggregator services, and locally hosted model servers. The project is distinguished by its ability to execute prompts across multiple models simultaneously for side-by-side comparison and response synthesis. It enables the merging of outputs from different models to reduce hallucinations and improve accuracy, while using persona-based configuration map

This project is a collection of educational resources and technical guides focused on the development and implementation of large language models. It provides a comprehensive curriculum covering transformer architectures, training methods, and deployment strategies. The materials provide detailed instructions for building autonomous agents using reasoning loops and tool integration, as well as guides for fine-tuning models through supervised learning and preference optimization. It also includes tutorials for constructing retrieval augmented generation pipelines and implementing transformer m

LaVague is an LLM web agent framework and large action model designed to translate natural language instructions into executable browser automation scripts. It functions as a multi-modal orchestrator that reasons over web page states and HTML content to automate multi-step tasks via a Selenium-based automation engine. The framework features a modular model provider layer, allowing users to swap between different language and vision models from providers such as Anthropic, Gemini, and Azure OpenAI. It employs a multi-modal world model to process screenshots and HTML structures, utilizing retri

The Adversarial Robustness Toolbox (ART) is an open-source library that provides a unified framework for evaluating, defending, and certifying machine learning models against adversarial threats. It wraps models from any framework behind a common estimator interface, enabling composable pipelines for attack generation, defense application, robustness certification, and privacy auditing across evasion, poisoning, and extraction threats. The library distinguishes itself by covering the full adversarial ML security lifecycle within a single toolkit. It supports gradient-based adversarial example

Learn_Prompting هو مشروع تعليمي يركز على هندسة المطالبات (prompt engineering)، ويوفر المبادئ والتقنيات المطلوبة لصياغة مدخلات فعالة وتحسين جودة مخرجات الذكاء الاصطناعي التوليدي. يغطي المشروع استراتيجيات مطالبات متقدمة لتعزيز التفكير، والموثوقية، وجودة المخرجات. يتضمن ذلك تقنيات لتفكيك المهام، وتفكير سلسلة الأفكار (chain-of-thought)، واستخدام التوجيه بلقطات قليلة أو بدون لقطات (few-shot/zero-shot). كما يتناول أمان النموذج من خلال دراسة اختراق المطالبات، وتحليل الثغرات، وتدقيق الخصوصية لمنع تسرب البيانات الحساسة. يمتد النطاق إلى التطبيق العملي للذكاء الاصطناعي التوليدي عبر وسائط وسير عمل متنوعة، بما في ذلك توليد النصوص، وإنشاء صور واقعية، والإنتاج السمعي البصري. كما يغطي تطوير الوكلاء المستقلين، والبرمجة بمساعدة الذكاء الاصطناعي، وأتمتة سير عمل الأعمال للتسويق والاتصالات. يوفر المشروع موارد لتحسين النماذج، والتقييم، وإدارة دورات حياة المطالبات داخل بيئة تجريبية تفاعلية.

Deepchecks هو إطار عمل للتحقق من نماذج تعلم الآلة ومكتبة اختبار MLOps. يعمل كجناح لجودة بيانات الذكاء الاصطناعي ومقيم للأداء مصمم للتحقق من سلامة وأداء النماذج ومجموعات البيانات من مرحلة البحث وحتى الإنتاج. يعمل المشروع كأداة لمراقبة النماذج لتتبع انحراف البيانات (Data drift) وتدهور الأداء في بيئات الإنتاج. ويسمح بإنشاء مجموعات تحقق مخصصة ويستخدم بنية فحص قابلة للتوصيل (Pluggable check) لأتمتة فحوصات الجودة داخل خطوط أنابيب التكامل المستمر (CI). يغطي إطار العمل مجموعة واسعة من الإمكانيات بما في ذلك التحقق من سلامة البيانات، واكتشاف الانحراف القائم على التوزيع، ومقارنة إصدارات النماذج. ويوفر تحليلاً متخصصاً لرؤية الكمبيوتر ومعالجة اللغات الطبيعية، إلى جانب أدوات إعداد التقارير التي تحول مقاييس التحقق إلى تقارير مرئية تفاعلية. يدعم النظام النشر في الموقع (On-premises) للحفاظ على خصوصية البيانات والتحكم في البنية التحتية.