Awesome GitHub RepositoriesModel Behavior Evaluation

CleanRL is a reinforcement learning library and PyTorch framework providing a suite of reproducible implementations for online reinforcement learning algorithms. It serves as a deep reinforcement learning benchmark suite and experiment orchestrator designed for research and agent development across both discrete and continuous action spaces. The project is distinguished by its single-file algorithm implementation approach, which encapsulates each algorithm in a standalone script to eliminate complex class hierarchies. This structure is paired with a system for scheduling and executing large-s

Arize Phoenix is an LLM observability platform and evaluation framework designed to capture execution traces and monitor large language model applications. It serves as a prompt management system for versioning and testing templates, and as a self-hosted AI operations infrastructure for managing telemetry and experiments. The platform differentiates itself through a specialized embedding visualization tool used to detect data drift and optimize vector search. It provides a comprehensive evaluation suite that utilizes judge-based evaluators and ground-truth datasets to score model outputs, and

Lab is a customizable 3D platform and research testbed designed for training and testing autonomous agents using reinforcement learning. It serves as a spatial AI training simulator where agents can be evaluated through navigation and puzzle-solving tasks. The environment allows for the definition of complex layouts and task behaviors through external scripting, enabling the generation of specific challenges for AI research. It supports both automated training via standard API bindings and manual agent control to validate simulation dynamics. The system utilizes a grid-based spatial represen

Learn_Prompting est un projet éducatif axé sur le prompt engineering, fournissant les principes et techniques nécessaires pour concevoir des entrées efficaces et améliorer la qualité des sorties d'IA générative. Le projet couvre des stratégies de prompting avancées pour améliorer le raisonnement, la fiabilité et la qualité des résultats. Cela inclut des techniques de décomposition de tâches, le raisonnement par chaîne de pensée (chain-of-thought), et l'utilisation de guidage few-shot et zero-shot. Il aborde également la sécurité des modèles à travers l'étude du prompt hacking, l'analyse de vulnérabilité et l'audit de confidentialité pour prévenir les fuites de données sensibles. La portée s'étend à l'application pratique de l'IA générative à travers divers médias et workflows, incluant la génération de texte, la création d'images photoréalistes et la production audiovisuelle. Il couvre en outre le développement d'agents autonomes, la programmation assistée par IA et l'automatisation des workflows métier pour le marketing et la communication. Le projet fournit des ressources pour l'optimisation des modèles, l'évaluation et la gestion des cycles de vie des prompts au sein d'un environnement d'expérimentation interactif.

PhiCookBook is a technical guide and implementation framework for integrating small language models into applications. It provides instructions for deploying these lightweight models to perform reasoning, coding, and math tasks across various hardware environments and serving platforms. The project functions as a tutorial for developing intelligent AI applications by chaining prompts and code into executable sequences. It includes a framework for evaluating model behavior and calculating quality metrics to verify the accuracy and reliability of these workflows. The repository covers a broad