4 Repos
Awesome GitHub RepositoriesInference APIs
Standardized network interfaces for serving machine learning model predictions and capabilities to external applications.
Distinguishing note: Focuses on the network-facing API layer for model serving, distinct from local CLI or UI interfaces.
Explore 4 awesome GitHub repositories matching artificial intelligence & ml · Inference APIs. Refine with filters or upvote what's useful.
Awesome Inference APIs GitHub Repositories
Finde die besten Repos mit KI.Wir suchen mit KI nach den am besten passenden Repositories.
- jingyaogong/minimind
jingyaogong/minimind
51,834Auf GitHub ansehenThis project is a comprehensive framework for the entire lifecycle of transformer-based language models, supporting everything from foundational pretraining to specialized deployment. It provides a modular toolkit for defining neural network architectures, managing data preparation pipelines, and executing training routines across various scales. The framework is designed to handle the full model development process, including supervised fine-tuning, behavioral alignment, and the integration of agentic capabilities. What distinguishes this framework is its focus on efficient training and adva
The framework exposes model capabilities through a standardized network API, supporting advanced features like tool calling and structured output for integration with external applications.
Pythonartificial-intelligencelarge-language-model - simstudioai/sim
simstudioai/sim
28,796Auf GitHub ansehenThis project is an AI agent orchestration platform that provides a visual environment for building, testing, and deploying complex automation workflows. It functions as a low-code development interface where users can chain discrete functional blocks into dependency-aware pipelines to integrate artificial intelligence with external data and services. The platform supports the creation of intelligent conversational agents, automated business processes, and multi-service API orchestrations within a unified workspace. The platform distinguishes itself through its event-driven integration engine,
Accesses inference APIs to perform machine learning tasks through a standardized interface.
TypeScriptagent-workflowagentic-workflowagents - openbmb/toolbench
OpenBMB/ToolBench
5,672Auf GitHub ansehenToolBench is an open platform for training, serving, and evaluating large language models that retrieve and call real-world APIs to complete user instructions. It provides an API-aware inference engine that selects relevant tools from a large corpus and generates sequences of tool calls to produce final answers, along with a custom API registration system that lets users add their own REST endpoints for the model to discover and invoke. The platform includes a complete instruction-tuning pipeline for training models on curated tool-use data, a multi-tool execution engine that coordinates sequ
Allows registering user-defined APIs with documentation and implementation for use during inference.
Python - swe-bench/swe-bench
SWE-bench/SWE-bench
4,321Auf GitHub ansehenSWE-bench is an automated evaluation framework that tests large language models on real-world software engineering tasks. It measures how effectively models can generate and apply code patches that resolve actual GitHub issues, using a standardized dataset and scoring system built around Docker-based patch verification against original project test suites. The framework provides curated benchmark datasets spanning comprehensive, fast, verified, multilingual, and multimodal evaluation splits, allowing targeted assessment of model capabilities across different programming languages and issue ty
Runs model inference on benchmark instances via external APIs with progress tracking.
Pythonbenchmarklanguage-modelsoftware-engineering
