awesome-repositories.com
博客
awesome-repositories.com

通过 AI 驱动的搜索,发现最优秀的开源仓库。

探索精选搜索开源替代品自托管软件博客网站地图
项目关于排名机制媒体报道MCP 服务器
法律隐私政策服务条款
© 2026 Bringes Technology SRL·VAT RO45896025·hello@awesome-repositories.com
·

5 个仓库

Awesome GitHub RepositoriesInput Caches

Systems for storing processed text and media inputs to reduce latency and costs for repeated requests.

Distinct from Data Caching: Distinct from general data caching: focuses on caching input payloads for AI model requests to avoid redundant processing.

Explore 5 awesome GitHub repositories matching data & databases · Input Caches. Refine with filters or upvote what's useful.

Awesome Input Caches GitHub Repositories

用 AI 发现最棒的仓库。我们将通过 AI 为您搜索最匹配的仓库。
  • ffmpeg/ffmpegFFmpeg 的头像

    FFmpeg/FFmpeg

    61,176在 GitHub 上查看↗

    FFmpeg is a cross-platform multimedia framework designed for the recording, conversion, and streaming of audio and video content. It functions as a comprehensive toolkit that provides both a command-line utility for direct media manipulation and a collection of low-level libraries for integration into custom applications. At its core, the project utilizes a packet-based stream engine and a format-agnostic abstraction layer to handle diverse media standards, containers, and network protocols. The framework distinguishes itself through a modular, graph-based filter execution model that allows f

    Stores remote stream data in temporary files to enable seeking and playback stability.

    Caudiocffmpeg
    在 GitHub 上查看↗61,176
  • google-gemini/cookbookgoogle-gemini 的头像

    google-gemini/cookbook

    17,418在 GitHub 上查看↗

    The Gemini Cookbook is a comprehensive collection of implementation patterns, code samples, and development guides designed for building applications with Google Gemini models. It serves as a central resource for developers to integrate multimodal generative artificial intelligence into their software, providing the necessary frameworks to manage model interactions, stateful workflows, and structured data extraction. The repository distinguishes itself by offering specialized toolkits for autonomous agent orchestration, enabling the construction of agents that can execute code, browse the web

    Stores frequently used input tokens on the server to reduce latency and operational costs during subsequent requests.

    Jupyter Notebookgeminigemini-api
    在 GitHub 上查看↗17,418
  • 567-labs/instructor567-labs 的头像

    567-labs/instructor

    13,176在 GitHub 上查看↗

    Instructor is a framework designed for structured data extraction, validation, and language model integration. It functions as a library that transforms unstructured text into validated, type-safe objects by leveraging schema definitions and model-specific tool-calling capabilities. By acting as a validation middleware, the project ensures that language model outputs strictly conform to defined data structures. The library distinguishes itself through a robust validation-based retry loop that automatically re-submits failed responses with error feedback to iteratively correct schema complianc

    Stores previously processed text and media inputs to reduce latency and operational costs for identical content.

    Pythonopenaiopenai-function-calliopenai-functions
    在 GitHub 上查看↗13,176
  • googleapis/python-genaigoogleapis 的头像

    googleapis/python-genai

    3,819在 GitHub 上查看↗

    This project is a Python software development kit and framework for building applications that integrate with large language models. It serves as a multimodal content generator and vector embedding library, enabling the production and editing of text, images, audio, and video. The toolkit provides specialized capabilities for adapting base models through supervised and reinforcement training. It further distinguishes itself by offering tools for orchestrating complex workflows, including stateful chat sessions, the enforcement of structured output via schemas, and the integration of external

    Caches large inputs and system instructions to reduce latency and token costs.

    Python
    在 GitHub 上查看↗3,819
  • mercari/ml-system-design-patternmercari 的头像

    mercari/ml-system-design-pattern

    2,922在 GitHub 上查看↗

    This project provides a collection of architectural blueprints and design patterns for building, deploying, and scaling machine learning systems in production environments. It serves as a comprehensive reference for standardizing the end-to-end lifecycle of machine learning components, including training pipelines, model serving, and system observability. The framework distinguishes itself by offering standardized strategies for managing complex operational requirements such as asynchronous inference, traffic routing, and service decoupling. It covers a wide range of patterns for model servin

    Reduces latency by storing frequently accessed input data in high-speed memory layers during prediction requests.

    在 GitHub 上查看↗2,922
  1. Home
  2. Data & Databases
  3. Data Caching
  4. Input Caches

探索子标签

  • StreamSystems for caching remote stream data to enable seeking and stability. **Distinct from Input Caches:** Distinct from input caches: focuses on media stream seeking and stability rather than AI model request caching.