Awesome GitHub RepositoriesAsynchronous Batch Processing

Moshi is a real-time voice foundation model and speech-to-speech framework designed for bidirectional, low-latency conversations. It functions as a full-duplex voice interface that processes audio and text concurrently in a single stream, enabling natural human-machine dialogue without sequential processing delays. The system utilizes a neural audio codec to compress high-fidelity audio into low-bitrate tokens for efficient transmission. To manage complex responses and reasoning, it employs internal monologue modeling, which generates a hidden stream of thought tokens alongside audible speech

p-queue 是一个 JavaScript Promise 队列和并发任务调度器，旨在限制活动异步操作的数量。它作为一个异步速率限制器和 Promise 生命周期管理器，以防止资源耗尽。 该项目以基于优先级的任务调度和令牌桶速率限制来控制执行频率而脱颖而出。它与用于任务取消的中止信号集成，并提供暂停、恢复和清除挂起操作的机制。 该工具涵盖了更广泛的流量管理能力，包括操作超时和并发限制。它还包括用于跟踪队列状态和挂起任务计数的监控原语，以及用于队列空闲的同步机制。

openai-go is an LLM SDK for Go and a client for interacting with OpenAI services. It provides type-safe bindings to generate text, images, and audio via REST endpoints, enabling the integration of large language models and AI assistant orchestration into Go applications. The library serves as an agent orchestration tool for managing stateful conversation threads and autonomous agents with integrated tool calling and file search. It also functions as an asynchronous batch processing client for monitoring large-scale request groups and fine-tuning jobs, alongside a management SDK for controllin

This is a Python SDK for interacting with large language models via API. It serves as a client library to generate text, process messages, and manage conversational states, while providing a specialized interface for connecting to models hosted across different cloud infrastructure providers. The SDK includes a tool-calling framework that maps Python functions to JSON schemas, allowing models to execute external tools. It also features a built-in token counting utility to estimate input size before transmission and a server-sent events client for receiving model tokens in real time. The libr