Awesome GitHub RepositoriesAsynchronous Batch Processing

Moshi is a real-time voice foundation model and speech-to-speech framework designed for bidirectional, low-latency conversations. It functions as a full-duplex voice interface that processes audio and text concurrently in a single stream, enabling natural human-machine dialogue without sequential processing delays. The system utilizes a neural audio codec to compress high-fidelity audio into low-bitrate tokens for efficient transmission. To manage complex responses and reasoning, it employs internal monologue modeling, which generates a hidden stream of thought tokens alongside audible speech

p-queue ist eine JavaScript-Promise-Warteschlange und ein Scheduler für gleichzeitige Aufgaben, der dazu entwickelt wurde, die Anzahl aktiver asynchroner Operationen zu begrenzen. Er dient als asynchroner Ratenbegrenzer und Promise-Lebenszyklus-Manager, um Ressourcenerschöpfung zu verhindern. Das Projekt zeichnet sich durch prioritätsbasierte Aufgabenplanung und Token-Bucket-Ratenbegrenzung zur Steuerung der Ausführungsfrequenz aus. Es lässt sich mit Abort-Signalen für den Abbruch von Aufgaben integrieren und bietet Mechanismen zum Anhalten, Fortsetzen und Löschen ausstehender Operationen. Das Tool deckt breitere Verkehrsmanagement-Funktionen ab, einschließlich Operations-Timeouts und Concurrency-Limiting. Es enthält zudem Monitoring-Primitive zur Verfolgung des Warteschlangenzustands und der Anzahl ausstehender Aufgaben sowie Synchronisation für das Leerlaufen der Warteschlange.

openai-go is an LLM SDK for Go and a client for interacting with OpenAI services. It provides type-safe bindings to generate text, images, and audio via REST endpoints, enabling the integration of large language models and AI assistant orchestration into Go applications. The library serves as an agent orchestration tool for managing stateful conversation threads and autonomous agents with integrated tool calling and file search. It also functions as an asynchronous batch processing client for monitoring large-scale request groups and fine-tuning jobs, alongside a management SDK for controllin

This is a Python SDK for interacting with large language models via API. It serves as a client library to generate text, process messages, and manage conversational states, while providing a specialized interface for connecting to models hosted across different cloud infrastructure providers. The SDK includes a tool-calling framework that maps Python functions to JSON schemas, allowing models to execute external tools. It also features a built-in token counting utility to estimate input size before transmission and a server-sent events client for receiving model tokens in real time. The libr