1 repo
Awesome GitHub RepositoriesBatch Inference Services
Tools for managing high-volume, cost-effective model inference requests.
Distinguishing note: Focuses on batch-mode execution rather than real-time streaming.
Explore 1 awesome GitHub repository matching artificial intelligence & ml · Batch Inference Services. Refine with filters or upvote what's useful.
Awesome Batch Inference Services GitHub Repositories
Find the best repos with AI.We'll search the best matching repositories with AI.
- google/langextract
google/langextract
33,310View on GitHubLangextract is a framework designed to transform unstructured text into structured, machine-readable data using language model orchestration. It provides a high-performance pipeline that processes large volumes of narrative text by utilizing parallel execution and sequential extraction passes. The library is built to handle complex data extraction tasks, including specialized support for clinical information and medical entity relationship recognition. The project distinguishes itself through a plugin-based architecture that supports both local hardware execution and cloud-hosted model endpoi
Enables cost-effective batch processing through cloud-based artificial intelligence services.
Pythongeminigemini-aigemini-api
