1 Repo
Deployment of AI-driven functions as containerized services exposed via HTTP endpoints.
Distinct from REST APIs: The candidates focus on general REST APIs or generic host deployments, not the specific pattern of hosting prompt functions as a service
Explore 1 awesome GitHub repository matching devops & infrastructure · Containerized AI Function Deployment. Refine with filters or upvote what's useful.
BAML is a prompt engineering framework and LLM client generator that defines AI prompts as type-safe functions. It serves as a structured data extraction tool and workflow orchestrator, transforming unstructured model responses into strongly typed objects using a custom schema language and alignment algorithms. The project distinguishes itself by using a compiler to generate language-specific boilerplate code for API communication and output parsing. It features a dedicated environment for designing complex prompt templates with conditional logic and reusable snippets, and employs genetic alg
Hosts defined prompt functions in containers to be called as services over HTTP.