4 रिपॉजिटरी
Techniques to reduce AI operational costs through history management and caching strategies.
Distinct from Token Consumption Trackers: Focuses on actively reducing costs via caching and append-only history, not just tracking usage analytics.
Explore 4 awesome GitHub repositories matching system administration & monitoring · Token Cost Optimizations. Refine with filters or upvote what's useful.
DeepSeek-Reasonix is an autonomous software engineering framework and terminal-based AI IDE designed to coordinate large language models for complex programming tasks. It functions as a multi-session agent that utilizes a split planner and executor workflow to break down and implement technical objectives. The system distinguishes itself through a specialized focus on session optimization and extensibility. It employs prefix caching and append-only history to reduce token consumption and latency during long sessions. It further extends its capabilities by integrating external tool servers via
Decreases operational costs and latency using append-only history and prefix caching to optimize token usage.
This project is an autonomous AI software development framework designed to plan, code, test, and commit software milestones without human intervention. It functions as a state-machine-driven agent loop that orchestrates development through a recurring cycle of research, execution, and verification. The system distinguishes itself through a git-isolated task runner that executes milestones in separate worktrees and branches, ensuring changes are squash-merged into a linear commit history. It features a multi-model routing gateway that assigns different LLM providers to specific workflow phase
Optimizes AI operational costs via context compression and the selection of cheaper model tiers.
OpenSquilla is an LLM agent orchestration framework designed to coordinate multi-step AI workflows and tool execution using directed acyclic graphs. It functions as a centralized system for managing specialized skill packages and executing complex reasoning sequences. The project distinguishes itself through a routing gateway that directs tasks to different AI providers based on complexity, cost, and performance. It utilizes a multi-tier AI memory system that organizes working, episodic, and semantic knowledge using local embeddings and SQLite, alongside a secure execution sandbox that isolat
Deno AI Agent disables reasoning billing for simple queries and auto-tunes prompt depth to lower consumption.
Tempest is an orchestration platform designed for the execution and management of autonomous coding agents. It provides a framework for running multiple agents in parallel, coordinating their workflows, and maintaining persistent session states through a centralized management interface. The platform distinguishes itself through its focus on secure, isolated execution and intelligent context management. Each agent operates within a dedicated sandbox, utilizing ephemeral file systems and database copies to perform tasks without impacting production environments. To optimize performance and red
Optimizes token consumption by utilizing a local knowledge graph to send only relevant code context to models.