Projects sharing features with Rci Agent

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements.

WrenAI is a platform designed to enable natural language interaction with relational and analytical databases. By combining a text-to-SQL engine with semantic data modeling, it allows users to explore structured data through plain language questions, removing the requirement for manual code generation. The system functions by grounding natural language requests in a predefined business logic layer rather than raw database schemas. This semantic approach, supported by context-aware prompt engineering, ensures that generated queries remain consistent and accurate across an organization. The pla

MemGPT is a memory management framework and external memory layer for large language models. It functions as a platform for building stateful AI agents that maintain a persistent identity and continuous context across multiple sessions. The system enables agents to bypass fixed context window limitations by using a virtual context windowing approach. This allows models to manage their own memory through internal commands to search, update, and delete stored information within a hierarchical structure of short-term working context and long-term archival storage. The framework provides a local

WorldGPT: Empowering LLM as Multimodal World Model

HiAgent: Hierarchical Working Memory Management for Solving Long-Horizon Agent Tasks with Large Language Model

Develop and deploy smart contracts using natural language.

Sen Li, Ruochen Wang, Cho-Jui Hsieh, Minhao Cheng, Tianyi Zhou

UFO is a multi-device task orchestrator and LLM agent orchestration framework designed to decompose natural language requests into executable task graphs. It functions as a cross-platform UI automation tool capable of performing interactions on Windows and mobile devices while routing tasks to distributed agents based on their hardware and software capabilities. The system is distinguished by its RAG-enhanced agent architecture, which integrates external documentation and previous execution traces to improve decision-making. It employs a hybrid UI detection approach that combines computer vis

This repository contains the main CALYPSO system from the paper CALYPSO: LLMs as Dungeon Masters’ Assistants. CALYPSO takes the form of a Discord bot that DMs can use to understand D&D monsters and brainstorm encounter ideas.

[Website](https://os-copilot.github.io/) [Arxiv](https://arxiv.org/abs/2402.07456) [PDF](https://arxiv.org/pdf/2402.07456.pdf) [Documentation](https://os-copilot.readthedocs.io/en/latest/)

NeurIPS'24 HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge across external documents. RAG Knowledge Graphs Personalized PageRank.

Read this in Chinese (阅读中文版本).

This is the official code implementation of paper From Commands to Prompts: LLM-based Semantic File System for AIOS.

User Behavior Simulation with Large Language Model based Agents

Agent-S is a multimodal AI agent and LLM desktop automation framework designed to control operating systems through graphical user interface interactions. It functions as a computer use interface, utilizing vision-language grounding to translate natural language goals into precise screen coordinates and system actions. The project differentiates itself by combining structured accessibility tree inspection with vision-based element localization. It manages cross-application workflows by mapping conceptual descriptions to physical pixels and simulating low-level keyboard and mouse events to mov

Chemcrow

Vanna is a Python framework designed to build conversational interfaces that translate natural language into executable database queries. It functions as an enterprise-grade toolkit that connects language models to relational databases, allowing users to retrieve information through conversational prompts rather than manual code. The system maintains context across interactions by utilizing vector databases to store historical query patterns and schema metadata. The framework distinguishes itself through a focus on security and schema-aware generation. It incorporates granular access control,

This repo provides the PyTorch source code of our paper: VideoAgent: Long-form Video Understanding with Large Language Model as Agent (ECCV 2024). Check out project page here!

To get started, clone the KARMA repository: ` git clone https://github.com/WZX0Swarm0Robotics/KARMA `

OpenAgents is an open-source platform for deploying, managing, and interacting with language agents through a conversational interface. Agents on this platform can analyze data by generating and executing Python and SQL code, invoke external plugins, browse the web autonomously, and perform tasks like flight search, map directions, and social media posting—all driven by natural language. What distinguishes the platform is its architecture for persistent agent lifecycle management, isolated code execution via a sandbox, multi-agent coordination for complex workflows, and automatic plugin disco

OSWorld is an evaluation framework and multimodal agent benchmark designed to test the ability of large language models to complete complex tasks within virtualized operating system environments. It provides a virtualized desktop sandbox and a virtual machine orchestrator to deploy, snapshot, and reset cloud-based desktops, ensuring reproducible test states for AI agent interactions. The system distinguishes itself by providing an OS-level action space that translates model decisions into mouse clicks, keyboard inputs, and system commands. It employs a standardized interface to integrate vari

This project serves as a curated directory and resource hub for developers working with generative artificial intelligence. It provides a comprehensive index of open-source software solutions, frameworks, and project examples designed to help users discover and implement advanced AI systems. The repository focuses on practical implementations of agentic, multimodal, and retrieval-augmented generation architectures. It highlights tools for building conversational assistants, voice-enabled agents, and automated workflows that leverage large language models. By showcasing diverse technical domai