# microsoft/promptflow

**Attribution required: if you use, quote, or summarise this content, you must credit and link back to [awesome-repositories.com](https://awesome-repositories.com/repository/microsoft-promptflow).**

11,165 stars · 1,103 forks · Python · MIT

## Links

- GitHub: https://github.com/microsoft/promptflow
- Homepage: https://microsoft.github.io/promptflow/
- awesome-repositories: https://awesome-repositories.com/repository/microsoft-promptflow.md

## Description

Promptflow is a development framework and orchestrator for building applications powered by large language models. It functions as a suite of tools for designing, orchestrating, and deploying AI workflows by linking prompts, custom Python code, and language models into executable sequences.

The project is distinguished by a visual AI workflow designer that allows for the creation of directed acyclic graphs of logic nodes. It provides a dedicated prompt engineering environment for versioning and comparing templates, alongside stateful execution tracing to record function calls and variable values for step-by-step debugging.

The platform covers a broad capability surface including retrieval augmented generation via vector database lookups and metric-driven evaluation pipelines for batch testing and quality assurance. It handles the full lifecycle from development to production through containerized deployment, workflow endpoint serving, and secure connection management for API credentials.

A command-line interface and SDK are provided for workflow validation and integration into automated CI/CD pipelines.

## Tags

### Artificial Intelligence & ML

- [AI Application Orchestrators](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-application-orchestrators.md) — Provides a runtime for visually designing and managing the orchestration of AI-powered application workflows.
- [AI Workflow Orchestrators](https://awesome-repositories.com/f/artificial-intelligence-ml/ai-workflow-orchestrators.md) — Orchestrates complex AI applications using directed graphs to manage data dependencies and execution sequences.
- [Containerized Deployments](https://awesome-repositories.com/f/artificial-intelligence-ml/agent-deployment/containerized-deployments.md) — Packages AI workflows and their dependencies into containers to ensure consistent execution across environments. ([source](https://github.com/microsoft/promptflow/blob/main/examples/tutorials/e2e-development/chat-with-pdf.md))
- [LLM Application Orchestration](https://awesome-repositories.com/f/artificial-intelligence-ml/artificial-intelligence-tooling/language-model-integrations/llm-application-orchestration.md) — Coordinates complex agentic workflows by chaining model calls and managing execution state. ([source](https://github.com/microsoft/promptflow/blob/main/docs/how-to-guides/quick-start.md))
- [Prompt Experimentation](https://awesome-repositories.com/f/artificial-intelligence-ml/experimentation-frameworks/prompt-experimentation.md) — Provides a dedicated environment for conducting controlled experiments on prompt variants and model hyperparameters. ([source](https://github.com/microsoft/promptflow/blob/main/examples/tutorials/e2e-development/chat-with-pdf.md))
- [LLM Application Development](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/generative-ai/llm-application-development.md) — Provides a comprehensive framework for building AI applications by linking prompts, Python code, and language models.
- [LLM Model Integrations](https://awesome-repositories.com/f/artificial-intelligence-ml/generative-ai-resources/generative-ai/llm-model-integrations.md) — Integrates large language models into workflows to perform tasks like text summarization and response generation. ([source](https://microsoft.github.io/promptflow/concepts/concept-tools.html))
- [Retrieval Augmented Generation](https://awesome-repositories.com/f/artificial-intelligence-ml/language-model-orchestration/retrieval-augmented-generation.md) — Implements retrieval augmented generation pipelines that ground model responses in external proprietary data. ([source](https://github.com/microsoft/promptflow/tree/main/examples))
- [LLM Application Frameworks](https://awesome-repositories.com/f/artificial-intelligence-ml/llm-application-frameworks.md) — Offers a comprehensive framework for building and deploying applications powered by large language models.
- [Prompt Engineering Environments](https://awesome-repositories.com/f/artificial-intelligence-ml/prompt-engineering-environments.md) — Provides a collaborative workspace for versioning, testing, and optimizing prompt templates with integrated execution traces.
- [Prompt Engineering Workflows](https://awesome-repositories.com/f/artificial-intelligence-ml/prompt-engineering-workflows.md) — Provides an environment for iterating on prompt templates through versioning, batch testing, and side-by-side comparison.
- [Prompt Templates](https://awesome-repositories.com/f/artificial-intelligence-ml/prompt-templates.md) — Implements a system for defining and managing reusable prompt structures using markdown files and structured metadata. ([source](https://github.com/microsoft/promptflow/blob/main/docs/how-to-guides/quick-start.md))
- [Visual AI Workflow Builders](https://awesome-repositories.com/f/artificial-intelligence-ml/visual-ai-workflow-builders.md) — Includes a graphical interface for connecting language models and custom code into executable pipelines.
- [Workflow Parsers and Validators](https://awesome-repositories.com/f/artificial-intelligence-ml/automation-workflows/yaml-based-workflows/workflow-parsers-and-validators.md) — Includes tools to check the structural integrity of workflow files and generate metadata for pipeline integration. ([source](https://microsoft.github.io/promptflow/reference/pf-command-reference.html))
- [RAG Pipelines](https://awesome-repositories.com/f/artificial-intelligence-ml/language-model-orchestration/retrieval-augmented-generation/rag-pipelines.md) — Facilitates the implementation of retrieval augmented generation pipelines by connecting models to vector databases.
- [LLM Response Streaming](https://awesome-repositories.com/f/artificial-intelligence-ml/llm-response-streaming.md) — Implements token-by-token streaming of AI model responses to reduce latency.
- [Model Response Streaming](https://awesome-repositories.com/f/artificial-intelligence-ml/model-response-parsers/model-response-aggregation/model-response-streaming.md) — Delivers model outputs incrementally to the client to improve perceived responsiveness. ([source](https://github.com/microsoft/promptflow/tree/main/examples))
- [Prompt Variant Experimentation](https://awesome-repositories.com/f/artificial-intelligence-ml/prompt-engineering/prompt-variant-experimentation.md) — Compares multiple prompt versions against a single dataset to analyze performance and token costs. ([source](https://github.com/microsoft/promptflow/blob/main/examples/tutorials/flow-fine-tuning-evaluation/promptflow-quality-improvement.md))

### Software Engineering & Architecture

- [Graph-Based Workflow Orchestrators](https://awesome-repositories.com/f/software-engineering-architecture/graph-based-workflow-orchestrators.md) — Orchestrates AI application logic using a directed graph of interconnected nodes. ([source](https://github.com/microsoft/promptflow/blob/main/README.md))
- [Directed Acyclic Graph Engines](https://awesome-repositories.com/f/software-engineering-architecture/directed-acyclic-graph-engines.md) — Structures application logic as a sequence of modular nodes in a directed acyclic graph.

### Content Management & Publishing

- [Prompt Metadata Schemas](https://awesome-repositories.com/f/content-management-publishing/plain-text-persistence/front-matter-data-models/prompt-metadata-schemas.md) — Uses markdown files with structured front matter to separate model configurations from prompt text.

### Development Tools & Productivity

- [Custom Tool Definitions](https://awesome-repositories.com/f/development-tools-productivity/ai-agent-development-tools/custom-tool-definitions.md) — Provides frameworks for defining, initializing, and validating the executable functions that AI agents invoke. ([source](https://microsoft.github.io/promptflow/reference/pf-command-reference.html))
- [Visual Flow Editors](https://awesome-repositories.com/f/development-tools-productivity/workflow-automation-triggers/ai-workflow-designers/visual-flow-editors.md) — Provides a visual AI workflow designer to build directed acyclic graphs of logic nodes. ([source](https://github.com/microsoft/promptflow/blob/main/README.md))
- [Prompt Batch Evaluators](https://awesome-repositories.com/f/development-tools-productivity/debugging-profiling-testing/test-execution-management/automated-test-execution/batch-test-runners/prompt-batch-evaluators.md) — Executes prompts across large datasets to evaluate response quality and accuracy using a collection of test entries. ([source](https://github.com/microsoft/promptflow/blob/main/examples/tutorials/flow-fine-tuning-evaluation/promptflow-quality-improvement.md))
- [Interactive Debugging and Testing](https://awesome-repositories.com/f/development-tools-productivity/developer-utilities-libraries/workflow-productivity-enhancers/developer-productivity-utilities/developer-experience/interactive-debugging-testing.md) — Offers an interactive environment to run workflows in real time for debugging and behavior validation. ([source](https://github.com/microsoft/promptflow/blob/main/README.md))

### DevOps & Infrastructure

- [AI Application Hosting](https://awesome-repositories.com/f/devops-infrastructure/cloud-infrastructure-deployment/managed-infrastructure-deployment/ai-application-hosting.md) — Packages developed workflows into executable services for hosting on cloud platforms. ([source](https://github.com/microsoft/promptflow/tree/main/examples))
- [Model Serving Endpoints](https://awesome-repositories.com/f/devops-infrastructure/model-serving-endpoints.md) — Hosts AI workflows as active API endpoints to handle real-time inference requests. ([source](https://microsoft.github.io/promptflow/reference/pf-command-reference.html))
- [CI/CD Pipeline Integrations](https://awesome-repositories.com/f/devops-infrastructure/ci-cd-pipeline-integrations.md) — Provides native support for automating quality checks and evaluation metrics within continuous integration and deployment workflows. ([source](https://github.com/microsoft/promptflow/blob/main/examples/tutorials/e2e-development/chat-with-pdf.md))
- [Container Deployment](https://awesome-repositories.com/f/devops-infrastructure/container-deployment.md) — Packages developed AI workflows into portable container images for consistent cloud and local deployment.
- [LLM Observability](https://awesome-repositories.com/f/devops-infrastructure/container-orchestration/container-runtimes/runtime-configuration-interfaces/docker-socket-orchestrators/docker-target-configurators/docker-container-deployments/llm-deployments/llm-observability.md) — Combines containerized deployment with stateful execution tracing for debugging and monitoring scalable AI services.

### Security & Cryptography

- [Unified API Connection Management](https://awesome-repositories.com/f/security-cryptography/unified-api-connection-management.md) — Provides a unified system to securely store and manage API keys and credentials for multiple external service providers. ([source](https://github.com/microsoft/promptflow#readme))

### System Administration & Monitoring

- [Agent Execution Trace Debugging](https://awesome-repositories.com/f/system-administration-monitoring/agent-execution-tracing/agent-execution-trace-debugging.md) — Records granular function calls and variable values to enable step-by-step debugging of agent behavior.
- [Pipeline Performance Evaluators](https://awesome-repositories.com/f/system-administration-monitoring/monitoring-and-observability/observability-platforms/metric-performance-monitors/pipeline-performance-evaluators.md) — Runs evaluation workflows against datasets to compute quality metrics for LLM performance.
- [Execution Tracing](https://awesome-repositories.com/f/system-administration-monitoring/monitoring-and-observability/execution-tracing-analysis/execution-tracing.md) — Records the sequence of operations and function calls during runtime to enable detailed debugging of AI components. ([source](https://microsoft.github.io/promptflow/how-to-guides/tracing/index.html))
- [Run Metadata Management](https://awesome-repositories.com/f/system-administration-monitoring/monitoring-and-observability/observability-platforms/distributed-tracing-execution-analysis/execution-run-apis/run-metadata-management.md) — Implements a system to trigger workflow executions and manage historical run metadata and archives. ([source](https://microsoft.github.io/promptflow/reference/pf-command-reference.html))

### Testing & Quality Assurance

- [LLM Evaluation](https://awesome-repositories.com/f/testing-quality-assurance/model-testing/llm-evaluation.md) — Implements metric-driven evaluation pipelines to measure the quality and accuracy of LLM responses using synthetic datasets.
- [Automated Agent Quality Assurance](https://awesome-repositories.com/f/testing-quality-assurance/automated-agent-quality-assurance.md) — Integrates LLM evaluation and testing processes into automated pipelines for consistent output quality. ([source](https://microsoft.github.io/promptflow/index.html))
- [Graph Logic Validation](https://awesome-repositories.com/f/testing-quality-assurance/graph-logic-validation.md) — Validates the correctness of computational graphs and agent configurations through a CLI or SDK. ([source](https://github.com/microsoft/promptflow/blob/main/docs/how-to-guides/quick-start.md))

### User Interface & Experience

- [Workflow Logic Nodes](https://awesome-repositories.com/f/user-interface-experience/visual-node-editors/node-execution-logic/python-logic-execution/workflow-logic-nodes.md) — Allows the integration of custom Python functions to process data and call APIs within a workflow. ([source](https://microsoft.github.io/promptflow/concepts/concept-tools.html))
- [Reasoning Step Visualizers](https://awesome-repositories.com/f/user-interface-experience/execution-trace-visualizers/reasoning-step-visualizers.md) — Generates visual snapshots of workflow steps to allow developers to inspect the reasoning process of the AI. ([source](https://github.com/microsoft/promptflow/blob/main/examples/tutorials/flow-fine-tuning-evaluation/promptflow-quality-improvement.md))

### Part of an Awesome List

- [Observability and Tracing](https://awesome-repositories.com/f/awesome-lists/devops/observability-and-tracing.md) — Tracks the flow of data and model interactions to identify errors and iterate on prompt designs. ([source](https://microsoft.github.io/promptflow/index.html))
- [Application Frameworks](https://awesome-repositories.com/f/awesome-lists/ai/application-frameworks.md) — Development suite for managing the lifecycle of AI applications.