Mockserver is a multi-protocol mock server and API verification proxy used to simulate HTTP, gRPC, and WebSocket endpoints. It functions as a tool for testing client applications without relying on live backend services, providing a system to simulate chat completions and streaming responses for large language model integrations. The project automates behavior by generating request expectations and response behaviors from OpenAPI and Swagger specification files. It differentiates itself through a network traffic simulator that introduces latency, dropped connections, and failures to verify ho
Promptfoo is an evaluation framework designed for testing, benchmarking, and red-teaming language models and agentic workflows. It provides a unified environment to run prompts against multiple providers, allowing developers to systematically validate model outputs against objective assertions, semantic similarity metrics, and custom grading rubrics. The platform distinguishes itself through a provider-agnostic execution layer and a stateful orchestrator capable of simulating multi-turn conversations and complex tool-use trajectories. It includes a dedicated adversarial mutation pipeline that
Simulate agent workflows and verify behavior without burning tokens.
AI Evaluation Framework
The main features of evaliphy/evaliphy are: AI and LLM Testing.
Open-source alternatives to evaliphy/evaliphy include: mock-server/mockserver — Mockserver is a multi-protocol mock server and API verification proxy used to simulate HTTP, gRPC, and WebSocket… jwekavanagh/agentskeptic — Tool effects vs read-only store facts. promptfoo/promptfoo — Promptfoo is an evaluation framework designed for testing, benchmarking, and red-teaming language models and agentic… tenro-ai/tenro-python — Simulate agent workflows and verify behavior without burning tokens. voicetestdev/voicetest — Test harness for voice agents. Import from Retell, VAPI, Bland, LiveKit. Run autonomous simulations. Evaluate with LLM…
