promptfoo

About promptfoo

Promptfoo: LLM evals & red teaming promptfoo is a CLI and library for evaluating and red-teaming LLM apps. Stop the trial-and-error approach - start shipping secure, reliable AI apps. Website · Getting Started · Red Teaming · Documentation · Discord Update (March 16, 2026): Promptfoo has joined OpenAI. Promptfoo remains open source and MIT licensed. Read the [company update](https://www.promptfoo.dev/

ci ci-cd cicd evaluation evaluation-framework llm llm-eval llm-evaluation llm-evaluation-framework llmops

Quick Facts

Stars	25,052
Forks	2,298
Language	TypeScript
Category	AI Tool
License	MIT
Quality Score	67.4141316700621/100
Open Issues	650
Last Updated	2026-09-13
Created	2023-04-28
Platforms	claude-code, gemini, node
Est. Tokens	~15k

Compatible Skills

These tools work well together with promptfoo for enhanced workflows:

lmnr — semantic(0.18)+complementary+rare_topics+same_lang+similar_pop+shared_platform (65%)
agentuse — semantic(0.22)+complementary+shared_fw(anthropic,openai)+same_lang+shared_platform (64%)
agiflow-sdks — semantic(0.25)+complementary+rare_topics+same_lang+shared_platform (53%)
eval-view — semantic(0.22)+complementary+shared_fw(anthropic,openai)+rare_topics (53%)

More AI Tool Tools

Explore other popular ai tool tools:

stagehand ⭐ 24.3k
gorilla ⭐ 13.0k
PocketFlow-Tutorial-Codebase-Knowledge ⭐ 12.6k
llm ⭐ 12.5k
phoenix ⭐ 11.4k
llm-engineer-toolkit ⭐ 10.8k
code2prompt ⭐ 7.6k
superagent ⭐ 6.7k
ai-cookbook ⭐ 4.4k
DecryptPrompt ⭐ 3.4k

View all AI Tool tools →

Popular TypeScript Agent Tools

openclaw ⭐ 389.5k · Codex Skill
n8n ⭐ 204.1k · MCP Server
dify ⭐ 155.6k · MCP Server
gstack ⭐ 132.8k · Agent Tool
gemini-cli ⭐ 106.9k · MCP Server

Frequently Asked Questions

What is promptfoo?

promptfoo is Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line . It is categorized as a AI Tool with 25.1k GitHub stars.

What programming language is promptfoo written in?

promptfoo is primarily written in TypeScript. It covers topics such as ci, ci-cd, cicd.

How do I install or use promptfoo?

You can find installation instructions and usage details in the promptfoo GitHub repository at github.com/promptfoo/promptfoo. The project has 25.1k stars and 2298 forks, indicating an active community.

What license does promptfoo use?

promptfoo is released under the MIT license, making it free to use and modify according to the license terms.

View on GitHub → Browse AI Tool tools