Promptfoo

Promptfoo is a flexible tool built to improve the reliability and security of Large Language Model (LLM) applications. Developers can perform custom vulnerability testing with this open-source tool, guaranteeing that your AI product avoids potential threats and operates at peak efficiency. Promptfoo enables quick detection and resolution of application-specific risks, delivering a more secure user experience. Its thorough evaluation capabilities simplify the development workflow, cutting down on time and resources while enhancing the quality and dependability of your AI systems.

Promptfoo is an open-source AI security testing tool now part of OpenAI. It enables developers and enterprises to build secure, reliable AI applications through automated red teaming, vulnerability scanning, and continuous monitoring. Integrated into CI/CD pipelines and developer workflows, Promptfoo simulates real users to uncover application-specific vulnerabilities such as prompt injections, jailbreaks, data/PII leaks, business rule violations, insecure tool use, and toxic content generation. Trusted by 156 Fortune 500 companies and backed by a community of over 272 contributors and 300k+ users, it provides real-time threat intelligence and actionable remediation guidance directly in pull requests.