Promptfoo Evaluation Overview This skill provides guidance for configuring and running LLM evaluations using Promptfoo, an open-source CLI tool for testing and comparing LLM outputs. Quick Start Configuration Structure A typical Promptfoo project structure: Core Configuration (promptfooconfig.yaml) Prompt Formats Text Prompt (system.md) Chat Format (chat.json) Few-Shot Pattern Embed examples directly in prompt or use chat format with assistant messages: Test Cases (tests/cases.yaml) Python Custom Assertions Create a Python file for custom assertions (e.g., ): Key points: - Default function na…