Skill Tester Validates all interactive (non-CI) skills in this repo. Runs the Anthropic skill-creator's plus project-specific checks. When to Use - After adding or modifying a skill - Before committing changes - Before submitting the plugin for Anthropic review - As part of the outer loop when eval-creator needs to verify skill quality Checks 1. Anthropic Spec Validation Run on every skill in (excluding variants): Pass criteria: Exit code 0 for every skill. Frontmatter has only allowed keys ( , , , , , ). Name is kebab-case, max 64 chars. Description max 1024 chars, no angle brackets. 2. Proj…

\\n'\n}\n\necho \"## Skill Test Results\"\necho\necho \"**Date:** $(date +%Y-%m-%d)\"\n\nif [ -n \"$1\" ]; then\n # Test single skill\n if [ -d \"$SKILLS_DIR/$1\" ]; then\n check_skill \"$SKILLS_DIR/$1\"\n else\n echo \"Skill not found: $1\"\n exit 1\n fi\nelse\n # Test all\n check_instruction_files\n for d in \"$SKILLS_DIR\"/*/; do\n check_skill \"$d\"\n done\nfi\n\necho \"**Skills tested:** $tested\"\necho \"**Passed:** $pass\"\necho \"**Warnings:** $warn\"\necho \"**Failed:** $((fail + instruction_fail))\"\nif [ -z \"$1\" ]; then\n echo \"**Instruction files:** $instruction_status\"\nfi\necho\n\nif [ $((fail + instruction_fail)) -gt 0 ]; then\n echo \"### Failures\"\n echo -e \"$failures\"\n echo\nfi\n\nif [ $warn -gt 0 ]; then\n echo \"### Warnings\"\n echo -e \"$warnings\"\n echo\nfi\n\nif [ $pass -gt 0 ]; then\n echo \"### Passed\"\n while IFS= read -r skill; do\n [ -n \"$skill\" ] || continue\n echo \" ✓ $skill\"\n done \u003c\u003c\u003c \"$passed_skills\"\nfi\n\nexit $((fail + instruction_fail))\n","content_type":"application/x-sh; charset=utf-8","language":"bash","size":4895,"content_sha256":"38ed59ec41e56b1c71643c025e1d78f702c0706aeb58b77efea98e24ff2026c7"}],"content_json":{"type":"doc","content":[{"type":"heading","attrs":{"level":1},"content":[{"text":"Skill Tester","type":"text"}]},{"type":"paragraph","content":[{"text":"Validates all interactive (non-CI) skills in this repo. Runs the Anthropic skill-creator's ","type":"text"},{"text":"quick_validate.py","type":"text","marks":[{"type":"code_inline"}]},{"text":" plus project-specific checks.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"When to Use","type":"text"}]},{"type":"bullet_list","content":[{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"After adding or modifying a skill","type":"text"}]}]},{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"Before committing changes","type":"text"}]}]},{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"Before submitting the plugin for Anthropic review","type":"text"}]}]},{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"As part of the outer loop when eval-creator needs to verify skill quality","type":"text"}]}]}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Checks","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"1. Anthropic Spec Validation","type":"text"}]},{"type":"paragraph","content":[{"text":"Run ","type":"text"},{"text":"quick_validate.py","type":"text","marks":[{"type":"code_inline"}]},{"text":" on every skill in ","type":"text"},{"text":"skills/","type":"text","marks":[{"type":"code_inline"}]},{"text":" (excluding ","type":"text"},{"text":"-ci","type":"text","marks":[{"type":"code_inline"}]},{"text":" variants):","type":"text"}]},{"type":"code_block","attrs":{"wrap":false,"language":"bash"},"content":[{"text":"for d in skills/*/; do\n skill=$(basename \"$d\")\n [[ \"$skill\" == *-ci ]] && continue\n python3 .claude/skills/skill-creator/scripts/quick_validate.py \"$d\"\ndone","type":"text"}]},{"type":"paragraph","content":[{"text":"Pass criteria:","type":"text","marks":[{"type":"strong"}]},{"text":" Exit code 0 for every skill. Frontmatter has only allowed keys (","type":"text"},{"text":"name","type":"text","marks":[{"type":"code_inline"}]},{"text":", ","type":"text"},{"text":"description","type":"text","marks":[{"type":"code_inline"}]},{"text":", ","type":"text"},{"text":"license","type":"text","marks":[{"type":"code_inline"}]},{"text":", ","type":"text"},{"text":"allowed-tools","type":"text","marks":[{"type":"code_inline"}]},{"text":", ","type":"text"},{"text":"metadata","type":"text","marks":[{"type":"code_inline"}]},{"text":", ","type":"text"},{"text":"compatibility","type":"text","marks":[{"type":"code_inline"}]},{"text":"). Name is kebab-case, max 64 chars. Description max 1024 chars, no angle brackets.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"2. Project Convention Checks","type":"text"}]},{"type":"paragraph","content":[{"text":"For each skill directory:","type":"text"}]},{"type":"table","attrs":{"layout":null},"content":[{"type":"tr","content":[{"type":"th","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Check","type":"text"}]}]},{"type":"th","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Rule","type":"text"}]}]},{"type":"th","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Severity","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Name matches folder","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Frontmatter ","type":"text"},{"text":"name","type":"text","marks":[{"type":"code_inline"}]},{"text":" == directory name","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Error","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Line limit","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"SKILL.md at or under 600 lines","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Error","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"No README.md","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Skill folders must not contain README.md","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Error","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Scripts executable","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"All ","type":"text"},{"text":".sh","type":"text","marks":[{"type":"code_inline"}]},{"text":" files in ","type":"text"},{"text":"scripts/","type":"text","marks":[{"type":"code_inline"}]},{"text":" must have execute permission","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Error","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"References exist","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Files referenced in SKILL.md body actually exist in ","type":"text"},{"text":"references/","type":"text","marks":[{"type":"code_inline"}]},{"text":" (agent-performed — not covered by run-tests.sh)","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Warning","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Description non-empty","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Description field is present and non-empty","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Error","type":"text"}]}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"3. Instruction File Validation","type":"text"}]},{"type":"paragraph","content":[{"text":"Validate this finite instruction-file set:","type":"text"}]},{"type":"bullet_list","content":[{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"CLAUDE.md","type":"text","marks":[{"type":"code_inline"}]}]}]},{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"AGENTS.md","type":"text","marks":[{"type":"code_inline"}]}]}]},{"type":"list_item","content":[{"type":"paragraph","content":[{"text":".github/copilot-instructions.md","type":"text","marks":[{"type":"code_inline"}]}]}]}]},{"type":"paragraph","content":[{"text":"AGENTS.md","type":"text","marks":[{"type":"code_inline"}]},{"text":" and ","type":"text"},{"text":"CLAUDE.md","type":"text","marks":[{"type":"code_inline"}]},{"text":" must be byte-identical. The Copilot file may use provider-specific framing but must retain the same durable principles.","type":"text"}]},{"type":"paragraph","content":[{"text":"Do not require instruction files to enumerate every skill. Those inventories go stale and contradict this repository's instruction-file conventions. Validate only deliberate skill references in workflow prose: when a named skill is referenced, its canonical directory must exist. The public catalog in ","type":"text"},{"text":"README.md","type":"text","marks":[{"type":"code_inline"}]},{"text":" is maintained and validated separately from agent instructions.","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"4. Hook Script Testing","type":"text"}]},{"type":"paragraph","content":[{"text":"For each skill with a ","type":"text"},{"text":"scripts/","type":"text","marks":[{"type":"code_inline"}]},{"text":" directory:","type":"text"}]},{"type":"code_block","attrs":{"wrap":false,"language":"bash"},"content":[{"text":"# Syntax check\nbash -n scripts/*.sh\n\n# Verify bash shebang (either form used in this repo)\nhead -1 scripts/*.sh | grep -qE \"^#!(/bin/bash|/usr/bin/env bash)\"\n\n# Verify executable\ntest -x scripts/*.sh","type":"text"}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"5. Plugin Skill Validation (agent-performed — not covered by run-tests.sh)","type":"text"}]},{"type":"paragraph","content":[{"text":"For skills that exist in both ","type":"text"},{"text":"skills/","type":"text","marks":[{"type":"code_inline"}]},{"text":" and ","type":"text"},{"text":"plugin/skills/","type":"text","marks":[{"type":"code_inline"}]},{"text":":","type":"text"}]},{"type":"table","attrs":{"layout":null},"content":[{"type":"tr","content":[{"type":"th","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Check","type":"text"}]}]},{"type":"th","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Rule","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Plugin frontmatter keys","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Only Claude Code-specific keys (","type":"text"},{"text":"hooks","type":"text","marks":[{"type":"code_inline"}]},{"text":", ","type":"text"},{"text":"user-invocable","type":"text","marks":[{"type":"code_inline"}]},{"text":", ","type":"text"},{"text":"argument-hint","type":"text","marks":[{"type":"code_inline"}]},{"text":") added beyond spec","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Content alignment","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Body content matches or plugin has extracted references","type":"text"}]}]}]},{"type":"tr","content":[{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"Beta markers consistent","type":"text"}]}]},{"type":"td","attrs":{"colspan":1,"rowspan":1,"colwidth":null,"alignment":null},"content":[{"type":"paragraph","content":[{"text":"If ","type":"text"},{"text":"skills/","type":"text","marks":[{"type":"code_inline"}]},{"text":" copy has ","type":"text"},{"text":"[Beta]","type":"text","marks":[{"type":"code_inline"}]},{"text":", plugin copy should too","type":"text"}]}]}]}]},{"type":"heading","attrs":{"level":3},"content":[{"text":"6. Portable Agent Plugins Validation (agent-performed — not covered by run-tests.sh)","type":"text"}]},{"type":"paragraph","content":[{"text":"After regenerating with ","type":"text"},{"text":"./scripts/sync-plugin.sh","type":"text","marks":[{"type":"code_inline"}]},{"text":", run:","type":"text"}]},{"type":"code_block","attrs":{"wrap":false,"language":"bash"},"content":[{"text":"python3 scripts/test-sync-plugin.py\nuv run --with jsonschema==4.25.1 --with PyYAML==6.0.3 \\\n python3 scripts/validate-agent-plugin.py","type":"text"}]},{"type":"paragraph","content":[{"text":"This validates the portable manifest against the vendored official Agent Plugins 1.0.0 schema, checks curated skill membership, rejects non-portable frontmatter, verifies canonical bytes and executable modes, and enforces release-version alignment. Use the Agent Skills reference CLI for an independent format check of generated ","type":"text"},{"text":"agent-plugin/skills/*","type":"text","marks":[{"type":"code_inline"}]},{"text":".","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Output Format","type":"text"}]},{"type":"code_block","attrs":{"wrap":false,"language":"markdown"},"content":[{"text":"## Skill Test Results\n\n**Date:** YYYY-MM-DD\n**Skills tested:** N\n**Passed:** N\n**Warnings:** N\n**Failed:** N\n**Instruction files:** passed|failed\n\n### Failures\n- [skill-name]: [check]: [error message]\n\n### Warnings\n- [skill-name]: [check]: [warning message]\n\n### Passed\n- [list of clean skills]","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"Running","type":"text"}]},{"type":"paragraph","content":[{"text":"Invoke manually:","type":"text"}]},{"type":"code_block","attrs":{"wrap":false,"language":""},"content":[{"text":"/skill-tester","type":"text"}]},{"type":"paragraph","content":[{"text":"Or run the script directly:","type":"text"}]},{"type":"code_block","attrs":{"wrap":false,"language":"bash"},"content":[{"text":"bash skills/skill-tester/scripts/run-tests.sh","type":"text"}]},{"type":"paragraph","content":[{"text":"Coverage note: ","type":"text"},{"text":"run-tests.sh","type":"text","marks":[{"type":"code_inline"}]},{"text":" automates Checks 1-4 (minus the references-exist portion of Check 2 and provider-specific semantic comparison in Check 3). Checks 5-6 and those semantic/reference checks are performed by the agent when ","type":"text"},{"text":"/skill-tester","type":"text","marks":[{"type":"code_inline"}]},{"text":" is invoked -- a green script run alone does not mean they passed.","type":"text"}]},{"type":"heading","attrs":{"level":2},"content":[{"text":"What This Skill Does NOT Do","type":"text"}]},{"type":"bullet_list","content":[{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"Does not test CI skills (use ","type":"text"},{"text":"skill-tester-ci","type":"text","marks":[{"type":"code_inline"}]},{"text":" for those)","type":"text"}]}]},{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"Does not modify skills — reports findings only","type":"text"}]}]},{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"Does not run behavioral evals (trigger testing) — use skill-creator's ","type":"text"},{"text":"run_eval.py","type":"text","marks":[{"type":"code_inline"}]},{"text":" for that","type":"text"}]}]},{"type":"list_item","content":[{"type":"paragraph","content":[{"text":"Does not replace the eval-creator regression framework — this tests skill structure, not promoted rules","type":"text"}]}]}]}]},"metadata":{"date":"2026-06-05","name":"skill-tester","author":"@skillopedia","source":{"stars":196,"repo_name":"pskoett-ai-skills","origin_url":"https://github.com/pskoett/pskoett-ai-skills/blob/HEAD/skills/skill-tester/SKILL.md","repo_owner":"pskoett","body_sha256":"e0c3aab2f029c8c05141cad5fe514f9261461fde606d250b05c0f748481c5b18","cluster_key":"43523978d0d9ca508a27229d46e9e0b5e85acc79fa3c69deedcc02713522284c","refresh_tag":"upstream-refresh-2026-11","clean_bundle":{"format":"clean-skill-bundle-v1","source":"pskoett/pskoett-ai-skills/skills/skill-tester/SKILL.md","bundle_sha256":"4404f92c1f93ec55c67c14f41712b34ab50bcde485b116d98b3d3303578476de","attachment_count":1,"text_attachments":1,"attachment_storage":"skill_attachments","binary_attachments":0},"cluster_size":1,"refreshed_at":"2026-11-02T23:25:39.665Z","skill_md_path":"skills/skill-tester/SKILL.md","import_metadata":{"date":"2026-06-05","author":"@skillopedia","version":"v1","category":"testing-qa","category_label":"Testing"},"upstream_commit":"878b0e48bca74849c6219815882e75e60cfa2b72","exact_dupes_collapsed_into_this":0},"version":"v1","category":"testing-qa","import_tag":"clean-skills-v1","description":"Validates all interactive skills in this repo against the Agent Skills spec, project conventions, and structural requirements. Runs quick_validate.py, checks line limits, verifies cross-references, and tests hook scripts. Use when skills have been added or modified and you want to verify everything passes before committing or submitting."}},"renderedAt":1794680054282}

Skill Tester Validates all interactive (non-CI) skills in this repo. Runs the Anthropic skill-creator's plus project-specific checks. When to Use - After adding or modifying a skill - Before committing changes - Before submitting the plugin for Anthropic review - As part of the outer loop when eval-creator needs to verify skill quality Checks 1. Anthropic Spec Validation Run on every skill in (excluding variants): Pass criteria: Exit code 0 for every skill. Frontmatter has only allowed keys ( , , , , , ). Name is kebab-case, max 64 chars. Description max 1024 chars, no angle brackets. 2. Proj…