RAG Eval

What it is

Runs a fixed set of questions against a retrieval pipeline and reports two numbers: whether the expected document appeared, and whether the answer cited it. Both matter, because a system that retrieves the right document and cites a different one is worse than it looks in a demo.

Install

Clone the repository, then copy the skill folder into your agent's skills directory — ~/.claude/skills/ for Claude Code. Skills are plain files: no build step, no daemon.

npx skills add rag-eval

How to judge it

Read the SKILL.md before you install. A good skill states when it applies, what it must not do, and how to verify the result. A skill that only lists adjectives will change the agent's tone without improving its output — skip those.

Other research skills

• Competitor Scan — Collects what changed on a competitor's site since the last scan.
• SQL Analyst — Turns a business question into one reviewed query.
• Data Cleaning — Profiles a messy CSV and reports what would break a join.