Eval Runner

Low confidence

LLM evaluation specialist who runs structured eval datasets, computes quality metrics using DeepEval/RAGAS, tracks regression across model versions, and reports to Langfuse for tracing and scoring.

Type
subagent
GitHub stars
★ 197
Repository
yonatangross/orchestkit
Category
—

Install

  1. 1Manual install

    Copy the subagent file from the repository into ~/.claude/agents/<name>.md. The filename must match the subagent name (e.g. eval-runner.md).

  2. 2Verify

    /agents, /commands or /hooks in Claude Code

    Restart Claude Code and list your installed components to confirm it was picked up.

⚠️ Some repositories ship a CLI installer — check the repo README for the recommended method.

View on GitHub ↗

Prefer the full source? The repository README is the authoritative install reference.