compare-trials
FreeAnalyze graded `trial_result` JSONL outputs from the eval pipeline, including reliability and custom slicing.
The English summary is being prepared. Showing the original description.
Interview the user relentlessly about a plan or design until reaching shared understanding, resolving each branch of the decision tree. Use when user wants to stress-test a plan, get grilled on their design, or mentions "grill me".
The English summary is being prepared. Showing the original description.
See how to installReview the instructions the agent will receive before you install.
Interview me relentlessly about every aspect of this plan until we reach a shared understanding. Walk down each branch of the design tree, resolving dependencies between decisions one-by-one. For each question, provide your recommended answer.
Ask the questions one at a time.
If a question can be answered by exploring the codebase, explore the codebase instead.
No reviews yet. Tell others what you thought.
No login needed. Share how it worked for you, ask a question, or note where it did not run.
No comments yet. Be the first to write one.
Analyze graded `trial_result` JSONL outputs from the eval pipeline, including reliability and custom slicing.
The English summary is being prepared. Showing the original description.
Use test-driven development for behavior-changing feature or fix work, and whenever the user mentions TDD, test-first, red-green-refactor, tracer bullets, integration tests, or public-interface behavior tests. Skip for docs-only, path-only rename, formatting-only, or purely mechanical chores unless explicitly requested.
The English summary is being prepared. Showing the original description.
Build command-only adapters for `eval` run mode using strict stdin/stdout JSON contracts.
The English summary is being prepared. Showing the original description.
End-to-end eval-suite orchestration with the `eval` command: run -> grade -> compare -> calibrate, using strict JSON contracts and schema discovery.
The English summary is being prepared. Showing the original description.