BDD Test Runner & Compliance Validator
Executes GIVEN-WHEN-THEN tests with compliance validation and coverage analysis.
Instructions
1. Understand Test Request
Common requests:
- "Run all tests" →
./gradlew test
- "Run compiler tests" →
./gradlew :compiler:test
- "Run specific tests" →
./gradlew :compiler:test --tests "*Pattern*"
- "Validate test naming" → BDD compliance check only
- "Check coverage" → Coverage analysis
2. Pre-Execution BDD Compliance Check
Unit tests live in compiler/, codegen-runtime/, gradle-plugin/, compiler-api/ and build-logic/ (src/test/kotlin); sample tests live under samples/*/src/*Test/.
TEST_DIRS="compiler/src/test codegen-runtime/src/test gradle-plugin/src/test compiler-api/src/test build-logic/src/test"
# Count GIVEN-WHEN-THEN tests
grep -rh "fun \`GIVEN" $TEST_DIRS | wc -l
# Forbidden "should" naming — expect zero matches
grep -rn "fun \`should" $TEST_DIRS
Compliance checklist:
If violations found — report and do not proceed until acknowledged:
BDD COMPLIANCE VIOLATION
Found {count} tests using "should" pattern (forbidden)
Files: {list}
Reference: .claude/docs/development/validation/testing-guidelines.md
3. Execute Tests
# All tests (from the repository root)
./gradlew test
# One module (:compiler, :codegen-runtime, :gradle-plugin, :compiler-api)
./gradlew :codegen-runtime:test
# Pattern-based
./gradlew :compiler:test --tests "*{Pattern}*"
# Samples (built against the published plugin)
make publish-local && make test-sample
4. Analyze Results
Parse output: total run, passed, failed, skipped, execution time.
If failures: categorize each failure and suggest relevant skills:
- Compilation errors →
compilation skill
- Test logic errors → fix test or implementation
- Missing imports → check generated code
5. Coverage Analysis
List source files with no matching *Test.kt in the module you changed (a heuristic — some classes are covered through other tests):
MODULE=codegen-runtime # or compiler, gradle-plugin, compiler-api
find $MODULE/src/main/kotlin -name "*.kt" | while read file; do
testFile="${file/src\/main/src\/test}"
testFile="${testFile/.kt/Test.kt}"
if [ ! -f "$testFile" ]; then
echo "Missing tests for: $file"
fi
done
6. Report
BDD TEST EXECUTION REPORT
Compliance: {PASSED/FAILED}
- GIVEN-WHEN-THEN naming: {count}/{total} ✅
- "should" violations: {count}
Execution:
- Total: {n} | Passed: {n} | Failed: {n} | Skipped: {n}
- Time: {duration}
Coverage:
- Implementation files: {n} | Test files: {n}
- Coverage gaps: {list if any}
Follow-up suggestions:
- If coverage gaps → offer to write GIVEN-WHEN-THEN tests for them
- If failures → suggest fixes or relevant skills
Related Skills
compilation — Validate code compiles