|
1 | 1 | # @artemiskit/cli |
2 | 2 |
|
| 3 | +## 0.2.4 |
| 4 | + |
| 5 | +### Patch Changes |
| 6 | + |
| 7 | +- 16604a6: ## New Features |
| 8 | + |
| 9 | + ### Validate Command |
| 10 | + |
| 11 | + New `artemiskit validate` command for validating scenario files without running them: |
| 12 | + |
| 13 | + - **YAML syntax validation** - Catches formatting errors |
| 14 | + - **Schema validation** - Validates against ArtemisKit schema using Zod |
| 15 | + - **Semantic validation** - Detects duplicate case IDs, undefined variables |
| 16 | + - **Warnings** - Identifies deprecated fields, missing descriptions, performance hints |
| 17 | + |
| 18 | + Options: |
| 19 | + |
| 20 | + - `--json` - Output results as JSON |
| 21 | + - `--strict` - Treat warnings as errors |
| 22 | + - `--quiet` - Only show errors |
| 23 | + - `--export junit` - Export to JUnit XML for CI integration |
| 24 | + |
| 25 | + ### JUnit XML Export |
| 26 | + |
| 27 | + Added JUnit XML export support for CI/CD integration with Jenkins, GitHub Actions, GitLab CI, and other systems: |
| 28 | + |
| 29 | + - `akit run scenarios/ --export junit` - Export run results |
| 30 | + - `akit redteam scenarios/chatbot.yaml --export junit` - Export security test results |
| 31 | + - `akit validate scenarios/ --export junit` - Export validation results |
| 32 | + |
| 33 | + JUnit reports include: |
| 34 | + |
| 35 | + - Test suite metadata (run ID, provider, model, success rate) |
| 36 | + - Individual test cases with pass/fail status |
| 37 | + - Failure details with matcher type and expected values |
| 38 | + - Timing information for each test |
| 39 | + |
| 40 | +- Updated dependencies [16604a6] |
| 41 | + - @artemiskit/core@0.2.4 |
| 42 | + - @artemiskit/reports@0.2.4 |
| 43 | + - @artemiskit/adapter-openai@0.1.11 |
| 44 | + - @artemiskit/adapter-vercel-ai@0.1.11 |
| 45 | + - @artemiskit/redteam@0.2.4 |
| 46 | + |
3 | 47 | ## 0.2.3 |
4 | 48 |
|
5 | 49 | ### Patch Changes |
|
0 commit comments