Skip to content

test: add cluster performance benchmark#8

Merged
huntharo merged 5 commits into
mainfrom
codex/add-cluster-perf-regression-test
Mar 12, 2026
Merged

test: add cluster performance benchmark#8
huntharo merged 5 commits into
mainfrom
codex/add-cluster-perf-regression-test

Conversation

@huntharo
Copy link
Copy Markdown
Contributor

Summary

  • add a deterministic cluster performance integration benchmark that exercises the real clusterRepository path against a synthetic file-backed SQLite fixture
  • run the benchmark in CI and publish a GitHub Actions step summary with the current fixture time, projected openclaw/openclaw cluster duration, and change vs baseline
  • fail the perf step when the measured regression exceeds the configured threshold in the committed baseline file

Details

The benchmark uses pre-seeded fake embeddings and does not call GitHub or OpenAI. It stays within the intended short runtime budget by sampling repeated rebuilds of a 512-thread fixture for up to about 10 seconds.

The committed baseline is currently:

  • fixture median: 239.1 ms
  • projected openclaw/openclaw cluster duration: 10m 0.0s
  • regression threshold: +50%

That threshold is intentionally conservative for the first pass because the baseline was bootstrapped locally rather than on a GitHub Actions runner.

Verification

  • pnpm --filter @ghcrawl/api-contract build && pnpm --filter @ghcrawl/api-core typecheck
  • pnpm --filter @ghcrawl/api-core test
  • pnpm --filter @ghcrawl/api-core test:cluster-perf

@huntharo huntharo merged commit ab15925 into main Mar 12, 2026
8 checks passed
@huntharo huntharo deleted the codex/add-cluster-perf-regression-test branch March 12, 2026 13:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant