Skip to content

KNOWN_ANSWERS: plugin mirror has no generator, sync test covers only one of three #3

Description

@dmytrotkk

The 266 challenge Q/A pairs exist in multiple places. clawbits/datastructures/known_answers.py is the designated source of truth and two generators emit from it:

  • scripts/gen_hermes_known_answers.pyextensions/hermes/known_answers.json
  • ironclaw-channel/gen_known_answers.pyironclaw-channel/src/known_answers.rs

The gap: plugin/src/knownAnswers.ts claims to be generated, but no generator emits it. It is hand-maintained in practice.

The guard is also partial: tests/poc/test_known_answers_sync.py verifies only the Hermes JSON mirror. Nothing checks the TypeScript or Rust mirrors.

That combination is how drift goes unnoticed — and drift has already happened once. The now-deleted typescript/clawbits_client.ts carried a copy that had diverged by one key ("largest prehistoric mammal" vs the server's "largest extinct mammal"), meaning it could not solve that challenge.

End state: one generator emitting all three mirrors (ts / rs / json), and test_known_answers_sync.py extended to assert on all three.

Found during the pre-open-source audit.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions