Redesign autotest PR comments: inline reviews + clean format#2281
Draft
albabn wants to merge 10 commits into
Draft
Redesign autotest PR comments: inline reviews + clean format#2281albabn wants to merge 10 commits into
albabn wants to merge 10 commits into
Conversation
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Replace the single postPrComment method with three new methods: - postResults: dispatches findings to inline or issue comments - postIssueComment: posts a standard issue comment (GitHub/GitLab) - postInlineReviewComment: posts inline review comments on specific lines via the GitHub pull request review API, with fallback to issue comments on failure Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
…ge case tests Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
- Use parseAgentReport() to validate before capturing reportText, instead of greedy ```json check that matched intermediate messages - Prefer resultText (actual final output) over reportText from assistant messages when posting comments - Remove dead code checking for old ## Autotest: header - Remove unused zod import Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
validation_report.mdas a CI artifactBefore
Wall of text with multiple collapsed
<details>sections per comment.After
PASS: Brief explanation + stats + log link
FAIL with line: Inline review comment on the exact diff line with explanation
FAIL without line: Issue comment with bold title + explanation
Test plan
domains/ci-app/etc/ci/autotest-pipeline.yml🤖 Generated with Claude Code