Repository navigation
[week-05] 26512071 - #267
Open
kimchyoungman wants to merge 25 commits into
Open
kimchyoungman wants to merge 25 commits into
kimchyoungman wants to merge 25 commits into
Conversation
Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
…four as week 04) Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…tiation, turn, and limit Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…et server Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…e runner measuring from the server event log Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ion pending runs Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…efusals Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…etions rejects function tools unless reasoning_effort='none' Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…5.6-luna accepts tools; move crashed run to failed/ Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ith gpt-5.6-luna Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ith gpt-5.6-luna Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…24 episodes, 0 crashes, 0 attempted violations Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…om Q&A on the results Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…OpenAI run Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
개요
week 04의 협상을 MCP 서버(마켓)로 옮겼습니다. 역할, negotiation, 차례, (server 조건에서는) 가격 한도를 서버가 발급한 bearer 토큰에 묶었습니다.
prompt_inject와server_inject를 시나리오 4개 × 3회 실행했습니다.결과 (
gpt-5.6-luna, 온도 0.2,reasoning_effort="none")[market notice]주입이 run마다 7~9번 전달됐지만 위반 시도는 0번이었습니다. 프롬프트 층에서 막혔고, 서버 층의 한도 거부는auth_checks.txt(4)로만 확인했습니다.refuse없이 8수 제한까지 가서open으로 끝났습니다. 그래서 correct가 6/12입니다.과정
failed/reasoning-effort-crash/에 보존했습니다.host.py가 OpenAI에서reasoning_effort="none"을 보내도록 고친 뒤 다시 실행했습니다.확인
python scripts/check_week05.py submissions/26512071/week-05: all checks passedpython -m unittest test_market: 7개 통과🤖 Generated with Claude Code