Repository navigation
ios-device: expose screenshot (client support already implemented) #103
Description
Activity
Shipped in #118 — with one design change from this proposal: capture goes over CoreDevice (
xcrun devicectl device capture screenshot) rather than the audit channel'scaptureScreenshot(). That turned out strictly better: no development-signing requirement (SpringBoard and system apps capture fine), ~2.8 s end-to-end, and no DTX session to tear down. The scale/rotation-metadata note is moot on this path (dimensions live in the PNG itself).AXAuditClient.captureScreenshot()remains implemented but unexposed. README and SKILL rule 4 were updated in the same PR.
Context
PR #99 ships the experimental
ios-devicesurface (devices/ui/tap). The accessibility audit channel exposes no element geometry, but it does serve screenshots:AXAuditClient.captureScreenshot()(selectordeviceCaptureScreenshot) is already implemented and returns PNG data plusdisplayNativeScaleandrotationRadians— it just isn't wired to any CLI verb.Proposal
Add
sim-use ios-device screenshot --output <path>, mirroring the simulator verb's flag vocabulary where it applies.Notes
uioutline, a screenshot is the main way an agent can visually ground what the labels describe — likely the highest-value follow-up on this surface.skills/sim-use/SKILL.mdrule 4, which currently list screenshot as unavailable here.