support local image

[quanru]

No description provided.

[netlify]

✅ Deploy Preview for midscene ready!

Name	Link
🔨 Latest commit	41ccfb0
🔍 Latest deploy log	https://app.netlify.com/projects/midscene/deploys/695cf82130a55900081a25c2
😎 Deploy Preview	https://deploy-preview-1703--midscene.netlify.app
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify project configuration.

[Copilot]

Pull request overview

This PR adds support for directory-based report format with local image files, providing an alternative to the traditional single HTML file with embedded base64 images. This is particularly useful for large reports where embedding many base64 images can make the HTML file unwieldy.

Key Changes:

• Added useDirectoryReport option to agent configuration that generates reports with separate PNG screenshot files instead of embedded base64 data
• Implemented image extraction to script tags for improved memory performance when parsing large JSON dumps in traditional reports
• Added frontend support to restore image references from script tags

Reviewed changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
packages/core/src/types.ts	Added useDirectoryReport option to AgentOpt interface
packages/core/src/agent/agent.ts	Passes useDirectoryReport option to report writing logic
packages/core/src/utils.ts	Implements directory report generation, screenshot extraction to files, and image extraction to script tags for traditional reports
apps/report/src/utils/image-restoration.ts	New utility to load and restore image references from script tags in the frontend
apps/report/src/App.tsx	Integrates image restoration logic when loading dump data
packages/web-integration/tests/ai/web/puppeteer/directory-report.test.ts	New test suite validating directory-based report format
packages/web-integration/tests/ai/web/puppeteer/open-new-tab.test.ts	Explicitly disables directory report to maintain existing behavior
apps/site/docs/en/api.mdx	Documents the new useDirectoryReport option (English)
apps/site/docs/zh/api.mdx	Documents the new useDirectoryReport option (Chinese)

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 9 out of 9 changed files in this pull request and generated 15 comments.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 18 out of 18 changed files in this pull request and generated 15 comments.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 22 out of 22 changed files in this pull request and generated 6 comments.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[Copilot]

Pull request overview

Copilot reviewed 42 out of 44 changed files in this pull request and generated 13 comments.

Comments suppressed due to low confidence (1)

packages/core/src/agent/agent.ts:277

• Potential race condition: The screenshotScale is computed lazily and stored in screenshotScalePromise. If multiple calls to getScreenshotScale happen concurrently before the first one completes, all will create new promises and compute the scale multiple times. The second check on line 259 should happen after the promise settles. Consider using a proper once-only pattern or mutex.

  private async getScreenshotScale(
    rawContext: RawUIContextData,
  ): Promise<number> {
    if (this.screenshotScale !== undefined) {
      return this.screenshotScale;
    }

    if (!this.screenshotScalePromise) {
      this.screenshotScalePromise = (async () => {
        const pageWidth = rawContext.size?.width;
        assert(
          pageWidth && pageWidth > 0,
          `Invalid page width when computing screenshot scale: ${pageWidth}`,
        );

        debug('will get image info of base64');
        const { width: screenshotWidth } = await imageInfoOfBase64(
          rawContext.screenshotBase64,
        );
        debug('image info of base64 done');

        assert(

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.