Skip to content

Add Playwright E2E test suite validating the Hugo upgrade - #746

Open
rossigee wants to merge 4 commits into
goharbor:mainfrom
rossigee:split/playwright-e2e
Open

Add Playwright E2E test suite validating the Hugo upgrade#746
rossigee wants to merge 4 commits into
goharbor:mainfrom
rossigee:split/playwright-e2e

Conversation

@rossigee

Copy link
Copy Markdown

Summary

Split out from #731 per review feedback. Depends on #745 (Hugo/Bulma upgrade) - this branch is built on top of it, so the diff below includes #745's commits until that one merges; only the last commit here is unique to this PR.

  • e2e/breaking-changes.spec.ts covers the breaking-change fixes from the Hugo/Bulma upgrade: admonition markdownify, disableKinds taxonomy/term pages, the _redirects custom output format, and the css.Sass CSS pipeline (fingerprinted output, computed styles applied)
  • .github/workflows/test.yml: build -> test -> lint pipeline, Hugo 0.163.3 pinned via peaceiris/actions-hugo, Playwright browsers installed in CI
  • make test / make test-ui targets, README section documenting them
  • .gitignore: test-results/, playwright-report/

These tests assert against the upgraded Hugo/CSS output and would fail against current main, which is why this can't land independently of #745.

Related

Part of the work originally proposed in #731, split per @OrlinVasilev's review request. Depends on #745 (Hugo/Bulma upgrade). See also #744 (misc cleanup, independent).

Test plan

  • Diff-reviewed against the test spec for correctness; local full E2E execution was blocked in this session by an unrelated sandbox-level Node permission issue in the build environment, not something in this PR - worth confirming in CI

rossigee added 4 commits July 20, 2026 13:15
Breaking changes fixed:
- markdownify on template.HTML: cast with `| string |` in admonition.html
- disableKinds: rename taxonomyTerm to term in config.toml
- mediaTypes: replace delimiter with suffixes array
- toCSS -> css.Sass, .Site.IsServer -> hugo.IsServer in css.html
- Remove unused version.html shortcode

Bulma 1.0.4 drops LibSass support, so this also:
- Installs Dart Sass via scripts/setup-dart-sass.sh (Hugo needs the
  real executable, not the npm JS wrapper), invoked from `make serve`
  and exported onto PATH from the Makefile for production builds
- Rewrites assets/sass/*.sass into a single style.scss, loading
  Bulma's precompiled CSS via CDN (its own Sass build no longer
  needs LibSass/Dart Sass) and layering only site-specific
  overrides/CSS custom properties on top
- Removes yarn.lock in favor of npm (package-lock.json only)
- Adds a Dockerfile pinned to Hugo 0.163.3 + Node 20 for local/CI
  parity with Netlify

Note: layouts/partials/{navbar,social-buttons}.html,
layouts/_default/baseof.html, layouts/partials/docs/{menu,sidebar}.html
are intentionally untouched here - upstream/main already carries its
own .File nil-guards and its own dark-mode/theme-toggle and CLI-docs
nav features (added independently since this work was branched), so
re-copying the stale versions from the original PR branch would have
reverted already-shipped upstream work.

Verified: `make production-build` succeeds cleanly against current
upstream/main (2261 pages, 0 errors, only pre-existing deprecation
warnings unrelated to this change).

Signed-off-by: Ross Golder <ross@golder.org>
The single-file style.scss rewrite dropped these two partials
entirely, even though the JS/HTML wiring for both features (navbar's
theme-toggle partial, javascript.html's table-popout.js) was left
untouched and still upstream-correct. Result: both features would
still activate at runtime but render completely unstyled, since their
source .sass files were no longer imported by anything once
style.sass was replaced.

Converts the indented Sass syntax to SCSS and folds the content
directly into style.scss rather than keeping them as separate
imports. table-popout.sass's `outline: 2px solid $primary` (a Bulma
Sass variable, unavailable now that Bulma is loaded via CDN rather
than compiled from source) is replaced with the equivalent
hsl(var(--bulma-primary-h), var(--bulma-primary-s),
var(--bulma-primary-l)) already used elsewhere in this file for the
same color.

Verified by compiling the resulting style.scss directly with Dart
Sass (bypassing Hugo/PostCSS, which are hitting an unrelated
environment-level Node permission issue in this sandbox): 712 lines
of output, dark-mode and table-popout selectors all present, the
outline substitution resolves correctly.

Signed-off-by: Ross Golder <ross@golder.org>
Same class of breaking change as the docs/ partials: these two
templates (added by goharbor#645, after the Hugo upgrade work
was originally branched) never got the .File nil-guard that Hugo
0.163 requires. Broke the /cli-docs section outright once
content/cli-docs stopped being tracked in git and started coming
purely from cli-docs.sh's generated output at build time - the
section index page has no .File, and Hugo 0.163 errors instead of
Hugo 0.74's more lenient handling.

Verified: full `make production-build` succeeds (2150 pages, 0
errors), /cli-docs renders.

Signed-off-by: Ross Golder <ross@golder.org>
- e2e/breaking-changes.spec.ts covers the four breaking-change fixes
  from the Hugo/Bulma upgrade: admonition markdownify, disableKinds
  taxonomy/term pages, the _redirects custom output format, and the
  css.Sass CSS pipeline (fingerprinted output, computed styles applied)
- .github/workflows/test.yml: build -> test -> lint pipeline, Hugo
  0.163.3 pinned via peaceiris/actions-hugo, Playwright browsers
  installed in CI
- make test / make test-ui targets, README section documenting them
- .gitignore: test-results/, playwright-report/

Built on top of the Hugo/Bulma upgrade branch since these tests
assert against its output (fingerprinted CSS, css.Sass pipeline,
disableKinds behavior) and would fail against current upstream/main.

Note: local `make production-build` in this sandbox intermittently
fails with a Node permission-model error inside autoprefixer's
browserslist parent-directory walk, unrelated to any code here - it
reproduced identically on the unmodified Hugo/Bulma upgrade branch
that had built successfully minutes earlier in the same session, with
no dependency or code change in between. Treating it as an
environment artifact rather than a real defect; worth a clean re-run
in CI to confirm.

Signed-off-by: Ross Golder <ross@golder.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants