Skip to content

Commit 6538124

Browse files
committed
Build: Skip checking oembed wp-json links in the hydra crawler
The oembed endpoint responds HTTP 429 Too Many Requests too often; perhaps because almost every page links to one. Also, run the spider check on PRs that modify the hydra config file.
1 parent 49f21dd commit 6538124

File tree

2 files changed

+8
-1
lines changed

2 files changed

+8
-1
lines changed

Diff for: .github/configs/hydra-config.json

+6-1
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,10 @@
11
{
2+
"//": [
3+
"2023-05: twitter.com serves broken redirect-loop",
4+
"2025-04: The oembed endpoint responds HTTP 429 Too Many Requests too often; perhaps because almost every page links to one"
5+
],
26
"exclude_scheme_prefixes": [
3-
"https://twitter.com/"
7+
"https://twitter.com/",
8+
"https://api.jquery.com/wp-json/oembed/1.0/embed"
49
]
510
}

Diff for: .github/workflows/spider-check.yaml

+2
Original file line numberDiff line numberDiff line change
@@ -9,9 +9,11 @@ on:
99
push:
1010
paths:
1111
- .github/workflows/spider-check.yaml
12+
- .github/configs/hydra-config.json
1213
pull_request:
1314
paths:
1415
- .github/workflows/spider-check.yaml
16+
- .github/configs/hydra-config.json
1517

1618
jobs:
1719
spider-check:

0 commit comments

Comments
 (0)