Skip to content

Commit aefc290

Browse files
committed
More robots I do not like.
1 parent ef56d2e commit aefc290

File tree

1 file changed

+9
-0
lines changed

1 file changed

+9
-0
lines changed

caddy/data/web/robots/robots.txt

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -12,3 +12,12 @@ Disallow: /
1212

1313
User-agent: dotbot
1414
Disallow: /
15+
16+
User-agent: SemrushBot
17+
Disallow: /
18+
19+
User-agent: AwarioRssBot
20+
Disallow: /
21+
22+
User-agent: AwarioSmartBot
23+
Disallow: /

0 commit comments

Comments
 (0)