Umbrel behind Caddy reverse proxy tries to fetch http:// resources, which are blocked by Content Security policy

[proudparrot2]

I'm running Umbrel on my home network, and I want to put it behind a Caddy reverse proxy to get https support and to put it on my domain that I use for my homelab services. I'm doing this via Tailscale installed on Umbrel, and reverse proxying its IP address on my tailnet.

However, it tries to fetch resources on http://umbrel.mydomain.com instead of https://, causing them to be blocked by the fact that you can't fetch http resources from a http site. Is this intended behavior?