HDR live streaming does not support AV1 encoding

[james58899]

Operating System Info

Windows 11

Other OS

No response

OBS Studio Version

32.2.1

OBS Studio Version (Other)

No response

OBS Studio Log URL

https://obsproject.com/logs/dSBxuvA2hO1doyOs

OBS Studio Crash Log URL

No response

Expected Behavior

Although it is mentioned in #8522 and #10029 that YouTube does not yet support 10-bit AV1 live streaming, custom RTMP services may support it, and AV1 encoding should be allowed when using custom RTMP services.

Current Behavior

Error message: HDR output is currently disabled for this output.
Even if a custom RTMP server actually supports it.

Steps to Reproduce

1. Enable 10bit/HDR settings
2. Set the encoding to AV1
3. Configure a custom RTMP service
4. Start streaming

Anything else we should know?

I'm currently using a self-written RTMP server, and I'm not sure which existing implementations support HDR live streaming, but my RTMP server can handle HDR AV1 streams pushed using ffmpeg.