Unicode characters mangled when viewing .mdx in a browser

[hkosova]

CLI Version (from fern.config.json)

0.50.13, also 0.46.22

Minimal API Specification

n/a

Actual UI Behavior

When you append .mdx at the end of a page URL to view its Markdown, Unicode characters are mangled. You can see this in Fern documentation: https://buildwithfern.com/learn/docs/building-and-customizing-your-docs/versioning.mdx

llms-full.txt does not have this problem:

If you download the .mdx file locally and view it in a text editor or IDE, it's displayed correctly. This probably means the file itself is OK but its charset it not properly communicated to the browser.

Those .mdx URLs have HTTP response header Content-Type: text/mdx. Maybe it should be Content-Type: text/mdx; charset=utf-8 instead.

Expected UI Behavior

Unicode characters are displayed correctly when viewing <page-url>.mdx in a browser.

Steps to Reproduce

Navigate to https://buildwithfern.com/learn/docs/building-and-customizing-your-docs/versioning.mdx

Environment Details

• Chrome, Safari on macOS
• Chrome, Firefox, Edge on Windows 10
• Chrome on Android