`setup-python` buggy for MacOS with Python 3.11+

[artpelling]

For some reason the cache directory of the setup-python action seems to be misconfigured with the setup-python action. This leads to a failure of the build tests for MacOS from PyPI with pip.

Not sure what to about it at the moment.

[artpelling]

This seems relevant actions/setup-python#179 (comment), somehow -l behaves differently on macOS and setup-python does not honour that...