#1956 added `simulated_builtin_runners` field but this logic is not tested. We should add test cases that reflect usage of the field.