Skip to content

PR #3907 #18160

Sign in to view logs

PR #3907

PR #3907 #18160

GitHub Actions / SDK CLI Test Result [ninhu/disable_tracing](https://github.com/microsoft/promptflow/actions/workflows/promptflow-sdk-cli-test.yml?query=branch:ninhu/disable_tracing++) failed Jan 7, 2025 in 0s

2 errors, 1 fail, 23 skipped, 766 pass in 32m 16s

    3 files  ±  0      3 suites  ±0   32m 16s ⏱️ - 16m 18s
  792 tests +  2    766 ✅ ±  0  23 💤 ± 0  1 ❌ ±0  2 🔥 +2 
1 582 runs   - 788  1 532 ✅  - 766  46 💤  - 23  2 ❌  - 1  2 🔥 +2 

Results for commit 9a131af. ± Comparison against earlier commit 76824ca.

Annotations

Check warning on line 0 in tests.sdk_cli_test.e2etests.test_cli.TestCli

See this annotation in the file changed.

@github-actions github-actions / SDK CLI Test Result [ninhu/disable_tracing](https://github.com/microsoft/promptflow/actions/workflows/promptflow-sdk-cli-test.yml?query=branch:ninhu/disable_tracing++)

All 2 runs failed: test_pf_version (tests.sdk_cli_test.e2etests.test_cli.TestCli) 

artifacts/Test Results (Python 3.10) (OS ubuntu-latest)/test-results.xml [took 2s]
artifacts/Test Results (Python 3.9) (OS ubuntu-latest)/test-results.xml [took 2s]
Raw output 
ModuleNotFoundError: No module named 'pkg_resources'
/home/runner/work/promptflow/promptflow/src/promptflow-devkit/tests/sdk_cli_test/e2etests/test_cli.py:99: in test_pf_version
    from pkg_resources import parse_version
E   ModuleNotFoundError: No module named 'pkg_resources'

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / SDK CLI Test Result [ninhu/disable_tracing](https://github.com/microsoft/promptflow/actions/workflows/promptflow-sdk-cli-test.yml?query=branch:ninhu/disable_tracing++)

tests.sdk_cli_test.e2etests.test_prompty_error_handler with error 

artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 0s]
Raw output 
collection failure
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_transports/default.py:101: in map_httpcore_exceptions
    yield
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_transports/default.py:250: in handle_request
    resp = self._pool.handle_request(req)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py:256: in handle_request
    raise exc from None
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_sync/connection_pool.py:236: in handle_request
    response = connection.handle_request(
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_sync/connection.py:103: in handle_request
    return self._connection.handle_request(request)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_sync/http11.py:136: in handle_request
    raise exc
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_sync/http11.py:106: in handle_request
    ) = self._receive_response_headers(**kwargs)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_sync/http11.py:177: in _receive_response_headers
    event = self._receive_event(timeout=timeout)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_sync/http11.py:217: in _receive_event
    data = self._network_stream.read(
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_backends/sync.py:126: in read
    with map_exceptions(exc_map):
/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/contextlib.py:158: in __exit__
    self.gen.throw(typ, value, traceback)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpcore/_exceptions.py:14: in map_exceptions
    raise to_exc(exc) from exc
E   httpcore.ReadTimeout: The read operation timed out

The above exception was the direct cause of the following exception:
tests/sdk_cli_test/e2etests/test_prompty_error_handler.py:55: in <module>
    class TestHandlePromptyError:
tests/sdk_cli_test/e2etests/test_prompty_error_handler.py:405: in TestHandlePromptyError
    "Something went wrong", response=httpx.get("https://www.example.com"), body=None
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_api.py:195: in get
    return request(
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_api.py:109: in request
    return client.request(
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_client.py:825: in request
    return self.send(request, auth=auth, follow_redirects=follow_redirects)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_client.py:914: in send
    response = self._send_handling_auth(
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_client.py:942: in _send_handling_auth
    response = self._send_handling_redirects(
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_client.py:979: in _send_handling_redirects
    response = self._send_single_request(request)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_client.py:1014: in _send_single_request
    response = transport.handle_request(request)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_transports/default.py:249: in handle_request
    with map_httpcore_exceptions():
/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/contextlib.py:158: in __exit__
    self.gen.throw(typ, value, traceback)
/home/runner/.cache/pypoetry/virtualenvs/promptflow-devkit-bFW165Ac-py3.11/lib/python3.11/site-packages/httpx/_transports/default.py:118: in map_httpcore_exceptions
    raise mapped_exc(message) from exc
E   httpx.ReadTimeout: The read operation timed out

Check failure on line 0 in /

See this annotation in the file changed.

@github-actions github-actions / SDK CLI Test Result [ninhu/disable_tracing](https://github.com/microsoft/promptflow/actions/workflows/promptflow-sdk-cli-test.yml?query=branch:ninhu/disable_tracing++)

gw0 with error 

artifacts/Test Results (Python 3.11) (OS ubuntu-latest)/test-results.xml [took 0s]
Raw output 
collection failure
Different tests were collected between gw1 and gw0. The difference is:
--- gw1

+++ gw0

@@ -434,23 +434,6 @@

 tests/sdk_cli_test/e2etests/test_prompty.py::TestPrompty::test_escape_roles_in_prompty
 tests/sdk_cli_test/e2etests/test_prompty.py::TestPrompty::test_tools_in_prompty
 tests/sdk_cli_test/e2etests/test_prompty.py::TestPrompty::test_prompty_with_image_input
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_chat_message_invalid_format
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_authentication_error_with_bad_api_key
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_connection_error_with_bad_api_base
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_not_found_error_with_bad_api_version
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_not_found_error_with_bad_deployment
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_rate_limit_error_insufficient_quota
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_retriable_openai_error_handle[dummyExceptionList0]
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_retriable_openai_error_handle_async[dummyExceptionList0]
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_retriable_openai_error_handle_with_header[dummyExceptionList0]
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_retriable_openai_error_handle_with_header_async[dummyExceptionList0]
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_unprocessable_entity_error
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_unprocessable_entity_error_async
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_non_retriable_openai_error_handle[dummyExceptionList0]
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_unexpected_error_handle
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_invalid_max_tokens[0-0 is less than the minimum of 1-UserError/OpenAIError/BadRequestError-WrappedOpenAIError]
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_invalid_max_tokens[-1--1 is less than the minimum of 1-UserError/OpenAIError/BadRequestError-WrappedOpenAIError]
-tests/sdk_cli_test/e2etests/test_prompty_error_handler.py::TestHandlePromptyError::test_invalid_max_tokens[invalid_max_token-not of type 'integer'-UserError/OpenAIError/BadRequestError-WrappedOpenAIError]
 tests/sdk_cli_test/e2etests/test_telemetry.py::TestTelemetry::test_run_yaml_type
 tests/sdk_cli_test/e2etests/test_telemetry.py::TestTelemetry::test_flow_type_with_pfazure_flows
 tests/sdk_cli_test/e2etests/test_tool.py::TestTool::test_python_tool_meta
To see why this happens see Known limitations in documentation
View more details on GitHub Actions