[bug] "Not supported URL scheme http+docker" on build in clean environment

[JakeTrock]

Checklist

• I've prepended issue tag with type of change: [bug]
• (If applicable) I've attached the script to reproduce the bug
• (If applicable) I've documented below the DLC image/dockerfile this relates to
• (If applicable) I've documented below the tests I've run on the DLC image
• I'm using an existing DLC image listed here: https://docs.aws.amazon.com/deep-learning-containers/latest/devguide/deep-learning-containers-images.html
• I've built my own container based off DLC (and I've attached the code used to build my own image)

Concise Description:
I am using a clean ubuntu ec2 instance with python 3.12.3
I am running the command

python -m src.main --buildspec pytorch/training/buildspec-2-6-sm.yml --framework pytorch

and have commented out the test code specified in this issue lines 349-367 of file src/patch_helper.py so the error is not thrown there, however I get the error I usually get which I specify below

DLC image/dockerfile:

Current behavior:

BuildSageMakerCPUPTTrainPy3DockerImage                                                                                                                               
Traceback (most recent call last):
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 633, in send
    conn = self.get_connection_with_tls_context(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 489, in get_connection_with_tls_context
    conn = self.poolmanager.connection_from_host(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/urllib3/poolmanager.py", line 303, in connection_from_host
    return self.connection_from_context(request_context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/urllib3/poolmanager.py", line 325, in connection_from_context
    raise URLSchemeUnknown(scheme)
urllib3.exceptions.URLSchemeUnknown: Not supported URL scheme http+docker

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/ubuntu/deep-learning-containers/src/main.py", line 140, in <module>
    main()
  File "/home/ubuntu/deep-learning-containers/src/main.py", line 136, in main
    image_builder(buildspec_file, image_types, device_types)
  File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 392, in image_builder
    pushed_images += process_images(parent_images, "Parent/Independent", buildspec_path=buildspec)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 448, in process_images
    build_images(pre_push_image_list)
  File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 603, in build_images
    FORMATTER.progress(THREADS)
  File "/home/ubuntu/deep-learning-containers/src/output.py", line 103, in progress
    output[i] += "." * 10 + constants.STATUS_MESSAGE[futures[image].result()]
                                                     ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/src/image.py", line 168, in build
    self.docker_build(fileobj=context_file, custom_context=True)
  File "/home/ubuntu/deep-learning-containers/src/image.py", line 196, in docker_build
    for line in self.client.build(
                ^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/api/build.py", line 263, in build
    response = self._post(
               ^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/api/client.py", line 226, in _post
    return self.post(url, **self._set_request_timeout(kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 637, in post
    return self.request("POST", url, data=data, json=json, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 637, in send
    raise InvalidURL(e, request=request)
requests.exceptions.InvalidURL: Not supported URL scheme http+docker

Expected behavior:
Build success
Additional context:

Full scrollback:

$ python -m src.main --buildspec pytorch/training/buildspec-2-6-sm.yml --framework pytorch
login into public ECR
WARNING! Your password will be stored unencrypted in /home/ubuntu/snap/docker/3064/.docker/config.json.
Configure a credential helper to remove this warning. See
https://docs.docker.com/engine/reference/commandline/login/#credential-stores

Login Succeeded
[PROD_URI for 539247459990.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-cpu-py312-ubuntu22.04-sagemaker] 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-cpu-py312-ubuntu22.04-sagemaker
=====================================================================================================================================================================
[PROD_URI for 539247459990.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-gpu-py312-cu126-ubuntu22.04-sagemaker] 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-gpu-py312-cu126-ubuntu22.04-sagemaker
=====================================================================================================================================================================
=====================================================================================================================================================================
=                                                     _    ____   _  _____ ____ _   _       ____  ____  _____ ____                                                  =
=                                                    / \  |  _ \ / \|_   _/ ___| | | |     |  _ \|  _ \| ____|  _ \                                                 =
=                                                   / _ \ | |_) / _ \ | || |   | |_| |_____| |_) | |_) |  _| | |_) |                                                =
=                                                  / ___ \|  __/ ___ \| || |___|  _  |_____|  __/|  _ <| |___|  __/                                                 =
=                                                 /_/   \_\_| /_/   \_\_| \____|_| |_|     |_|   |_| \_\_____|_|                                                    =
=                                                                                                                                                                   =
=                                                                                                                                                                   =
=====================================================================================================================================================================
Requirement already satisfied: boto3 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.37.9)
Requirement already satisfied: docker in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 2)) (4.2.0)
Requirement already satisfied: fabric in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (3.2.2)
Requirement already satisfied: invoke in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 4)) (2.2.0)
Requirement already satisfied: junit-xml==1.9 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 5)) (1.9)
Requirement already satisfied: packaging in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 6)) (24.2)
Requirement already satisfied: pytest<8.1 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8)) (8.0.2)
Requirement already satisfied: pytest-rerunfailures in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 9)) (15.0)
Requirement already satisfied: pytest-timeout in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 10)) (2.3.1)
Requirement already satisfied: pytest-json-report in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 11)) (1.5.0)
Requirement already satisfied: pytest-xdist in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 12)) (3.6.1)
Requirement already satisfied: sagemaker<3,>=2 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.242.0)
Requirement already satisfied: xmltodict in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 14)) (0.14.2)
Requirement already satisfied: retrying in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 15)) (1.3.4)
Requirement already satisfied: gitpython in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16)) (3.1.44)
Requirement already satisfied: pytz in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 17)) (2025.1)
Requirement already satisfied: toml in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 18)) (0.10.2)
Requirement already satisfied: lxml==5.3.1 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 19)) (5.3.1)
Requirement already satisfied: scrapy in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.12.0)
Requirement already satisfied: crochet in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 21)) (2.1.1)
Requirement already satisfied: tenacity in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 22)) (9.0.0)
Requirement already satisfied: requests in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (2.32.3)
Requirement already satisfied: six in ./dlc/lib/python3.12/site-packages (from junit-xml==1.9->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 5)) (1.17.0)
Requirement already satisfied: botocore<1.38.0,>=1.37.9 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.37.9)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.0.1)
Requirement already satisfied: s3transfer<0.12.0,>=0.11.0 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (0.11.4)
Requirement already satisfied: websocket-client>=0.32.0 in ./dlc/lib/python3.12/site-packages (from docker->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 2)) (1.8.0)
Requirement already satisfied: paramiko>=2.4 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (3.5.1)
Requirement already satisfied: decorator>=5 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (5.2.1)
Requirement already satisfied: deprecated>=1.2 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (1.2.18)
Requirement already satisfied: iniconfig in ./dlc/lib/python3.12/site-packages (from pytest<8.1->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8)) (2.1.0)
Requirement already satisfied: pluggy<2.0,>=1.3.0 in ./dlc/lib/python3.12/site-packages (from pytest<8.1->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8)) (1.5.0)
Requirement already satisfied: pytest-metadata in ./dlc/lib/python3.12/site-packages (from pytest-json-report->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 11)) (3.1.1)
Requirement already satisfied: execnet>=2.1 in ./dlc/lib/python3.12/site-packages (from pytest-xdist->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 12)) (2.1.1)
Requirement already satisfied: attrs<24,>=23.1.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (23.2.0)
Requirement already satisfied: cloudpickle>=2.2.1 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (3.1.1)
Requirement already satisfied: fastapi in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.115.12)
Requirement already satisfied: google-pasta in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.2.0)
Requirement already satisfied: importlib-metadata<7.0,>=1.4.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (6.11.0)
Requirement already satisfied: jsonschema in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.23.0)
Requirement already satisfied: numpy<2.0,>=1.9.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.26.4)
Requirement already satisfied: omegaconf<=2.3,>=2.2 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.3.0)
Requirement already satisfied: pandas in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.2.3)
Requirement already satisfied: pathos in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.3.3)
Requirement already satisfied: platformdirs in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.3.7)
Requirement already satisfied: protobuf<6.0,>=3.12 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (5.29.4)
Requirement already satisfied: psutil in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (7.0.0)
Requirement already satisfied: pyyaml~=6.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (6.0.2)
Requirement already satisfied: sagemaker-core<2.0.0,>=1.0.17 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.0.25)
Requirement already satisfied: schema in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.7.7)
Requirement already satisfied: smdebug-rulesconfig==1.0.1 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.0.1)
Requirement already satisfied: tblib<4,>=1.7.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (3.0.0)
Requirement already satisfied: tqdm in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.67.1)
Requirement already satisfied: urllib3<3.0.0,>=1.26.8 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.3.0)
Requirement already satisfied: uvicorn in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.34.0)
Requirement already satisfied: gitdb<5,>=4.0.1 in ./dlc/lib/python3.12/site-packages (from gitpython->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16)) (4.0.12)
Requirement already satisfied: Twisted>=21.7.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (24.11.0)
Requirement already satisfied: cryptography>=37.0.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (44.0.2)
Requirement already satisfied: cssselect>=0.9.1 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.3.0)
Requirement already satisfied: itemloaders>=1.0.1 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.3.2)
Requirement already satisfied: parsel>=1.5.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.10.0)
Requirement already satisfied: pyOpenSSL>=22.0.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (25.0.0)
Requirement already satisfied: queuelib>=1.4.2 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.7.0)
Requirement already satisfied: service-identity>=18.1.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (24.2.0)
Requirement already satisfied: w3lib>=1.17.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.3.1)
Requirement already satisfied: zope.interface>=5.1.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (7.2)
Requirement already satisfied: protego>=0.1.15 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.4.0)
Requirement already satisfied: itemadapter>=0.1.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.11.0)
Requirement already satisfied: tldextract in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (5.1.3)
Requirement already satisfied: defusedxml>=0.7.1 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.7.1)
Requirement already satisfied: PyDispatcher>=2.0.5 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.0.7)
Requirement already satisfied: wrapt in ./dlc/lib/python3.12/site-packages (from crochet->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 21)) (1.17.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (3.4.1)
Requirement already satisfied: idna<4,>=2.5 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (3.10)
Requirement already satisfied: certifi>=2017.4.17 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (2025.1.31)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in ./dlc/lib/python3.12/site-packages (from botocore<1.38.0,>=1.37.9->boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (2.9.0.post0)
Requirement already satisfied: cffi>=1.12 in ./dlc/lib/python3.12/site-packages (from cryptography>=37.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.17.1)
Requirement already satisfied: smmap<6,>=3.0.1 in ./dlc/lib/python3.12/site-packages (from gitdb<5,>=4.0.1->gitpython->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16)) (5.0.2)
Requirement already satisfied: zipp>=0.5 in ./dlc/lib/python3.12/site-packages (from importlib-metadata<7.0,>=1.4.0->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (3.21.0)
Requirement already satisfied: antlr4-python3-runtime==4.9.* in ./dlc/lib/python3.12/site-packages (from omegaconf<=2.3,>=2.2->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.9.3)
Requirement already satisfied: bcrypt>=3.2 in ./dlc/lib/python3.12/site-packages (from paramiko>=2.4->fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (4.3.0)
Requirement already satisfied: pynacl>=1.5 in ./dlc/lib/python3.12/site-packages (from paramiko>=2.4->fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (1.5.0)
Requirement already satisfied: typing-extensions>=4.9 in ./dlc/lib/python3.12/site-packages (from pyOpenSSL>=22.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (4.12.2)
Requirement already satisfied: pydantic<3.0.0,>=2.0.0 in ./dlc/lib/python3.12/site-packages (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.10.6)
Requirement already satisfied: rich<14.0.0,>=13.0.0 in ./dlc/lib/python3.12/site-packages (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (13.9.4)
Requirement already satisfied: mock<5.0,>4.0 in ./dlc/lib/python3.12/site-packages (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.0.3)
Requirement already satisfied: jsonschema-specifications>=2023.03.6 in ./dlc/lib/python3.12/site-packages (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2024.10.1)
Requirement already satisfied: referencing>=0.28.4 in ./dlc/lib/python3.12/site-packages (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.36.2)
Requirement already satisfied: rpds-py>=0.7.1 in ./dlc/lib/python3.12/site-packages (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.23.1)
Requirement already satisfied: pyasn1 in ./dlc/lib/python3.12/site-packages (from service-identity>=18.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.6.1)
Requirement already satisfied: pyasn1-modules in ./dlc/lib/python3.12/site-packages (from service-identity>=18.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.4.1)
Requirement already satisfied: automat>=24.8.0 in ./dlc/lib/python3.12/site-packages (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (24.8.1)
Requirement already satisfied: constantly>=15.1 in ./dlc/lib/python3.12/site-packages (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (23.10.4)
Requirement already satisfied: hyperlink>=17.1.1 in ./dlc/lib/python3.12/site-packages (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (21.0.0)
Requirement already satisfied: incremental>=24.7.0 in ./dlc/lib/python3.12/site-packages (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (24.7.2)
Requirement already satisfied: setuptools in ./dlc/lib/python3.12/site-packages (from zope.interface>=5.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (78.0.2)
Requirement already satisfied: starlette<0.47.0,>=0.40.0 in ./dlc/lib/python3.12/site-packages (from fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.46.1)
Requirement already satisfied: tzdata>=2022.7 in ./dlc/lib/python3.12/site-packages (from pandas->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2025.2)
Requirement already satisfied: ppft>=1.7.6.9 in ./dlc/lib/python3.12/site-packages (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.7.6.9)
Requirement already satisfied: dill>=0.3.9 in ./dlc/lib/python3.12/site-packages (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.3.9)
Requirement already satisfied: pox>=0.3.5 in ./dlc/lib/python3.12/site-packages (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.3.5)
Requirement already satisfied: multiprocess>=0.70.17 in ./dlc/lib/python3.12/site-packages (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.70.17)
Requirement already satisfied: requests-file>=1.4 in ./dlc/lib/python3.12/site-packages (from tldextract->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.1.0)
Requirement already satisfied: filelock>=3.0.8 in ./dlc/lib/python3.12/site-packages (from tldextract->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (3.18.0)
Requirement already satisfied: click>=7.0 in ./dlc/lib/python3.12/site-packages (from uvicorn->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (8.1.8)
Requirement already satisfied: h11>=0.8 in ./dlc/lib/python3.12/site-packages (from uvicorn->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.14.0)
Requirement already satisfied: pycparser in ./dlc/lib/python3.12/site-packages (from cffi>=1.12->cryptography>=37.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.22)
Requirement already satisfied: annotated-types>=0.6.0 in ./dlc/lib/python3.12/site-packages (from pydantic<3.0.0,>=2.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.7.0)
Requirement already satisfied: pydantic-core==2.27.2 in ./dlc/lib/python3.12/site-packages (from pydantic<3.0.0,>=2.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.27.2)
Requirement already satisfied: markdown-it-py>=2.2.0 in ./dlc/lib/python3.12/site-packages (from rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (3.0.0)
Requirement already satisfied: pygments<3.0.0,>=2.13.0 in ./dlc/lib/python3.12/site-packages (from rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.19.1)
Requirement already satisfied: anyio<5,>=3.6.2 in ./dlc/lib/python3.12/site-packages (from starlette<0.47.0,>=0.40.0->fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.9.0)
Requirement already satisfied: sniffio>=1.1 in ./dlc/lib/python3.12/site-packages (from anyio<5,>=3.6.2->starlette<0.47.0,>=0.40.0->fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (1.3.1)
Requirement already satisfied: mdurl~=0.1 in ./dlc/lib/python3.12/site-packages (from markdown-it-py>=2.2.0->rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (0.1.2)
=====================================================================================================================================================================
=                                                                          ____  _     ____                                                                         =
=                                                                         |  _ \| |   / ___|                                                                        =
=                                                                         | | | | |  | |                                                                            =
=                                                                         | |_| | |__| |___                                                                         =
=                                                                         |____/|_____\____|                                                                        =
=                                                                                                                                                                   =
=                                                                                                                                                                   =
=====================================================================================================================================================================
=====================================================================================================================================================================
=                                              ____                      _      _____           _                                                                   =
=                                             |  _ \ __ _ _ __ ___ _ __ | |_   / /_ _|_ __   __| | ___ _ __   ___ _ __                                              =
=                                             | |_) / _` | '__/ _ \ '_ \| __| / / | || '_ \ / _` |/ _ \ '_ \ / _ \ '_ \                                             =
=                                             |  __/ (_| | | |  __/ | | | |_ / /  | || | | | (_| |  __/ |_) |  __/ | | |                                            =
=                                             |_|   \__,_|_|  \___|_| |_|\__/_/  |___|_| |_|\__,_|\___| .__/ \___|_| |_|                                            =
=                                                                                                     |_|                                                           =
=                                                                _            _     ____        _ _     _                                                           =
=                                                             __| | ___ _ __ | |_  | __ ) _   _(_) | __| |                                                          =
=                                                            / _` |/ _ \ '_ \| __| |  _ \| | | | | |/ _` |                                                          =
=                                                           | (_| |  __/ | | | |_  | |_) | |_| | | | (_| |                                                          =
=                                                            \__,_|\___|_| |_|\__| |____/ \__,_|_|_|\__,_|                                                          =
=                                                                                                                                                                   =
=                                                                                                                                                                   =
=====================================================================================================================================================================


BuildSageMakerCPUPTTrainPy3DockerImage                                                                                                                               
Traceback (most recent call last):
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 633, in send
    conn = self.get_connection_with_tls_context(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 489, in get_connection_with_tls_context
    conn = self.poolmanager.connection_from_host(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/urllib3/poolmanager.py", line 303, in connection_from_host
    return self.connection_from_context(request_context)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/urllib3/poolmanager.py", line 325, in connection_from_context
    raise URLSchemeUnknown(scheme)
urllib3.exceptions.URLSchemeUnknown: Not supported URL scheme http+docker

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/ubuntu/deep-learning-containers/src/main.py", line 140, in <module>
    main()
  File "/home/ubuntu/deep-learning-containers/src/main.py", line 136, in main
    image_builder(buildspec_file, image_types, device_types)
  File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 392, in image_builder
    pushed_images += process_images(parent_images, "Parent/Independent", buildspec_path=buildspec)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 448, in process_images
    build_images(pre_push_image_list)
  File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 603, in build_images
    FORMATTER.progress(THREADS)
  File "/home/ubuntu/deep-learning-containers/src/output.py", line 103, in progress
    output[i] += "." * 10 + constants.STATUS_MESSAGE[futures[image].result()]
                                                     ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/concurrent/futures/_base.py", line 449, in result
    return self.__get_result()
           ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/concurrent/futures/_base.py", line 401, in __get_result
    raise self._exception
  File "/usr/lib/python3.12/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/src/image.py", line 168, in build
    self.docker_build(fileobj=context_file, custom_context=True)
  File "/home/ubuntu/deep-learning-containers/src/image.py", line 196, in docker_build
    for line in self.client.build(
                ^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/api/build.py", line 263, in build
    response = self._post(
               ^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/utils/decorators.py", line 46, in inner
    return f(self, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/docker/api/client.py", line 226, in _post
    return self.post(url, **self._set_request_timeout(kwargs))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 637, in post
    return self.request("POST", url, data=data, json=json, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 589, in request
    resp = self.send(prep, **send_kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/sessions.py", line 703, in send
    r = adapter.send(request, **kwargs)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/requests/adapters.py", line 637, in send
    raise InvalidURL(e, request=request)
requests.exceptions.InvalidURL: Not supported URL scheme http+docker

[Yadan-Wei]

I would close this issue since it's duplicated with previous one.