Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[bug] S3 bucket for "patch-dlc" not public, causing failure #4659

Closed
3 of 6 tasks
JakeTrock opened this issue Mar 24, 2025 · 2 comments
Closed
3 of 6 tasks

[bug] S3 bucket for "patch-dlc" not public, causing failure #4659

JakeTrock opened this issue Mar 24, 2025 · 2 comments

Comments

@JakeTrock
Copy link

JakeTrock commented Mar 24, 2025 •
edited
Loading

Checklist

Concise Description:
I am using a clean ubuntu ec2 instance with python 3.12.3
I am trying to create an image with the following command after a proper setup:

python -m src.main --buildspec pytorch/training/buildspec-2-6-sm.yml --framework pytorch

but I get the error specified below

DLC image/dockerfile:

Current behavior:

invoke.exceptions.UnexpectedExit: Encountered a bad command exit code!

Command: 'aws s3 cp s3://patch-dlc /home/ubuntu/patch-dlc --recursive'

Exit code: 1

Stdout:



Stderr:

fatal error: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied

Expected behavior:

Successful build

Additional context:

It seems you did not make your bucket public:

 ~  aws s3api get-bucket-acl --bucket patch-dlc | jq '.Grants[] | select(.Grantee.Type == "Group" and .Grantee.URI == "http://acs.amazonaws.com/groups/global/AllUsers")'

An error occurred (AccessDenied) when calling the GetBucketAcl operation: Access Denied

full scrollback:

$ python -m src.main --buildspec pytorch/training/buildspec-2-6-sm.yml --framework pytorch
login into public ECR
WARNING! Your password will be stored unencrypted in /home/ubuntu/snap/docker/3064/.docker/config.json.
Configure a credential helper to remove this warning. See
https://docs.docker.com/engine/reference/commandline/login/#credential-stores

Login Succeeded
[PROD_URI for 539247459990.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-cpu-py312-ubuntu22.04-sagemaker] 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-cpu-py312-ubuntu22.04-sagemaker
=====================================================================================================================================================================
[PROD_URI for 539247459990.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-gpu-py312-cu126-ubuntu22.04-sagemaker] 763104351884.dkr.ecr.us-east-1.amazonaws.com/pytorch-training:2.6.0-gpu-py312-cu126-ubuntu22.04-sagemaker
=====================================================================================================================================================================
=====================================================================================================================================================================
=                                                     _    ____   _  _____ ____ _   _       ____  ____  _____ ____                                                  =
=                                                    / \  |  _ \ / \|_   _/ ___| | | |     |  _ \|  _ \| ____|  _ \                                                 =
=                                                   / _ \ | |_) / _ \ | || |   | |_| |_____| |_) | |_) |  _| | |_) |                                                =
=                                                  / ___ \|  __/ ___ \| || |___|  _  |_____|  __/|  _ <| |___|  __/                                                 =
=                                                 /_/   \_\_| /_/   \_\_| \____|_| |_|     |_|   |_| \_\_____|_|                                                    =
=                                                                                                                                                                   =
=                                                                                                                                                                   =
=====================================================================================================================================================================
Requirement already satisfied: boto3 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.37.9)
Requirement already satisfied: docker in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 2)) (4.2.0)
Requirement already satisfied: fabric in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (3.2.2)
Requirement already satisfied: invoke in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 4)) (2.2.0)
Requirement already satisfied: junit-xml==1.9 in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 5)) (1.9)
Requirement already satisfied: packaging in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 6)) (24.2)
Collecting pytest<8.1 (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8))
  Downloading pytest-8.0.2-py3-none-any.whl.metadata (7.7 kB)
Collecting pytest-rerunfailures (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 9))
  Downloading pytest_rerunfailures-15.0-py3-none-any.whl.metadata (19 kB)
Collecting pytest-timeout (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 10))
  Downloading pytest_timeout-2.3.1-py3-none-any.whl.metadata (20 kB)
Collecting pytest-json-report (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 11))
  Downloading pytest_json_report-1.5.0-py3-none-any.whl.metadata (15 kB)
Collecting pytest-xdist (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 12))
  Downloading pytest_xdist-3.6.1-py3-none-any.whl.metadata (4.3 kB)
Collecting sagemaker<3,>=2 (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading sagemaker-2.242.0-py3-none-any.whl.metadata (16 kB)
Collecting xmltodict (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 14))
  Downloading xmltodict-0.14.2-py2.py3-none-any.whl.metadata (8.0 kB)
Requirement already satisfied: retrying in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 15)) (1.3.4)
Collecting gitpython (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16))
  Downloading GitPython-3.1.44-py3-none-any.whl.metadata (13 kB)
Collecting pytz (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 17))
  Downloading pytz-2025.1-py2.py3-none-any.whl.metadata (22 kB)
Requirement already satisfied: toml in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 18)) (0.10.2)
Collecting lxml==5.3.1 (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 19))
  Downloading lxml-5.3.1-cp312-cp312-manylinux_2_28_x86_64.whl.metadata (3.7 kB)
Collecting scrapy (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading Scrapy-2.12.0-py2.py3-none-any.whl.metadata (5.3 kB)
Collecting crochet (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 21))
  Downloading crochet-2.1.1-py3-none-any.whl.metadata (10 kB)
Collecting tenacity (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 22))
  Downloading tenacity-9.0.0-py3-none-any.whl.metadata (1.2 kB)
Requirement already satisfied: requests in ./dlc/lib/python3.12/site-packages (from -r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (2.32.3)
Requirement already satisfied: six in ./dlc/lib/python3.12/site-packages (from junit-xml==1.9->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 5)) (1.17.0)
Requirement already satisfied: botocore<1.38.0,>=1.37.9 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.37.9)
Requirement already satisfied: jmespath<2.0.0,>=0.7.1 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (1.0.1)
Requirement already satisfied: s3transfer<0.12.0,>=0.11.0 in ./dlc/lib/python3.12/site-packages (from boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (0.11.4)
Requirement already satisfied: websocket-client>=0.32.0 in ./dlc/lib/python3.12/site-packages (from docker->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 2)) (1.8.0)
Requirement already satisfied: paramiko>=2.4 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (3.5.1)
Requirement already satisfied: decorator>=5 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (5.2.1)
Requirement already satisfied: deprecated>=1.2 in ./dlc/lib/python3.12/site-packages (from fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (1.2.18)
Collecting iniconfig (from pytest<8.1->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8))
  Downloading iniconfig-2.1.0-py3-none-any.whl.metadata (2.7 kB)
Collecting pluggy<2.0,>=1.3.0 (from pytest<8.1->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 8))
  Downloading pluggy-1.5.0-py3-none-any.whl.metadata (4.8 kB)
Collecting pytest-metadata (from pytest-json-report->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 11))
  Downloading pytest_metadata-3.1.1-py3-none-any.whl.metadata (8.6 kB)
Collecting execnet>=2.1 (from pytest-xdist->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 12))
  Downloading execnet-2.1.1-py3-none-any.whl.metadata (2.9 kB)
Collecting attrs<24,>=23.1.0 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading attrs-23.2.0-py3-none-any.whl.metadata (9.5 kB)
Collecting cloudpickle>=2.2.1 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading cloudpickle-3.1.1-py3-none-any.whl.metadata (7.1 kB)
Collecting fastapi (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading fastapi-0.115.12-py3-none-any.whl.metadata (27 kB)
Collecting google-pasta (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading google_pasta-0.2.0-py3-none-any.whl.metadata (814 bytes)
Collecting importlib-metadata<7.0,>=1.4.0 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading importlib_metadata-6.11.0-py3-none-any.whl.metadata (4.9 kB)
Collecting jsonschema (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading jsonschema-4.23.0-py3-none-any.whl.metadata (7.9 kB)
Collecting numpy<2.0,>=1.9.0 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading numpy-1.26.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.0/61.0 kB 2.5 MB/s eta 0:00:00
Collecting omegaconf<=2.3,>=2.2 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading omegaconf-2.3.0-py3-none-any.whl.metadata (3.9 kB)
Collecting pandas (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading pandas-2.2.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (89 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 89.9/89.9 kB 6.3 MB/s eta 0:00:00
Collecting pathos (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading pathos-0.3.3-py3-none-any.whl.metadata (11 kB)
Requirement already satisfied: platformdirs in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (4.3.7)
Collecting protobuf<6.0,>=3.12 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading protobuf-5.29.4-cp38-abi3-manylinux2014_x86_64.whl.metadata (592 bytes)
Collecting psutil (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (22 kB)
Requirement already satisfied: pyyaml~=6.0 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (6.0.2)
Collecting sagemaker-core<2.0.0,>=1.0.17 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading sagemaker_core-1.0.25-py3-none-any.whl.metadata (4.9 kB)
Collecting schema (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading schema-0.7.7-py2.py3-none-any.whl.metadata (34 kB)
Collecting smdebug-rulesconfig==1.0.1 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading smdebug_rulesconfig-1.0.1-py2.py3-none-any.whl.metadata (943 bytes)
Collecting tblib<4,>=1.7.0 (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading tblib-3.0.0-py3-none-any.whl.metadata (25 kB)
Collecting tqdm (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading tqdm-4.67.1-py3-none-any.whl.metadata (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.7/57.7 kB 4.0 MB/s eta 0:00:00
Requirement already satisfied: urllib3<3.0.0,>=1.26.8 in ./dlc/lib/python3.12/site-packages (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (2.3.0)
Collecting uvicorn (from sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading uvicorn-0.34.0-py3-none-any.whl.metadata (6.5 kB)
Collecting gitdb<5,>=4.0.1 (from gitpython->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16))
  Downloading gitdb-4.0.12-py3-none-any.whl.metadata (1.2 kB)
Collecting Twisted>=21.7.0 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading twisted-24.11.0-py3-none-any.whl.metadata (20 kB)
Requirement already satisfied: cryptography>=37.0.0 in ./dlc/lib/python3.12/site-packages (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (44.0.2)
Collecting cssselect>=0.9.1 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading cssselect-1.3.0-py3-none-any.whl.metadata (2.6 kB)
Collecting itemloaders>=1.0.1 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading itemloaders-1.3.2-py3-none-any.whl.metadata (3.9 kB)
Collecting parsel>=1.5.0 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading parsel-1.10.0-py2.py3-none-any.whl.metadata (11 kB)
Collecting pyOpenSSL>=22.0.0 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading pyOpenSSL-25.0.0-py3-none-any.whl.metadata (16 kB)
Collecting queuelib>=1.4.2 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading queuelib-1.7.0-py2.py3-none-any.whl.metadata (5.7 kB)
Collecting service-identity>=18.1.0 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading service_identity-24.2.0-py3-none-any.whl.metadata (5.1 kB)
Collecting w3lib>=1.17.0 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading w3lib-2.3.1-py3-none-any.whl.metadata (2.3 kB)
Collecting zope.interface>=5.1.0 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading zope.interface-7.2-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (44 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.4/44.4 kB 3.7 MB/s eta 0:00:00
Collecting protego>=0.1.15 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading Protego-0.4.0-py2.py3-none-any.whl.metadata (6.2 kB)
Collecting itemadapter>=0.1.0 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading itemadapter-0.11.0-py3-none-any.whl.metadata (18 kB)
Collecting tldextract (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading tldextract-5.1.3-py3-none-any.whl.metadata (11 kB)
Collecting defusedxml>=0.7.1 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading defusedxml-0.7.1-py2.py3-none-any.whl.metadata (32 kB)
Collecting PyDispatcher>=2.0.5 (from scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading PyDispatcher-2.0.7-py3-none-any.whl.metadata (2.4 kB)
Requirement already satisfied: wrapt in ./dlc/lib/python3.12/site-packages (from crochet->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 21)) (1.17.2)
Requirement already satisfied: charset-normalizer<4,>=2 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (3.4.1)
Requirement already satisfied: idna<4,>=2.5 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (3.10)
Requirement already satisfied: certifi>=2017.4.17 in ./dlc/lib/python3.12/site-packages (from requests->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 23)) (2025.1.31)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in ./dlc/lib/python3.12/site-packages (from botocore<1.38.0,>=1.37.9->boto3->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 1)) (2.9.0.post0)
Requirement already satisfied: cffi>=1.12 in ./dlc/lib/python3.12/site-packages (from cryptography>=37.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (1.17.1)
Collecting smmap<6,>=3.0.1 (from gitdb<5,>=4.0.1->gitpython->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 16))
  Downloading smmap-5.0.2-py3-none-any.whl.metadata (4.3 kB)
Collecting zipp>=0.5 (from importlib-metadata<7.0,>=1.4.0->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading zipp-3.21.0-py3-none-any.whl.metadata (3.7 kB)
Collecting antlr4-python3-runtime==4.9.* (from omegaconf<=2.3,>=2.2->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading antlr4-python3-runtime-4.9.3.tar.gz (117 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 117.0/117.0 kB 11.7 MB/s eta 0:00:00
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: bcrypt>=3.2 in ./dlc/lib/python3.12/site-packages (from paramiko>=2.4->fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (4.3.0)
Requirement already satisfied: pynacl>=1.5 in ./dlc/lib/python3.12/site-packages (from paramiko>=2.4->fabric->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 3)) (1.5.0)
Collecting typing-extensions>=4.9 (from pyOpenSSL>=22.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Collecting pydantic<3.0.0,>=2.0.0 (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading pydantic-2.10.6-py3-none-any.whl.metadata (30 kB)
Collecting rich<14.0.0,>=13.0.0 (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading rich-13.9.4-py3-none-any.whl.metadata (18 kB)
Collecting mock<5.0,>4.0 (from sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading mock-4.0.3-py3-none-any.whl.metadata (2.8 kB)
Collecting jsonschema-specifications>=2023.03.6 (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading jsonschema_specifications-2024.10.1-py3-none-any.whl.metadata (3.0 kB)
Collecting referencing>=0.28.4 (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading referencing-0.36.2-py3-none-any.whl.metadata (2.8 kB)
Collecting rpds-py>=0.7.1 (from jsonschema->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading rpds_py-0.23.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (4.1 kB)
Requirement already satisfied: pyasn1 in ./dlc/lib/python3.12/site-packages (from service-identity>=18.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (0.6.1)
Collecting pyasn1-modules (from service-identity>=18.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading pyasn1_modules-0.4.1-py3-none-any.whl.metadata (3.5 kB)
Collecting automat>=24.8.0 (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading Automat-24.8.1-py3-none-any.whl.metadata (8.4 kB)
Collecting constantly>=15.1 (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading constantly-23.10.4-py3-none-any.whl.metadata (1.8 kB)
Collecting hyperlink>=17.1.1 (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading hyperlink-21.0.0-py2.py3-none-any.whl.metadata (1.5 kB)
Collecting incremental>=24.7.0 (from Twisted>=21.7.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading incremental-24.7.2-py3-none-any.whl.metadata (8.1 kB)
Requirement already satisfied: setuptools in ./dlc/lib/python3.12/site-packages (from zope.interface>=5.1.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (78.0.2)
Collecting starlette<0.47.0,>=0.40.0 (from fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading starlette-0.46.1-py3-none-any.whl.metadata (6.2 kB)
Collecting tzdata>=2022.7 (from pandas->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading tzdata-2025.2-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting ppft>=1.7.6.9 (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading ppft-1.7.6.9-py3-none-any.whl.metadata (12 kB)
Collecting dill>=0.3.9 (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading dill-0.3.9-py3-none-any.whl.metadata (10 kB)
Collecting pox>=0.3.5 (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading pox-0.3.5-py3-none-any.whl.metadata (8.0 kB)
Collecting multiprocess>=0.70.17 (from pathos->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading multiprocess-0.70.17-py312-none-any.whl.metadata (7.2 kB)
Collecting requests-file>=1.4 (from tldextract->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading requests_file-2.1.0-py2.py3-none-any.whl.metadata (1.7 kB)
Collecting filelock>=3.0.8 (from tldextract->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20))
  Downloading filelock-3.18.0-py3-none-any.whl.metadata (2.9 kB)
Requirement already satisfied: click>=7.0 in ./dlc/lib/python3.12/site-packages (from uvicorn->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13)) (8.1.8)
Collecting h11>=0.8 (from uvicorn->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading h11-0.14.0-py3-none-any.whl.metadata (8.2 kB)
Requirement already satisfied: pycparser in ./dlc/lib/python3.12/site-packages (from cffi>=1.12->cryptography>=37.0.0->scrapy->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 20)) (2.22)
Collecting annotated-types>=0.6.0 (from pydantic<3.0.0,>=2.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading annotated_types-0.7.0-py3-none-any.whl.metadata (15 kB)
Collecting pydantic-core==2.27.2 (from pydantic<3.0.0,>=2.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading pydantic_core-2.27.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (6.6 kB)
Collecting markdown-it-py>=2.2.0 (from rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading markdown_it_py-3.0.0-py3-none-any.whl.metadata (6.9 kB)
Collecting pygments<3.0.0,>=2.13.0 (from rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading pygments-2.19.1-py3-none-any.whl.metadata (2.5 kB)
Collecting anyio<5,>=3.6.2 (from starlette<0.47.0,>=0.40.0->fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading anyio-4.9.0-py3-none-any.whl.metadata (4.7 kB)
Collecting sniffio>=1.1 (from anyio<5,>=3.6.2->starlette<0.47.0,>=0.40.0->fastapi->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading sniffio-1.3.1-py3-none-any.whl.metadata (3.9 kB)
Collecting mdurl~=0.1 (from markdown-it-py>=2.2.0->rich<14.0.0,>=13.0.0->sagemaker-core<2.0.0,>=1.0.17->sagemaker<3,>=2->-r /home/ubuntu/deep-learning-containers/test/requirements.txt (line 13))
  Downloading mdurl-0.1.2-py3-none-any.whl.metadata (1.6 kB)
Downloading lxml-5.3.1-cp312-cp312-manylinux_2_28_x86_64.whl (5.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.0/5.0 MB 55.9 MB/s eta 0:00:00
Downloading pytest-8.0.2-py3-none-any.whl (333 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 334.0/334.0 kB 43.1 MB/s eta 0:00:00
Downloading pytest_rerunfailures-15.0-py3-none-any.whl (13 kB)
Downloading pytest_timeout-2.3.1-py3-none-any.whl (14 kB)
Downloading pytest_json_report-1.5.0-py3-none-any.whl (13 kB)
Downloading pytest_xdist-3.6.1-py3-none-any.whl (46 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.1/46.1 kB 4.1 MB/s eta 0:00:00
Downloading sagemaker-2.242.0-py3-none-any.whl (1.6 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 43.7 MB/s eta 0:00:00
Downloading smdebug_rulesconfig-1.0.1-py2.py3-none-any.whl (20 kB)
Downloading xmltodict-0.14.2-py2.py3-none-any.whl (10.0 kB)
Downloading GitPython-3.1.44-py3-none-any.whl (207 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 207.6/207.6 kB 19.3 MB/s eta 0:00:00
Downloading pytz-2025.1-py2.py3-none-any.whl (507 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 507.9/507.9 kB 37.3 MB/s eta 0:00:00
Downloading Scrapy-2.12.0-py2.py3-none-any.whl (311 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 311.2/311.2 kB 24.8 MB/s eta 0:00:00
Downloading crochet-2.1.1-py3-none-any.whl (31 kB)
Downloading tenacity-9.0.0-py3-none-any.whl (28 kB)
Downloading attrs-23.2.0-py3-none-any.whl (60 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 60.8/60.8 kB 5.4 MB/s eta 0:00:00
Downloading cloudpickle-3.1.1-py3-none-any.whl (20 kB)
Downloading cssselect-1.3.0-py3-none-any.whl (18 kB)
Downloading defusedxml-0.7.1-py2.py3-none-any.whl (25 kB)
Downloading execnet-2.1.1-py3-none-any.whl (40 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.6/40.6 kB 3.0 MB/s eta 0:00:00
Downloading gitdb-4.0.12-py3-none-any.whl (62 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.8/62.8 kB 5.5 MB/s eta 0:00:00
Downloading importlib_metadata-6.11.0-py3-none-any.whl (23 kB)
Downloading itemadapter-0.11.0-py3-none-any.whl (11 kB)
Downloading itemloaders-1.3.2-py3-none-any.whl (12 kB)
Downloading numpy-1.26.4-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (18.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 18.0/18.0 MB 81.1 MB/s eta 0:00:00
Downloading omegaconf-2.3.0-py3-none-any.whl (79 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 79.5/79.5 kB 13.6 MB/s eta 0:00:00
Downloading parsel-1.10.0-py2.py3-none-any.whl (17 kB)
Downloading pluggy-1.5.0-py3-none-any.whl (20 kB)
Downloading Protego-0.4.0-py2.py3-none-any.whl (8.6 kB)
Downloading protobuf-5.29.4-cp38-abi3-manylinux2014_x86_64.whl (319 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 319.7/319.7 kB 53.9 MB/s eta 0:00:00
Downloading PyDispatcher-2.0.7-py3-none-any.whl (12 kB)
Downloading pyOpenSSL-25.0.0-py3-none-any.whl (56 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.5/56.5 kB 7.8 MB/s eta 0:00:00
Downloading queuelib-1.7.0-py2.py3-none-any.whl (13 kB)
Downloading sagemaker_core-1.0.25-py3-none-any.whl (406 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 406.7/406.7 kB 52.0 MB/s eta 0:00:00
Downloading jsonschema-4.23.0-py3-none-any.whl (88 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 88.5/88.5 kB 16.4 MB/s eta 0:00:00
Downloading service_identity-24.2.0-py3-none-any.whl (11 kB)
Downloading tblib-3.0.0-py3-none-any.whl (12 kB)
Downloading twisted-24.11.0-py3-none-any.whl (3.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.2/3.2 MB 87.8 MB/s eta 0:00:00
Downloading w3lib-2.3.1-py3-none-any.whl (21 kB)
Downloading zope.interface-7.2-cp312-cp312-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (264 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 264.7/264.7 kB 33.5 MB/s eta 0:00:00
Downloading fastapi-0.115.12-py3-none-any.whl (95 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.2/95.2 kB 14.9 MB/s eta 0:00:00
Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 kB 11.0 MB/s eta 0:00:00
Downloading iniconfig-2.1.0-py3-none-any.whl (6.0 kB)
Downloading pandas-2.2.3-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (12.7 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.7/12.7 MB 69.4 MB/s eta 0:00:00
Downloading pathos-0.3.3-py3-none-any.whl (82 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 82.1/82.1 kB 14.6 MB/s eta 0:00:00
Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 278.0/278.0 kB 43.0 MB/s eta 0:00:00
Downloading pytest_metadata-3.1.1-py3-none-any.whl (11 kB)
Downloading schema-0.7.7-py2.py3-none-any.whl (18 kB)
Downloading tldextract-5.1.3-py3-none-any.whl (104 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 104.9/104.9 kB 13.9 MB/s eta 0:00:00
Downloading tqdm-4.67.1-py3-none-any.whl (78 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 78.5/78.5 kB 11.7 MB/s eta 0:00:00
Downloading uvicorn-0.34.0-py3-none-any.whl (62 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 62.3/62.3 kB 7.1 MB/s eta 0:00:00
Downloading Automat-24.8.1-py3-none-any.whl (42 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.6/42.6 kB 5.5 MB/s eta 0:00:00
Downloading constantly-23.10.4-py3-none-any.whl (13 kB)
Downloading dill-0.3.9-py3-none-any.whl (119 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 119.4/119.4 kB 21.0 MB/s eta 0:00:00
Downloading filelock-3.18.0-py3-none-any.whl (16 kB)
Downloading h11-0.14.0-py3-none-any.whl (58 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 58.3/58.3 kB 10.0 MB/s eta 0:00:00
Downloading hyperlink-21.0.0-py2.py3-none-any.whl (74 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 74.6/74.6 kB 13.4 MB/s eta 0:00:00
Downloading incremental-24.7.2-py3-none-any.whl (20 kB)
Downloading jsonschema_specifications-2024.10.1-py3-none-any.whl (18 kB)
Downloading mock-4.0.3-py3-none-any.whl (28 kB)
Downloading multiprocess-0.70.17-py312-none-any.whl (147 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 148.0/148.0 kB 19.3 MB/s eta 0:00:00
Downloading pox-0.3.5-py3-none-any.whl (29 kB)
Downloading ppft-1.7.6.9-py3-none-any.whl (56 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.8/56.8 kB 10.9 MB/s eta 0:00:00
Downloading pydantic-2.10.6-py3-none-any.whl (431 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 431.7/431.7 kB 57.5 MB/s eta 0:00:00
Downloading pydantic_core-2.27.2-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 64.7 MB/s eta 0:00:00
Downloading referencing-0.36.2-py3-none-any.whl (26 kB)
Downloading requests_file-2.1.0-py2.py3-none-any.whl (4.2 kB)
Downloading rich-13.9.4-py3-none-any.whl (242 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 242.4/242.4 kB 28.0 MB/s eta 0:00:00
Downloading rpds_py-0.23.1-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (391 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 391.6/391.6 kB 48.2 MB/s eta 0:00:00
Downloading smmap-5.0.2-py3-none-any.whl (24 kB)
Downloading starlette-0.46.1-py3-none-any.whl (71 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 72.0/72.0 kB 13.0 MB/s eta 0:00:00
Downloading typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Downloading tzdata-2025.2-py2.py3-none-any.whl (347 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 347.8/347.8 kB 46.1 MB/s eta 0:00:00
Downloading zipp-3.21.0-py3-none-any.whl (9.6 kB)
Downloading pyasn1_modules-0.4.1-py3-none-any.whl (181 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 181.5/181.5 kB 26.2 MB/s eta 0:00:00
Downloading annotated_types-0.7.0-py3-none-any.whl (13 kB)
Downloading anyio-4.9.0-py3-none-any.whl (100 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100.9/100.9 kB 13.5 MB/s eta 0:00:00
Downloading markdown_it_py-3.0.0-py3-none-any.whl (87 kB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 87.5/87.5 kB 11.3 MB/s eta 0:00:00
Downloading pygments-2.19.1-py3-none-any.whl (1.2 MB)
   ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 64.7 MB/s eta 0:00:00
Downloading mdurl-0.1.2-py3-none-any.whl (10.0 kB)
Downloading sniffio-1.3.1-py3-none-any.whl (10 kB)
Building wheels for collected packages: antlr4-python3-runtime
  Building wheel for antlr4-python3-runtime (setup.py): started
  Building wheel for antlr4-python3-runtime (setup.py): finished with status 'done'
  Created wheel for antlr4-python3-runtime: filename=antlr4_python3_runtime-4.9.3-py3-none-any.whl size=144590 sha256=cbe3284dd4dde3fce116f9f86a5db3670975dd8755e503e5a0d4957610992033
  Stored in directory: /home/ubuntu/.cache/pip/wheels/1f/be/48/13754633f1d08d1fbfc60d5e80ae1e5d7329500477685286cd
Successfully built antlr4-python3-runtime
Installing collected packages: schema, pytz, PyDispatcher, antlr4-python3-runtime, zope.interface, zipp, xmltodict, w3lib, tzdata, typing-extensions, tqdm, tenacity, tblib, sniffio, smmap, smdebug-rulesconfig, rpds-py, queuelib, pygments, pyasn1-modules, psutil, protobuf, protego, ppft, pox, pluggy, omegaconf, numpy, mock, mdurl, lxml, itemadapter, iniconfig, incremental, hyperlink, h11, google-pasta, filelock, execnet, dill, defusedxml, cssselect, constantly, cloudpickle, automat, attrs, annotated-types, uvicorn, Twisted, requests-file, referencing, pytest, pydantic-core, parsel, pandas, multiprocess, markdown-it-py, importlib-metadata, gitdb, anyio, tldextract, starlette, service-identity, rich, pytest-xdist, pytest-timeout, pytest-rerunfailures, pytest-metadata, pyOpenSSL, pydantic, pathos, jsonschema-specifications, itemloaders, gitpython, crochet, scrapy, pytest-json-report, jsonschema, fastapi, sagemaker-core, sagemaker
Successfully installed PyDispatcher-2.0.7 Twisted-24.11.0 annotated-types-0.7.0 antlr4-python3-runtime-4.9.3 anyio-4.9.0 attrs-23.2.0 automat-24.8.1 cloudpickle-3.1.1 constantly-23.10.4 crochet-2.1.1 cssselect-1.3.0 defusedxml-0.7.1 dill-0.3.9 execnet-2.1.1 fastapi-0.115.12 filelock-3.18.0 gitdb-4.0.12 gitpython-3.1.44 google-pasta-0.2.0 h11-0.14.0 hyperlink-21.0.0 importlib-metadata-6.11.0 incremental-24.7.2 iniconfig-2.1.0 itemadapter-0.11.0 itemloaders-1.3.2 jsonschema-4.23.0 jsonschema-specifications-2024.10.1 lxml-5.3.1 markdown-it-py-3.0.0 mdurl-0.1.2 mock-4.0.3 multiprocess-0.70.17 numpy-1.26.4 omegaconf-2.3.0 pandas-2.2.3 parsel-1.10.0 pathos-0.3.3 pluggy-1.5.0 pox-0.3.5 ppft-1.7.6.9 protego-0.4.0 protobuf-5.29.4 psutil-7.0.0 pyOpenSSL-25.0.0 pyasn1-modules-0.4.1 pydantic-2.10.6 pydantic-core-2.27.2 pygments-2.19.1 pytest-8.0.2 pytest-json-report-1.5.0 pytest-metadata-3.1.1 pytest-rerunfailures-15.0 pytest-timeout-2.3.1 pytest-xdist-3.6.1 pytz-2025.1 queuelib-1.7.0 referencing-0.36.2 requests-file-2.1.0 rich-13.9.4 rpds-py-0.23.1 sagemaker-2.242.0 sagemaker-core-1.0.25 schema-0.7.7 scrapy-2.12.0 service-identity-24.2.0 smdebug-rulesconfig-1.0.1 smmap-5.0.2 sniffio-1.3.1 starlette-0.46.1 tblib-3.0.0 tenacity-9.0.0 tldextract-5.1.3 tqdm-4.67.1 typing-extensions-4.12.2 tzdata-2025.2 uvicorn-0.34.0 w3lib-2.3.1 xmltodict-0.14.2 zipp-3.21.0 zope.interface-7.2
Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/home/ubuntu/deep-learning-containers/src/main.py", line 140, in <module>
    main()
  File "/home/ubuntu/deep-learning-containers/src/main.py", line 136, in main
    image_builder(buildspec_file, image_types, device_types)
  File "/home/ubuntu/deep-learning-containers/src/image_builder.py", line 378, in image_builder
    patch_helper.initiate_multithreaded_autopatch_prep(
  File "/home/ubuntu/deep-learning-containers/src/patch_helper.py", line 352, in initiate_multithreaded_autopatch_prep
    run(f"aws s3 cp s3://patch-dlc {download_path} --recursive", hide=True)
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/invoke/__init__.py", line 50, in run
    return Context().run(command, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/invoke/context.py", line 104, in run
    return self._run(runner, command, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/invoke/context.py", line 113, in _run
    return runner.run(command, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/invoke/runners.py", line 395, in run
    return self._run_body(command, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/invoke/runners.py", line 451, in _run_body
    return self.make_promise() if self._asynchronous else self._finish()
                                                          ^^^^^^^^^^^^^^
  File "/home/ubuntu/deep-learning-containers/dlc/lib/python3.12/site-packages/invoke/runners.py", line 518, in _finish
    raise UnexpectedExit(result)
invoke.exceptions.UnexpectedExit: Encountered a bad command exit code!

Command: 'aws s3 cp s3://patch-dlc /home/ubuntu/patch-dlc --recursive'

Exit code: 1

Stdout:



Stderr:

fatal error: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied
@JakeTrock JakeTrock mentioned this issue Mar 24, 2025
Closed
6 tasks
@Yadan-Wei
Copy link
Contributor

Hi Jake, please refer to this issue for solution. You need to disable auto patch we used internally. #4653

@Yadan-Wei
Copy link
Contributor

Will close this one because of duplicated with #4653

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@JakeTrock @Yadan-Wei