Skip to content

Support S3 Access GrantsΒ #2885

Open
Open
@jornfranke

Description

@jornfranke

Is your idea related to a problem? Please describe.
S3 Access Grants are the recommended solution for accessing files in S3 by end users (the target group of AWS SDK for Pandas). This should be supported by AWS SDK for Pandas.

Describe the solution you'd like
When writing code in a notebook and using the AWS SDK for Pandas I want that for any S3 access it automatically requests from a given S3 Access Grant instance the credentials based on the S3 Url I provide.
E.g. when executing the following code

wr.s3.read_parquet(f"s3://{bucket}/parquet/")

I want that AWS SDK for pandas automatically contacts in the background a preconfigured S3 Access Grant instance to obtain a token to be able to access the S3 location.

It may also automatically request, cache, and refreshe temporary credential tokens for all S3 requests that I run in my notebook.

AWS provided recently some libraries and support to enable this in general:

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions