Skip to content

Conversation

ziruiliu
Copy link
Contributor

@ziruiliu ziruiliu commented Sep 18, 2025

What?

Add a new param 'ca_bundle' for obj plugin and corresponding option 'obj_ca_bundle' in nixlbench

Why?

AWS cpp sdk does not honor environment variable AWS_CA_BUNDLE when initializing ClientConfiguration.
When testing with S3-compatible storage with self-signed certificates, the plugin and nixlbench are not working

How?

pass certificate path to the plugin, and set caFile when initializing ClientConfiguration

Copy link

copy-pr-bot bot commented Sep 18, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

Copy link

👋 Hi ziruiliu! Thank you for contributing to ai-dynamo/nixl.

Your PR reviewers will review your contribution then trigger the CI to test your changes.

🚀

@ovidiusm
Copy link
Contributor

/build

update with clearer description

Co-authored-by: ovidiusm <[email protected]>
Signed-off-by: ziruiliu <[email protected]>
ovidiusm
ovidiusm previously approved these changes Sep 18, 2025
@ovidiusm ovidiusm self-requested a review September 18, 2025 20:35
@ovidiusm
Copy link
Contributor

It also needs to be added to benchmark/kvbench/commands/args.py (see obj_endpoint_override for example)

Signed-off-by: Zirui Liu <[email protected]>
@ziruiliu
Copy link
Contributor Author

It also needs to be added to benchmark/kvbench/commands/args.py (see obj_endpoint_override for example)

Hi @ovidiusm , I have updated benchmark/kvbench/commands/args.py according to you suggestion

@aranadive
Copy link
Contributor

/ok to test b85ef3e

@aranadive
Copy link
Contributor

/build

@aranadive
Copy link
Contributor

/ok to test 5c2f091

@aranadive
Copy link
Contributor

/build

@ziruiliu
Copy link
Contributor Author

Hi @w1ldptr and @barneuman, would you please review this change that add ca_bundle in obj plugin?
It is critical to pass self-signed certificate into the obj plugin, when testing with private S3-compatible storage.
Thanks!

Copy link
Contributor

@barneuman barneuman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ovidiusm ovidiusm merged commit 3227b61 into ai-dynamo:main Sep 29, 2025
21 checks passed
evgeny-leksikov pushed a commit to evgeny-leksikov/nixl that referenced this pull request Sep 29, 2025
* obj: Add ca_bundle option for S3 compatible storage

Signed-off-by: Zirui Liu <[email protected]>

* obj: Add ca_bundle option in README.md

Signed-off-by: Zirui Liu <[email protected]>

* Update benchmark/nixlbench/src/utils/utils.cpp

update with clearer description

Co-authored-by: ovidiusm <[email protected]>
Signed-off-by: ziruiliu <[email protected]>

* obj: add ca_bundle option

Signed-off-by: Zirui Liu <[email protected]>

---------

Signed-off-by: Zirui Liu <[email protected]>
Signed-off-by: ziruiliu <[email protected]>
Co-authored-by: ovidiusm <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants