Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Staging] Optimizing Vector Configuration to avoid missing logs #5324

Merged
merged 1 commit into from
Jan 21, 2025

Conversation

khrm
Copy link
Contributor

@khrm khrm commented Jan 20, 2025

Optimized the vector configuration to avoid missing logs.

Optimized the vector configuration to avoid missing logs.
@openshift-ci openshift-ci bot requested review from hugares and zregvart January 20, 2025 16:30
Copy link
Contributor Author

@khrm khrm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/assign @enarha

@khrm khrm changed the title Optimizing Vector Configuration to avoid missing logs [Staging] Optimizing Vector Configuration to avoid missing logs Jan 20, 2025
Copy link

openshift-ci bot commented Jan 20, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: hugares, khrm

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@enarha
Copy link
Contributor

enarha commented Jan 20, 2025

/test appstudio-e2e-tests

@@ -17,7 +17,8 @@ customConfig:
kubernetes_logs:
type: kubernetes_logs
rotate_wait_secs: 5
glob_minimum_cooldown_ms: 15000
glob_minimum_cooldown_ms: 500
Copy link
Contributor

@enarha enarha Jan 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe do that 1s (1000)? IMO that'll be enough to detect the new logs, without stressing the system too much. I've already heard complains of vector (not our deployment) being too resource hungry. Unless you have some data to suggest 0.5 is the value we need.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I use this reference while setting this: vectordotdev/vector#7934 (comment)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

OK. I was thinking most short lived taskruns I've seen are taking ~3s, so setting that value to 1s will be enough to not miss logs without over stressing the system. Anyway, we can start with that lower value and monitor the resource utilization and increase the value if needed.

@enarha
Copy link
Contributor

enarha commented Jan 21, 2025

/lgtm

@openshift-ci openshift-ci bot added the lgtm label Jan 21, 2025
@openshift-merge-bot openshift-merge-bot bot merged commit 342bba0 into redhat-appstudio:main Jan 21, 2025
5 of 6 checks passed
@khrm khrm deleted the vector-opti branch January 21, 2025 12:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants