Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update composer 2 to newer version #307

Open
chowbao opened this issue Jan 28, 2025 · 1 comment
Open

Update composer 2 to newer version #307

chowbao opened this issue Jan 28, 2025 · 1 comment
Assignees
Labels
enhancement New feature or request etl-scrum

Comments

@chowbao
Copy link
Contributor

chowbao commented Jan 28, 2025

Composer 2 images

Currently on version composer-2.6.4-airflow-2.6.3 which reaches end of support 3/18/2025
We can probably upgrade this to the latest composer/airflow version composer-2.10.2-airflow-2.10.2

Note: GCP seems to only support composer images for 1 year. We can increase our composer/airflow update cadence or just do this update annually

@chowbao chowbao added enhancement New feature or request etl-scrum labels Jan 28, 2025
@chowbao chowbao added this to the Data Sprint 56 milestone Jan 28, 2025
@chowbao chowbao modified the milestones: Data Sprint 56, Data Sprint 57 Feb 4, 2025
@amishas157 amishas157 self-assigned this Feb 25, 2025
@amishas157
Copy link
Contributor

Gotchas when upgrading to new composer version:
You will need to create new clusterbinding

Example:

gcloud container clusters list

gcloud container clusters get-credentials us-central1-test-hubble-43c3e190-gke --zone us-central1

kubectl create clusterrolebinding default-admin --clusterrole cluster-admin --serviceaccount=composer-2-11-4-airflow-2-10-2-e5ddf630:default --namespace hubble-composer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request etl-scrum
Projects
None yet
Development

No branches or pull requests

2 participants