Version 2.4.1

What's Changed

• fix(backend): Replaced hardcoded ServiceAccount with default config by @hbelmiro in #11578
• chore: Remove License checker by @HumairAK in #11609
• fix(backend): the metacontroller is broken since by @juliusvonkohout in #11608
• fix(backend) fix run retry for argo by @ntny in #11585
• fix(backend): parallelFor resolve upstream inputs. by @zazulam in #11627
• fix(manifests): Upgrading metacontroller to v4.11.22 by @tarekabouzeid in #11656
• fix(backend): ignore unknown fields for pb json unmarshaling by @HumairAK in #11662
• chore: improved securitycontext for mysql by @juliusvonkohout in #11678
• chore(backend): partially revert 9afe23e by @HumairAK in in #11713
• fix(backend) fix execution-level retry on the Argo Workflows backend by @ntny in #11673
• update driver/launcher images for 2.4.1 by @HumairAK in #11717

Full Changelog: 2.4.0...2.4.1

KFP SDK v2.12.1

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.12.1

For changelog, see release notes.

KFP SDK v2.12.0

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.12.0

For changelog, see release notes.

Version 2.4.0

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here

Install python SDK (python 3.9 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log

What's Changed

• chore: Update RELEASE.md to remove obsolete instructions by @chensun in #11183
• chore: Release kfp-pipeline-spec 0.4.0 by @chensun in #11189
• chore: release kfp-kubernetes 1.3.0 by @chensun in #11190
• chore: update kfp-kubernetes release scripts and instructions by @chensun in #11191
• feat(sdk)!: Pin kfp-pipeline-spec==0.4.0, kfp-server-api>=2.1.0,<2.4.0 by @chensun in #11192
• chore(sdk): release KFP SDK 2.9.0 by @chensun in #11193
• replaced deprecated image repos with registry.k8s.io by @HumairAK in #11152
• chore: Set Python 3.9 as the Minimum Supported Version by @diegolovison in #11159
• chore(docs): clean up kfp-kubernetes documentation index page by @gregsheremeta in #11207
• chore: move release instruction screenshots out of root directory by @chensun in #11215
• fix(ui): Fixes V1 Run detail unnecessary reloading. Fixes #10590 by @quinnovator in #11214
• fix(frontend): first time choosing a pipeline definition is VERY slow. Fixes #10897 by @ElayAharoni in #11130
• chore: clean up obsolete requirements.txt under root directory by @chensun in #11216
• chore(components): GCPC 2.17.0 Release by @copybara-service in #11213
• chore: fix CI by adding a dependency of python/sdk for the e2e-test by @rimolive in #11221
• refactor: fix invalid escape sequences by @TheKevJames in #11147
• fix(backend): upgrade PyYMAL to fix metadata_writer build error by @chensun in #11231
• chore(deps-dev): bump elliptic from 6.5.5 to 6.5.7 in /frontend by @dependabot in #11127
• chore(deps): bump fast-xml-parser and @aws-sdk/credential-providers in /frontend/server by @dependabot in #11056
• chore(deps): bump send and express in /frontend/server by @dependabot in #11229
• chore: add workflow to build images by @HumairAK in #11232
• fix(workflows): patch reversed launcher / driver in workflow matrix by @CarterFendley in #11238
• chore: Remove PaulinaPacyna from reviewers by @PaulinaPacyna in #11242
• test: Fixed kubeflow-pipelines-integration-v2 workflow by @hbelmiro in #11244
• feat(sdk): Allow disabling default caching via a CLI flag and env var by @DharmitD in #11222
• feat(frontend/backend): Allow the ability to sort experiments by last run creation. Fixes #10884 by @ElayAharoni in #11163
• chore: adding HumairAK to root OWNERS by @chensun in #11253
• feat(backend): add configurable S3 path style support by @ntny in #11246
• chore: adding @hbelmiro to backend reviewers by @hbelmiro in #11256
• chore: pinned estroz/rerun-actions version by @hbelmiro in #11257
• feat(backend): Remove PipelineSpec Template storage from ObjStore responsibilies. Fixes #10509 by @gmfrasca in #10790
• fix(backend): randomizing output uri path to avoid overwriting. Fixes #10186 by @b4sus in #11243
• correct lastrun unittest timestamps by @HumairAK in #11270
• chore(deps): bump rollup from 2.63.0 to 2.79.2 in /frontend by @dependabot in #11254
• chore(deps): bump webpack from 5.90.3 to 5.95.0 in /frontend by @dependabot in #11271
• chore(doc): Update kfp-kubenetes release instructions. by @chensun in #11276
• fix(backend): set default value to true for ForcePathStyle by @zazulam in #11281
• fix(components): remove default prediction column names in evaluation regression component to fix issues with bigquery data source by @copybara-service in #11282
• feat(workflows): use built images in Github workflows by @CarterFendley in #11284
• test: Integrate Git Hub Action Results into Tide by @VaniHaripriya in #11262
• chore(deps): bump golang.org/x/net from 0.0.0-20210726213435-c6fcb2dbf985 to 0.23.0 in /test/tools/project-cleaner by @dependabot in #10728
• Revert "chore(deps): bump golang.org/x/net from 0.0.0-20210726213435-… by @hbelmiro in #11297
• chore: update SinglePlatformSpec and ComponentSpec for Vertex Platform speci… by @chenyifan-vertex in #11298
• feat: add fields in SinglePlatformSpec by @chenyifan-vertex in #11299
• test: Resolve ci-check failures in long-running CI tests by @VaniHaripriya in #11295
• test: Fix failing SDK tests by creating Python virtual environment by @VaniHaripriya in #11300
• feat(testing): use kustomize to patch deployments before deploy by @CarterFendley in #11294
• test: Disabled ci-check and add-ci-passed-label workflows. by @hbelmiro in #11306
• chore(components): move old components to contrib folder by @chensun in #11315
• test: Enabled ci-check and add-ci-passed-label workflows by @VaniHaripriya in #11320
• fix(tests): remove redundant integration test wf by @droctothorpe in #11322
• adding chore as a new template. Fixes #11263 by @varodrig in #11317
• Add-Create-Experiment-button-when-selecting-experiement-final by @ElayAharoni in #11332
• feat(components): Add reservation_affinity support in v1.create_custom_training_job_from_component by @copybara-service in #11330
• feat(components)!: Deprecate preview.custom_job module by @copybara-service in #11336
• feat(api): add PipelineConfig to api to re-implement pipeline-level config by @gregsheremeta in #11333
• feat(component): execute in a virtual env by @leseb in #11326
• feat(sdk): add PipelineConfig to DSL to re-implement pipeline-level config by @gregsheremeta in #11112
• chore: fix release note by @chensun in #11337
• fix(components): Fix create_custom_training_job_from_component default location by @copybara-service in #11334
• chore(components): Update docker base image to marketplace.gcr.io/google/ubuntu2404, which will install newer Python by @copybara-service in #11338
• chore(backend): typo in max concurrency error text by @Gkrumbach07 in #11342
• feat(backend): implement subdag output resolution by @droctothorpe in #11196
• chore: upstream our authorization changes for oauth2-proxy by @juliusvonkohout in #11347
• test: Fix ci-passed label update on PR synchronization by @VaniHaripriya in #11358
• chore: Added cached layer for Go dependencies to Dockerfiles by @hbelmiro in #11348
• chore: Update the generated cache proto file by @rimolive in #11359
• feat(sdk)!: stop auto-populating metrics as dag output by @chensun in #11362
• chore(sdk): release KFP SDK 2.10.0 by @chensun in #11364
• chore(components): bump highest support KFP SDK version to 2.10.0 and highest support Python version to 3.13 by @copybara-service in #11369
• chore(sdk): remove kfp.deprecated from sdk, legacy samples, and legacy tests by @chensun in #11366
• chore: Updating Pytorch-Launcher component to work with pipelines v2 by @Fiona-Waters in #11273
• chore(components): remove upper limit on python_requires by @copybara-service in https://g...

KFP SDK v2.11.0

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.11.0

For changelog, see release notes.

KFP SDK v2.10.1

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.10.1

For changelog, see release notes.

KFP SDK v2.10.0

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.10.0

For changelog, see release notes.

KFP SDK v2.9.0

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.9.0

For changelog, see release notes.

Version 2.3.0

To deploy Kubeflow Pipelines in an existing cluster, follow the instruction in here or via UI here

Install python SDK (python 3.7 above) by running:

python3 -m pip install kfp kfp-server-api --upgrade

See the Change Log

What's Changed

• chore: Update RELEASE.md by @chensun in #10767
• fix(components): Add input param autorater_prompt_parameters to online_evaluation_pairwise component by @copybara-service in #10759
• feat(components): create infer preprocessor component by @copybara-service in #10765
• feat(components): create utility class for preprocessors and use it in rlhf preprocessor and infer preprocessor by @copybara-service in #10768
• chore(sdk): drop Python 3.7 for kfp sdk by @rickyxie0929 in #10750
• chore: Promote @rimolive as a backend approver by @chensun in #10780
• feat(components): use preprocessor utility methods for the upload model graph by @copybara-service in #10774
• chore: upgrade node to v18 by @HumairAK in #10794
• feat(GH workflow): migrate periodic functional tests to GH actions by @shruti2522 in #10751
• chore: Add Container Engine and Image Tag parameters to backend Makefiles by @gmfrasca in #10725
• chore: add meaningful logs to client initialization. by @HumairAK in #10801
• feat(kubernetes_platform): Update kubernetes_platform go package to include EnabledSharedMemory by @hsteude in #10703
• feat(components): Retry on batch prediction internal errors in AutoSxS by @copybara-service in #10799
• fix(components): Add staging and temp locations to prophet trainer component by @copybara-service in #10803
• fix(components): Remove unused import function_based from infer pipeline by @copybara-service in #10802
• docs(components): Bump the python version to 3.8 by @copybara-service in #10764
• chore(components): GCPC 2.14.1 Release by @copybara-service in #10813
• chore(components): Rollback GCPC 2.14.1 Release due to b/339911077 by @copybara-service in #10818
• chore(components): Add TaskError proto by @copybara-service in #10823
• chore(components): GCPC 2.14.1 Release by @copybara-service in #10821
• feat(components): Create the write_user_defined_error function by @copybara-service in #10835
• test: fix CI failure for periodic functional tests by @tmvfb in #10817
• chore(docs): Fix link by @haoxins in #7533
• chore: Update Periodic Functional Tests to run once a day by @DharmitD in #10842
• test: fix version conflict for functional tests by @tmvfb in #10837
• chore: server should skip sample load if path DNE by @DharmitD in #10833
• fix(frontend): reduce list run latency by @droctothorpe in #10797
• feat(components): Support parsing Gemini BP outputs in AutoSxS pipeline by @copybara-service in #10853
• feat(components): Use GetModel integration test to manually test write_user_defined_error function by @copybara-service in #10843
• docs: modified the ConfigMap as Env variable example in README.md with right key_name within use_config_map_as_env() block. by @vamsi-01 in #10855
• fix(sdk): Add required auth scopes to RegistryClient for GCP service accounts credentials by @PChambino in #10819
• chore(deps): bump requests from 2.31.0 to 2.32.2 in /backend/src/apiserver/visualization by @dependabot in #10858
• chore: Change command to apply manifests in the docs by @rimolive in #10864
• fix(manifests): Move metacontroller to the top in kustmization.yaml by @codablock in #10669
• test: Migrate Backend tests to a GHA workflow by @DharmitD in #10871
• feat(backend): mount EmptyDir volumes for launcher write locations by @HumairAK in #10857
• docs(components): internal by @copybara-service in #10874
• feat(components): Add role_field_name and model_name as input parameters to llm_evaluation_preprocessor component to support gemini model's input and output schema by @copybara-service in #10875
• fix(components): add check and add log to call out the fallback to the default model checkpoint and remove the model checkpoint check condition in RLHF GCPC by @copybara-service in #10828
• test: migrate kubeflow-pipeline-e2e-test to GitHub Actions by @hbelmiro in #10887
• feat(components): Support dynamic machine type paramters in CustomTrainingJobOp by @KevinGrantLee in #10883
• fix(kubernetes_platform): fix api-generator docker mount for SELinux by @gregsheremeta in #10890
• feat(components): Add Starry Net forecasting pipeline to public preview by @copybara-service in #10888
• chore(components): Update AutoSxS and RLHF image tags by @copybara-service in #10906
• feat(components): Update Starry Net image tags by @copybara-service in #10920
• chore: Updated Python image to 3.8 in backend/Dockerfile by @hbelmiro in #10941
• Expose starry_net yaml to GitHub by @chensun in #10943
• chore(sdk): release KFP SDK 2.8.0 by @chensun in #10940
• chore: Upgrade Python version to 3.8 in readthedocs config by @chensun in #10945
• feat(frontend&backend): Add UI support for object store customization and prefixes by @HumairAK in #10787
• chore(components): Update AutoSxS and RLHF image tags by @copybara-service in #10958
• chore(components): GCPC 2.15.0 Release by @copybara-service in #10951
• docs(backend): Remove deprecated v2 compatibility mode docs by @droctothorpe in #10956
• Upgrade go version to 1.21 by @DharmitD in #10911
• chore: Add ability to mount self-signed certs to kfp by @DharmitD in #10849
• feat(components): add persistent_resource_id to v1 GCPC custom job components/utils by @copybara-service in #10954
• chore: Added @rimolive, @hbelmiro and @DharmitD as approvers and reviewers for GitHub Actions by @hbelmiro in #10963
• test: Migrate KFP SDK YAPF test to a GHA Workflow by @DharmitD in #10961
• test: Created a new GitHub action to reuse the creation of a KFP cluster by @hbelmiro in #10946
• test: kubeflow-pipeline-upgrade-test migrated to GitHub Actions by @hbelmiro in #10932
• test: Migrate Frontend tests to a GHA Workflow by @DharmitD in #10972
• test: install kfp on github periodic functional tests workflow by @tmvfb in #10859
• chore: Add an option to re-run GHA workflows by @rimolive in #10930
• chore(components): Update Starry Net description and add nan- and zero-threshold args by @copybara-service in #10986
• test: Moved KFP backend visualization tests to GitHub Actions by @hbelmiro in #10984
• test: Migrate KFP SDK Upgrade Test to GHA by @DharmitD in #10989
• test: Migrate KFP SDK Runtime Code Test to GHA by @DharmitD in #10991
• chore(components): Bump image version for Structured Data pipelines by @copybara-service in #11000
• chore(components): Fix bug due to protobuf library being upgraded by pinning protobuf version by @copybara-service in #11007
• chore(components): Add target_field_name as input parameters to llm_evaluation_preprocessor component to support gemini model's input and output schema by @copybara-service in https://github.co...

KFP SDK v2.8.0

Release of the KFP SDK only.

To install the KFP SDK:

pip install kfp==2.8.0

For changelog, see release notes.