Releases: exasol/script-languages-release
5.0.0: Conda-Container and UDF client refactoring
Summary
This release adds two new python-flavors, which use the conda-package manager: A template flavor for Python3.8 with conda (template-Exasol-all-python-3.8-conda) and a template flavor for Python3.8 with conda and cuda (template-Exasol-all-python-3.8-cuda-conda), which replaces the old cuda Python3.6 container.
Also, the C++ part of the UDF client was refactored. Besides, there are several minor refactorings and features and many security updates for Ubuntu and Python packages.
Package Version Comparison between Release 4.3.0 and 5.0.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.14.0 of the container tool.
Bug Fixes
- #686: Fixed bazel crashes on conda flavor
Features / Enhancements
- #666: Make package diffs more robust for CI
- #590: Added flavor template-Exasol-all-python-3.8-conda
- #673: Added dev-tools-script to test container
Documentation
n/a
Refactoring
- #588: Removed virtualschema-jdbc-adapter.jar
- #329: Splitted exaudflib cc into several files
- #646: Updated ci dependencies and removed GCloud CI
- #650: Changed nightly cron and avoid running nightly builds during the weekend
- #648: Moved swig-2.0.4.tar.gz to AWS
- #572: Refactored package import tests
- #677: Improved poetry project structure
- #679: Added a duplicated pyproject.toml
- #451: Removed legacy install scripts
- #503: Added flavor template-Exasol-all-python-3.8-cuda-conda
Security
4.3.0: AWS CI Build and removal of standard-6.2.0 container
Summary
This release now uses AWS for CI and release builds (instead of GClouds). The old standard-6.2.0 container has been removed.
It also contains minor changes regarding the documentation of the packages in the container. The deployment of test container on Dockerhub has been fixed.
The source code of the exaudfclient has been now removed from the script-languages-container. Some integration tests for JVM owned native libraries have been added.
Besides, it contains several security related updates and the documentation has been improved.
Package Version Comparison between Release 4.2.0 and 4.3.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.14.0 of the container tool.
Bug Fixes
- #599: Fixed duplicated packages
- #573: Pushed test container to Dockerhub
- #616: Performed login to dockerhub for specific tests
- #631: Updated script-languages-container-ci-setup and script-languages-container-ci
Features / Enhancements
- #433: Removed the source of the udflclient from the standard containers
- #147: Added tests for JVM owned native libs
- #628: Added release GH actions
Documentation
- #78: Added Docker socket section to prerequisites in usage documentation
- #107: Referenced EXA_toolbox.upload_github_release_file_to_bucketfs in documentation
- #22: Added documentation about testing
- #161: Created FAQ and added solution for /tmp directory
- #181: Added faq about how to start exaslct from within a docker container
- #595: Fixed content of contributing.md
- #632: Prepared release 4.3.0
- #638: Adapted changelog to release-droid format
Refactoring
Security
- #582: Updated libssl
- #596: Updated packages
- #605: Updated packages
- #607: Ignored CVE-2022-1116 as it affects the Linux kernel only
- #613: Ignored CVE-2022-29581 as it affects the Linux kernel only
- #621: Ignored CVE-2022-21499 as it affects the Linux kernel only
- #620: Fixed trivy false positive during secret scan
- #623: Removed CVE-2021-43816 from ignore list
- #636: Updated Ubuntu packages
4.2.0: Vagrant setup and bugfix for Pandas Dataframe
This release fixes a bug in the Python UDF client which occurred when emitting Pandas data frames.
Also, it adds initial support for setting up a virtual machine via Vagrant, which can be used to build this project.
Besides, this releases contains several security fixes.
Package Version Comparison between Release 4.1.0 and 4.2.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.9.0 of the container tool.
Bug Fixes
- #561: Fixed emit of Pandas Dataframe for np.float32 dtype
Features / Enhancements
- #542: Add vagrant setup for libvirt
Documentation
- #578: Prepared release 4.2.0
Refactoring
- n/a
Security
- #541: Update packages python-dev, openjdk, paramiko and ignore CVE-2022-0492
- #553: Ignored CVE-2022-23648
- #558: Update git package
- #562: Ignored CVE-2022-27191
- #567: Updated Python3.7 packages
- #570: Updated Ubuntu packages
- #575: Updated NVidia CUDA Public Key and Updated Curl
4.1.0: Removed datascience flavors and security updates
This release removed two datascience flavors (namely python-3.6-data-science-EXASOL-6.2.0 and r-3.5-data-science-EXASOL-6.2.0).
Also, it contains many security updates and some cleanup.
Package Version Comparison between Release 4.0.0 and 4.1.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.9.0 of the container tool.
Bug Fixes
- #488: Ignore CVE-2021-43816
Features / Enhancements
- #150: Remove usage of pip-legacy-dependency-resolver
Documentation
- #533: Prepare release 4.1.0
Refactoring
Security
- #493: Ignore CVE-2022-0492
- #505: Update libsasl2-dev
- #510: update locales apt package
- #513: Update locales apt package in 20.04 flavors
- #511: Updated generate_package_diffs_for_flavors to Python3.8
- #517: Update openjdk-11-jdk-headless, libssl-dev and openssl
- #520: Ignored Kernel CVE's
- #525: Update package libxml2-dev on standard-8.0 flavor
- #528: Update libssl-dev
- #537: Updated Python3.7
4.0.0: Pandas upgrade to 1.1.5
This release contains a breaking change in the standard containers, because due to a security fix Pandas Python3 package was updated to version 1.1.5 (from 0.22.0). Please note that this version might break existing UDF's using Pandas (Read Pandas Release notes for more information).
Also, this release contains minor bug fixes and other security fixes.
Package Version Comparison between Release 3.2.0 and 4.0.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.9.0 of the container tool.
Bug Fixes
- #472: Fix github upload script
- #474: Fix Python3.6 installation script
- #480: Fix R security scan script
- #484: Update exaslct to 0.9.0
Features / Enhancements
n/a
Documentation
n/a
Refactoring
- #482: Increase version to 4.0
Security
3.2.0: New standard container for Exasol 8.0 and Java UDF conditional compilation
This release adds the new standard container for Exasol 8.0 with Ubuntu 20.04, Python 3.8, Java 11 and R 4.1. Furthermore, we added conditional compilation to Java UDF, which only invokes the Java compiler if the script contains Java code. If it only contains %jar and %scriptClass options it doesn't get used which saves considerable amount of time during startup of the UDFs. Finally, we also improved the startup time of Python3 UDFs.
Package Version Comparison between Release 3.1.0 and 3.2.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.8.0 of the container tool.
Bug Fixes
- #461: Fix Security scan for r-3.5-data-science flavor
- #118: rredis package got discontinued and the new flavor standard-8.0.0-Exasol replaces with redux
- #466: Remove unconditional pandas import in Python3 UDFs to improve startup time
Features / Enhancements
- #440: Updated exaslct to 0.8.0
- #441: updated to exasol python test framework 0.3.0
- #446: Add shellcheck GH actions
- #454: Java UDF conditional compilation
- #382: Add new standard flavor for Exasol 8.0
- #333: Use the new pip dependency resolver in the new flavor standard-8.0.0-Exasol
- #428: Add a security-scan script to the latest standard container
Documentation
n/a
Refactoring
n/a
Security
- #434: Update Python3.6 and Python3.8
- #437: Update openjdk-11-jdk-headless
- #447: Added tensorflow to ignore list on Python3.6-data-science flavor
- #453: Ignore CVE-2021-33430 on Python3.6 flavors
- #457: Use source package of numpy for all flavors. Undo of #453 and fix for CVE-2021-33430 (for major flavors).
Security scan
This release runs security scans on all supported flavors. Also, the implementation of handling of Java exceptions has been changed, and the respective tests have been extended.
The script-language container tool was updated to version 0.7.0. Besides, there were several minor fixes and some packages where updated.
Package Version Comparison between Release 3.0.0 and 3.1.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.7.0 of the container tool.
Bug Fixes
- #395: Avoid creating wheel cache in install_via_pip
- #139: Check Java exceptions
- #415: Fix build break
- #422: Remove maven from r-4-minimum flavor
- #424: Fix deployment of security scan report in Gcloud builds
Features / Enhancements
- #401: Integrate script-languages-container-tool v0.6.0
- #343: Change bazel python scripts to Python3
- #383: Added security scan for flavors
Documentation
- #225: Improve py_dataframe documentation and moved it to user guide
Refactoring
n/a
Security
Add Python3.8 flavor and update tests to Python3
This release added a new Python 3.8 minimal flavor. Also, it uses the script-language-container-tool v0.5.0, which runs the db-tests with Python3, instead of Python2.7 (which has reached EOL). Because of this, all tests have be adjusted to be compatible with Python3. Please note that any custom tests for custom flavors also have to be compatible with Python3 now.
Besides, this release applied a few security updates and adjusted the Docker files of standard-, python-, and r-flavors to have a common format and behavior.
Package Version Comparison between Release 2.5.0 and 3.0.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.5.0 of the container tool.
Bug Fixes
Features / Enhancements
- #384: Use exasol python test framework package and update tests to Python3
- #379: Add commit prefix "security" to GCloud triggers
Documentation
- #391: Prepare documentation for release 3.0.0
Refactoring
n/a
Security
- #376: Update binutils
Add new Python 3.7 minimal flavor and the SageMaker Python SDK to the standard flavors
This release added a new Python 3.7 minimal flavor and the SageMaker Python SDK to the standard flavor. Besides that, we also fixed a few bugs, applied a few security updates and extented the tests.
Package Version Comparison between Release 2.4.0 and 2.5.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.3.0 of the container tool.
Bug Fixes
- #369: Script for generating package diffs may generate the wrong column order in the markdown files
Features / Enhancements
- #330: Add Python 3.7 minimal flavor
- #336: Add the SageMaker Python SDK to the standard flavors
- #341: New tests for linker namespace
Documentation
- #371: Prepare release of version 2.5.0
Refactoring
n/a
Security
MacOsX support and package updates for git and curl
This release upgraded to the Script-Languages-Container-Tools version 0.3.0.
With that, it enables building script-language container under MacOsX (with some limitation, check Readme).
It also contains several minor bugfixes and updates the git and curl packages.
Package Version Comparison between Release 2.3.0 and 2.4.0
Script-Language-Container-Tool (Exaslct)
This release uses version 0.3.0 of the container tool.
Bug Fixes
- #169: Removed duplicated push in CI
- #260: Moved ppa management into separate script
- #342: Specify python2 for bazel steps
- #338: Using master branch for diff generation
Features / Enhancements
- #345: Update git package
- #349: Update curl and libcurl4-openssl-dev packages
- #354: Updated to exaslct v0.3.0
- #335: Add requirements/limitations for MacOsX to README
Refactoring
n/a