Skip to content

Releases: airbnb/omniduct

v0.8.1

16 Jul 20:11
Compare
Choose a tag to compare

This release stops passing 'default' as the default value for aws_profile for S3 filesystems, as this breaks default behaviour for AWS logins.

v0.8.0

16 Jul 19:32
Compare
Choose a tag to compare

Another relatively small release with minor breaking changes to the API, pushing it up to the next major version.

Breaking changes:

  • All async keywords have been replaced with wait, in order to support Python 3.7.

Features and enhancements:

  • Compatibility fixes for Python 2 data encoding in filesystem operations.
  • S3 write support, as well as slightly more robust S3 client connections and the option to skip Hadoop artifacts.
  • Improved logging and warnings (including support for indeterminate progress bars).
  • Pyhive logging of query has been silenced.
  • Added thrift dependency which does not seem to be pulled in upstream.

Behind the scenes:

  • Stricter code conventions and linting has resulted in cleaner code.

v0.7.0

06 Apr 05:15
Compare
Choose a tag to compare

This is a relatively small release, but which has slightly different default behaviour, making it a tick over to the next major release.

Improvements:

  • Authorisation is now actually passed through to backends in Presto, Hive, Druid and Neo4j clients when username is not None. To avoid default usernames being passed, use username=False in the constructor.
  • Allow customisation of the source name for Presto clients.

Bugfixes:

  • Fixed requests being loaded at import time, despite supposedly being a runtime import.
  • None results from presto polling are now correctly handled.

v0.6.2

10 Mar 22:01
Compare
Choose a tag to compare

Features and Enhancements:

  • Added warning when users push dataframes using HiveServer2Client.push when default table properties are implicitly used.

Bugfixes:

  • Fix reference to self.remote in WebHdfsClient constructor, which causes the client to be prepared at creation time rather than lazily deferred until first use.
  • Fix empty StringIO buffer being returned when opening a non-existent file with mode 'r'.

v0.6.1

09 Mar 10:20
Compare
Choose a tag to compare

Features and enhancements:

  • Allow all host specifications provided to a Duct instance to include the port. This port will take precedence over any value supplied via port.
  • Supplying a list of hostnames to a Duct instance as the host value will result in naive load-balancing (i.e. the hostnames will be randomly sorted and the first accessible hostname/port will be chosen).
  • Added support for automatically configuring WebHdfsClient instances via a cloudera XML configuration file.

Bugfixes:

  • Fix typo/bug in LocalFsClient.open() due to missing self reference in function definition.

v0.6.0: First publicly supported release

09 Mar 10:09
Compare
Choose a tag to compare

This release marks the graduation of omniduct from a fledgeling project to a publicly supported body of code. Core functionality is now fully documented. Refer to documentation for a full rundown of functionality.