Releases: airbnb/omniduct
v0.8.1
This release stops passing 'default'
as the default value for aws_profile
for S3 filesystems, as this breaks default behaviour for AWS logins.
v0.8.0
Another relatively small release with minor breaking changes to the API, pushing it up to the next major version.
Breaking changes:
- All
async
keywords have been replaced withwait
, in order to support Python 3.7.
Features and enhancements:
- Compatibility fixes for Python 2 data encoding in filesystem operations.
- S3 write support, as well as slightly more robust S3 client connections and the option to skip Hadoop artifacts.
- Improved logging and warnings (including support for indeterminate progress bars).
- Pyhive logging of query has been silenced.
- Added thrift dependency which does not seem to be pulled in upstream.
Behind the scenes:
- Stricter code conventions and linting has resulted in cleaner code.
v0.7.0
This is a relatively small release, but which has slightly different default behaviour, making it a tick over to the next major release.
Improvements:
- Authorisation is now actually passed through to backends in Presto, Hive, Druid and Neo4j clients when
username
is not None. To avoid default usernames being passed, useusername=False
in the constructor. - Allow customisation of the
source
name for Presto clients.
Bugfixes:
- Fixed
requests
being loaded at import time, despite supposedly being a runtime import. None
results from presto polling are now correctly handled.
v0.6.2
Features and Enhancements:
- Added warning when users push dataframes using
HiveServer2Client.push
when default table properties are implicitly used.
Bugfixes:
- Fix reference to
self.remote
in WebHdfsClient constructor, which causes the client to be prepared at creation time rather than lazily deferred until first use. - Fix empty StringIO buffer being returned when opening a non-existent file with mode 'r'.
v0.6.1
Features and enhancements:
- Allow all
host
specifications provided to aDuct
instance to include the port. This port will take precedence over any value supplied viaport
. - Supplying a list of hostnames to a
Duct
instance as thehost
value will result in naive load-balancing (i.e. the hostnames will be randomly sorted and the first accessible hostname/port will be chosen). - Added support for automatically configuring
WebHdfsClient
instances via a cloudera XML configuration file.
Bugfixes:
- Fix typo/bug in
LocalFsClient.open()
due to missingself
reference in function definition.
v0.6.0: First publicly supported release
This release marks the graduation of omniduct from a fledgeling project to a publicly supported body of code. Core functionality is now fully documented. Refer to documentation for a full rundown of functionality.