Skip to content

Pravega Flink Connectors 0.11.0
Compare
Choose a tag to compare
@crazyzhou crazyzhou released this 16 May 10:04
· 21 commits to master since this release
v0.11.0
b13da07

This release supports Flink 1.12, 1.13 and 1.14, and it is tested and validated with Pravega 0.11.0 release
For more detail, please read the documentation on Pravega official website: http://pravega.io/docs/latest/connectors/flink-connector

Highlight features

  • (#560) Support Flink 1.14

The connector fixes the compatibility issues and updates its API to adapt Flink 1.14

  • (#460) Experimental: FLIP-143 new Sink

In the latest Flink 1.14 connector, we have implemented the new FLIP-143 Sink API to catch up with the Flink community latest updates. The features for the new API PravegaSink are the aligned with the legacy Sink API FlinkPravegaWriter including:

  • Parallel writes
  • Ordering guarantee based on routing key
  • Data Durability
  • Support transactional write

Note: This is only an experimental API, so there may still be changes in future versions. (e.g. Changing to FLIP-191 v2 Sink is on the plan(#653))

  • (#390 #673) Experimental: FLIP-27 new Source

In the latest Flink 1.14 connector, we have implemented the new FLIP-27 Source API to catch up with the Flink community latest updates. The features for the new API PravegaSource are aligned with the legacy Source API FlinkPravegaReader including:

  • Parallel reads
  • Consistency
  • Ordering guarantee based on routing key
  • Seamless checkpointing integration with Pravega checkpoint

Note: This is only an experimental API, so there may still be changes in future versions.

Notable bugfixes

  • (#635) Fix null pointer when closing pravega batch client factory
  • (#639 #642 #647) Refinements for document

Notifications

  • (#675) Update schema registry to 0.4.0

Along with this fix, withDeserializationSchemaFromRegistry API is now dropped and now the actual produced type should be provided when deserialization schema is initialized.

  • (#617) Increase default transaction lease

This fix increased the default transaction lease for transactional sink from 2 to 10 minutes.

Flink 1.14 connector source code and artifacts are listed in the assets.
Here is the complete list of commits: changelog-flink.txt

Assets 14
Loading