Contact Free trial Login

Apache Kafka Connector Release Notes - Mule 4

Support Category: Select

Anypoint Connector for Apache Kafka (Kafka Connector) enables you to connect to the Apache Kafka messaging system, enabling seamless integration between your applications and an Apache Kafka cluster.

4.0.0

February 25, 2020

Compatibility

Software Version

Mule

4.2.0 and later

Apache Kafka

2.4.0

New Features

Kafka Connector 4.0.0 contains a lot of changes to improve efficiency, including new operations to enable you to better understand how to use the connector.

All of the changes included in this version break backward compatibility.

See Kafka Connector Upgrade for detailed information about all of the changes in this release.

The new features and changes in this release include:

  • Four new operations, including:

    • Commit

    • Consume

    • Publish

    • Seek

  • A new Batch Message Listener source

  • The addition of different acknowledgment modes in the Consumer configuration, including:

    • AUTO

    • MANUAL

    • DUPS_OK

    • IMMEDIATE

  • One plaintext connection type that supports transactions

3.0.10

December 17, 2019

Compatibility

Software Version

Mule

4.2.0 and later

Apache Kafka

2.4.0

Fixed Issues

  • Updated Kafka Client version to the latest to prevent internal exceptions. (SE-14104)

  • Fixed Kafka consumer disconnection that occurred after a period of inactivity. (SE-14221)

3.0.9

December 16, 2019

Compatibility

Software Version

Mule

4.2.0 and later

Apache Kafka

2.3.0

Fixed Issues

Fixed relative path issue for Kafka connector settings with Windows. (SE-14140)

3.0.8

November 25, 2019

Compatibility

Software Version

Mule

4.2.0 and later

Apache Kafka

2.3.0

Fixed Issues

When KafkaConsumer was stopped by the Mule runtime engine, Kafka threw a concurrency error. (SE-13970)

3.0.7

August 21, 2019

Compatibility

Software Version

Mule

4.1.1 and later

Apache Kafka

2.3.0

Features

  • Upgraded the Kafka Clients library to version 2.3.0. (CONN-2857)

  • Implemented validation method for producer and consumer connection. (CONN-2698)

  • Added Scheduler Service for spawning new threads for consumers. (CONN-2849)

Fixed Issues

  • Refactoring to improve compliance with the Mule development best practices. (CONN-2699, CONN-2700, CONN-2701, CONN-2702, CONN-2848, CONN-2703, CONN-2847, CONN-2747, CONN-2696, CONN-2697)

  • Deprecated the UNKNOWN error type that will be removed in the next major upcoming release. (CONN-2703)

  • In Kafka versions 3.0.2 to 3.0.6, in the Publish Message operation, the Key field appeared in Anypoint Studio as required. In version 3.0.7, the Key field was no longer required.

  • In Kafka versions 3.0.2 to 3.0.6, in the Message Consumer source operation, the Partition Offsets field was described as "a list of offsets representing the partitions offsets configuration. For each element in the list you have to specify partition index and offset". In version 3.0.7, the Partition Offsets field is now described as "a list of objects that contain the index of the partition and the offset".

  • In Kafka versions 3.0.2 to 3.0.6, in the Message Consumer source operation, the Partition Offsets field is typed as an array of offsets. In 3.0.2 to 3.0.6 in the Offset array, the Partition Number and Partition Offset fields did not require values. In 3.0.7, the Partition Number and Partition Offset fields now require values.

  • In Kafka versions 3.0.2 to 3.0.6, in the Repeatable File Store Stream object, the Max in Memory Size field name was changed to be In Memory Size in 3.0.7.

3.0.6

July 2, 2019

Compatibility

Software Version

Mule

4.0.0 and later

Apache Kafka

2.2.0

Fixed Issues

Kafka connector overrode the user-defined security.protocol=SASL_SSL to use the security.protocol=SSL value. (SE-11947)

3.0.5

June 19, 2019

Compatibility

Software Version

Mule

4.0.0 and later

Apache Kafka

2.2.0

Fixed Issues

  • Updated the Kafka Clients library to version 2.2.0.

  • Updated code to use the poll(java.time.Duration) method provided in the new library that replaces the deprecated poll(long) method. The deprecated method did not block beyond the timeout for waiting on a partition assignment. (KIP-266)

3.0.4

May 16, 2019

Compatibility

Software Version

Mule

4.0.0 and later

Apache Kafka

0.10.2.0

Fixed Issues

Fixed a performance connection validation issue relating to the same issue as in v3.0.3. (SE-11817)

3.0.3

May 16, 2019

Compatibility

Software Version

Mule

4.0.0 and later

Apache Kafka

0.10.2.0

Fixed Issues

  • The Test Connection button in Anypoint Studio for the Kafka connector did not work in Mule 4. (SE-11817)

  • Fixed a performance connection validation issue relating to the same issue as in v3.0.3. (SE-11817)

3.0.2

April 30, 2019

Compatibility

Software Version

Mule

4.0.0 and later

Apache Kafka

0.10.2.0

Fixed Issues

3.0.1

June 26, 2018

Compatibility

Software Version

Mule

4.0.0 and later

Apache Kafka

0.10.2.0

Features

None

Fixed Issues

Kafka connector was not serializing and deserializing properly the messages that were not plain text. Now the content of the messages can be sent as any type (plain, XML, JSON) as the value is serialized and deserialized properly.

Was this article helpful?

💙 Thanks for your feedback!