Apache Kafka Connector Release Notes - Mule 4
Support Category: Select
Anypoint Connector for Apache Kafka (Kafka Connector) enables you to connect to the Apache Kafka messaging system, enabling seamless integration between your applications and an Apache Kafka cluster.
Guide: Apache Kafka Connector
Reference: Apache Kafka Connector Reference
4.9.0
August 23, 2024
What’s New
-
The Bulk publish operation is added to publish multiple messages at the same time.
-
The custom
MuleKafkaAvroSerializer
property is added to publish messages in Avro format.
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0, 3.3.2, 3.4.0, 3.5.1, and 3.6.1 |
OpenJDK |
8, 11, and 17 |
4.8.0
June 18, 2024
What’s New
-
Apache Kafka Connector now supports OAuth2 Client Credentials grant type authentication to integrate seamlessly with OAuth2-compliant authorization servers. Use the Consumer SASL/OAUTHBEARER - Client Credentials Connection or Producer SASL/OAUTHBEARER - Client Credentials Connection options in the connector configuration.
-
The consumer and producer connection configurations have a new Additional properties field to customize the Kafka connection as you desire.
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0, 3.3.2, 3.4.0, 3.5.1, and 3.6.1 |
OpenJDK |
8, 11, and 17 |
4.7.6
May 31, 2024
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0, 3.3.2, 3.4.0, 3.5.1, and 3.6.1 |
OpenJDK |
8, 11, and 17 |
Fixed Issues
Issue Resolution | ID |
---|---|
The connector performance is now improved when redeploying. |
W-15637208 |
4.7.5
February 2, 2024
What’s New
-
This connector is now compatible with Java 17.
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0, 3.3.2, 3.4.0, 3.5.1, and 3.6.1 |
OpenJDK |
8, 11, and 17 |
4.7.4
January 9, 2024
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0, 3.3.2, 3.4.0, and 3.6.1 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue Resolution | ID |
---|---|
The Mule application deployment no longer fails when the connector connection test fails. |
W-13197433 |
The Kafka clients library is upgraded to version 3.6.1 to address reported security vulnerabilities. |
W-14486778 |
4.7.3
November 29, 2023
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0, 3.3.2, and 3.4.0 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue Resolution | ID |
---|---|
Upgraded snappy-java library version from 1.1.8.1 to 1.1.10.4. |
W-14486778 |
4.7.2
May 4, 2023
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0, 3.3.2, and 3.4.0 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue Resolution | ID |
---|---|
Upgraded the Kafka Clients library from org.apache.kafka:kafka-clients:3.3.2 to org.apache.kafka:kafka-clients:3.4.0. |
W-12665458 |
4.7.1
March 17, 2023
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0 and 3.3.2 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue Resolution | ID |
---|---|
Updated the Maximum polling interval field description both in the Studio UI and the Apache Kafka Connector Reference. |
W-12660459 |
Updated internal dependencies. |
W-12710406 |
4.7.0
February 13, 2023
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, 2.8.1, 3.2.0 and 3.3.2 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue Resolution | ID |
---|---|
Kafka Connector now uses kafka-clients 3.3.2. |
W-11554436 |
The Publish operation now handles AUTHENTICATION_ERROR. |
W-12042969 |
Kafka connector now supports the boolean system property |
W-12150770 |
4.6.8
November 25, 2022
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, and 2.8.1 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue Resolution | ID |
---|---|
The Kafka record is no longer empty when using the Consume operation more than once without using the Commit operation. |
W-11768903 |
Kafka Connector now throws the expected error when the message body exceeds the maximum topic size. |
W-12042969 |
4.6.7
May 30, 2022
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, and 2.8.1 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue | ID |
---|---|
The connector now displays the correct field names for Default operation poll timeout and Default operation poll timeout time unit. |
W-11137428 |
4.6.6
May 5, 2022
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, and 2.8.1 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue | ID |
---|---|
The Kafka message key is no longer empty when reprocessing messages when the topic contains more than one partition. |
W-11048498 |
The connector no longer throws null pointer exceptions when the message key is null. |
W-11090869 |
4.6.5
April 7, 2022
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, and 2.8.1 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue | ID |
---|---|
The Kafka message key is no longer empty when reprocessing messages. |
W-10795597, W-10889605 |
4.6.4
February 4, 2022
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, and 2.8.1 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue | ID |
---|---|
Reconnection issues caused the Kafka Message Listener to stop consuming messages. |
SE-22821, SE-24437 |
4.6.3
February 2, 2022
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, and 2.8.1 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue | ID |
---|---|
The IsolationLevel parameter was declared but not implemented in the code. |
CONN-9887 |
4.6.2
January 4, 2022
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, and 2.8.1 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue | ID |
---|---|
Kafka Message Listener did not process tombstone messages correctly. |
SE-23630 |
Kafka Message Listener stopped when attempting to consume messages in corner cases. |
SE-22821 |
4.6.1
October 27, 2021
What’s New
-
Upgraded the Kafka client library to version 2.8.1.
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, 2.7.0, and 2.8.1 |
OpenJDK |
8 and 11 |
4.6.0
October 19, 2021
What’s New
-
Added the Consumer SASL/TOKEN Connection and Producer SASL/TOKEN Connection authentication types, which use token delegation to connect to the Kafka cluster.
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, and 2.7.0 |
OpenJDK |
8 and 11 |
4.5.7
September 28, 2021
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, and 2.7.0 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue | ID |
---|---|
Kafka Connector reconnection did not work when there was an ACL access issue. |
SE-22595 |
Kafka Message Listener did not handle duplicate headers. |
SE-22520 |
4.5.6
September 15, 2021
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, and 2.7.0 |
OpenJDK |
8 and 11 |
Fixed Issues
Issue | ID |
---|---|
The reconnection strategy did not work. |
SE-22340 |
4.5.1
4.5.0
February 25, 2021
Compatibility
Software | Version |
---|---|
Mule |
4.1.1 and later |
Apache Kafka |
2.4.0, 2.5.0, 2.6.0, and 2.7.0 |
OpenJDK |
8 and 11 |
4.4.0
4.1.0
May 28, 2020
New Features
-
Added the SASL SCRAM connection type for connecting to a Kafka broker. This connection type works with the SCRAM-SHA-256 and SCARM-SHA-512 authentication mechanisms.
-
Added the Endpoint Identification Algorithm field to all connection types. Clients use this field to validate the server hostname.
4.0.0
February 25, 2020
New Features
Kafka Connector 4.0.0 contains a lot of changes to improve efficiency, including new operations to enable you to better understand how to use the connector.
All of the changes included in this version break backward compatibility.
See Kafka Connector Upgrade for detailed information about all of the changes in this release.
The new features and changes in this release include:
-
Four new operations, including:
-
Commit
-
Consume
-
Publish
-
Seek
-
-
A new Batch Message Listener source
-
The addition of different acknowledgment modes in the Consumer configuration, including:
-
AUTO
-
MANUAL
-
DUPS_OK
-
IMMEDIATE
-
-
One plaintext connection type that supports transactions
3.0.7
August 21, 2019
Features
-
Upgraded the Kafka Clients library to version 2.3.0. (CONN-2857)
-
Implemented validation method for producer and consumer connection. (CONN-2698)
-
Added Scheduler Service for spawning new threads for consumers. (CONN-2849)
Fixed Issues
-
Refactoring to improve compliance with the Mule development best practices. (CONN-2699, CONN-2700, CONN-2701, CONN-2702, CONN-2848, CONN-2703, CONN-2847, CONN-2747, CONN-2696, CONN-2697)
-
Deprecated the UNKNOWN error type that will be removed in the next major upcoming release. (CONN-2703)
-
In Kafka versions 3.0.2 to 3.0.6, in the Publish Message operation, the Key field appeared in Anypoint Studio as required. In version 3.0.7, the Key field was no longer required.
-
In Kafka versions 3.0.2 to 3.0.6, in the Message Consumer source operation, the Partition Offsets field was described as "a list of offsets representing the partitions offsets configuration. For each element in the list you have to specify partition index and offset". In version 3.0.7, the Partition Offsets field is now described as "a list of objects that contain the index of the partition and the offset".
-
In Kafka versions 3.0.2 to 3.0.6, in the Message Consumer source operation, the Partition Offsets field is typed as an array of offsets. In 3.0.2 to 3.0.6 in the Offset array, the Partition Number and Partition Offset fields did not require values. In 3.0.7, the Partition Number and Partition Offset fields now require values.
-
In Kafka versions 3.0.2 to 3.0.6, in the Repeatable File Store Stream object, the Max in Memory Size field name was changed to be In Memory Size in 3.0.7.
3.0.5
June 19, 2019
Fixed Issues
-
Updated the Kafka Clients library to version 2.2.0.
-
Updated code to use the
poll(java.time.Duration)
method provided in the new library that replaces the deprecatedpoll(long)
method. The deprecated method did not block beyond the timeout for waiting on a partition assignment. (KIP-266)
3.0.2
April 30, 2019
Fixed Issues
-
Can’t stop Kafka consumer flow. See How To Stop Or Start Flows In Mule 4.x Programmatically. (SE-11337)
-
The Test Connection button in Anypoint Studio for the Kafka connector did not work in Mule 4. (SE-11817)