Anypoint Runtime Fabric Installer Release Notes

These are the release notes for the installer package bundle for Runtime Fabric on VMs / Bare Metal. In addition to these release notes, see the Anypoint Runtime Fabric release notes and the complete Anypoint Runtime Fabric documentation.

2.0.1683838781-797f198

May 12, 2023

What’s New

  • The container logging format changed from JSON (docker-specific) to CRI (cri-o, containerd, etc.).

Fixed Issues

Issue Resolution ID

The new Runtime Fabric Installer version 2.0.1683838781-797f198 enables you to log in correctly into Ops center.

W-13191265

2.0.1682628878-0253858

May 5, 2023

What’s New

  • This release contains bug fixes only.

Fixed Issues

Issue Resolution ID

Latest installer is based on gravity 5.5.77, which switches from Docker to containerd as the container manager.

W-12353489

Ops center now displays medium or long term data for memory related metrics.

W-12549948

Performance issues no longer occur when operating appliance clusters with high utilization or many apps after they are upgraded.

W-11781677, W-12353489

Known Issues

Known Issue Workaround ID

When you log into the Ops Center using the https://<OpsCenter-URL-here>:32009/web/login URL, the landing page shows an Invalid Version: 2.0.1682628878-0253858 internal error.

To access Ops Center, use the https://<OpsCenter-URL-here>:32009/web/site/<cluster-name>/monitor URL.

W-13191265

Log format changed starting with Runtime Fabric installer version 2.0.1682628878-0253858. The log output scrambles information and affects multiline logging.

  1. Edit the DaemonSet by running the command kubectl edit ds -n rtf external-log-forwarder.

  2. In the DaemonSet configuration window, locate the section under spec > template > spec > containers that corresponds to the external-log-forwarder container.

  3. Find the line that contains the Image field.

  4. Modify the value of the Image field to use the desired version rtf-pkg-fluentbit v1.2.113 that contains the fix for the multiline logging issue, for example, rtf-runtime-registry.kprod.msap.io/mulesoft/rtf-pkg-fluentbit:v1.2.113.

  5. Save the changes.

  6. Close the text editor.

W-13504485

2.0.1668062290-074bc49

December 14, 2022

What’s New

  • This release contains bug fixes only.

Fixed Issues

Issue Resolution ID

Runtime Fabric appliance upgrades no longer fail due to a long running etcd backup command.

W-11585892

This release upgrades Helm3 to v3.10.0.

W-11820302

The Telegraf monitoring app no longer issues false alerts for node uptime.

W-11740287

Known Issues

Known Issue Workaround ID

Starting with release 2.0.1661808686-2ff0e92, you might experience performance issues operating appliance clusters with high utilization or many apps, after they are upgraded. Usually during node maintenance. After the nodes are brought back into operation, they might show signs of increased CPU usage and fail to start deployed applications.

W-11781677

2.0.1661808686-2ff0e92

August 29, 2022

What’s New

  • This release includes fixes for security vulnerabilities.

Fixed Issues

Issue Resolution ID

This release includes fixes for security vulnerabilities.

W-11585892

Known Issues

Known Issue Workaround ID

Starting with release 2.0.1661808686-2ff0e92, you might experience performance issues operating appliance clusters with high utilization or many apps, after they are upgraded. Usually during node maintenance. After the nodes are brought back into operation, they might show signs of increased CPU usage and fail to start deployed applications.

W-11781677

1.1.1660253001-ab8f5e5

August 12, 2022

What’s New

  • This release adds support for Ubuntu 20.04 and RHEL 8.6

Fixed Issues

Description Issue

When starting an upgrade, the installer now performs an InfluxDB size check.

W-10606099

The etcd.tick Kapacitor alert no longer re-appears if you delete it.

W-10760515

The systemd Kapacitor task is now works as expected.

W-10833331

The sudo gravity leave command now removes a node as documented.

W-10946440

The Ops Center Individual Node Memory Usage graph now shows the correct legend.

W-10961514

The RTF readiness probe no longer fails with a cgroup.procs: invalid argument error.

W-10647444

Known Issues

Description Issue

Runtime Fabric might issue false alerts about uptime.

W-10819071

1.1.1636064094-8b70d2d

January 19, 2022

What’s New

  • Added support for RHEL/CentOS 8.4 using install scripts version 20220112-f8b0e44 or later.

Known Issues

Known Issue Workaround ID

For RHEL/CentOS 8.4, the install scripts disable the Network Mangager Cloud Setup (nm-cloud-setup) service.

If you’re upgrading your node operating systems from RHEL/CentOS 8.3 to 8.4, you must disable the nm-cloud-setup service before upgrading or installing Runtime Fabric with the latest install scripts. To disable nm-cloud-setup, run the following on each node:

cat > disable_nm_cloud.sh << 'EOF'
#!/bin/bash

function perform_os_specific_operations() {
    set +e
    if [[ "$ID_LIKE" == *"fedora"* ]] && [[ $VERSION_ID == 8.4 ]]; then
        echo "Disabling nm-cloud-setup service on RHEL 8.4"
        systemctl disable nm-cloud-setup.service nm-cloud-setup.timer
        systemctl stop nm-cloud-setup.service nm-cloud-setup.timer
        echo "Removing ip rule prio 30400 on RHEL 8.4"
        ip rule del prio 30400
        if [[ -d "/etc/systemd/system/nm-cloud-setup.service.d" ]]; then
            rm -rf /etc/systemd/system/nm-cloud-setup.service.d
        fi
        echo "Restarting NetworkManager.service on RHEL 8.4"
        systemctl restart NetworkManager.service
    fi
    set -e
}
source /etc/os-release
perform_os_specific_operations
EOF

sudo chmod +x ./disable_nm_cloud.sh
sudo ./disable_nm_cloud.sh

N/A

1.1.1625094374-7058b20

July 15, 2021

What’s New

  • Ubuntu 18.04 support using the install scripts version 20210709-b48dec6 or later.

  • The InfluxDB pod no longer crashes due to localhost resolving to an invalid IP address.

1.1.1619717580-73a133d

May 3, 2021

This release includes the following fix and enhancement:

  • Added: Support for RHEL/CentOS 8.3

  • Fixed: Issue that caused the Ops Center UI metrics retention page to sometimes fail to load after reboot.

1.1.1613157109-f27c821

Mar 4, 2021

This release includes the following fix and enhancement:

  • Added: Improvement to inject Google’s metadata server’s host record in the Planet container when using Google Cloud Platform.

  • Fixed: Issue with stale alerts being shown in the output of the gravity status utility.

1.1.1606942735-3f99c37 - Dec 15, 2020

This release includes the following fixes and enhancements:

  • Added: RHEL/CentOS 7.9 support.

  • Added: Improvements to the resiliency of the dns-app component during upgrades.

  • Fixed: Custom taints were not tolerated by logging and monitoring services.

  • Fixed: Upgrades with etcd may break watches in internal services.

1.1.160392​9599-47b2888 - Nov 10, 2020

This release includes the following fixes and enhancements:

  • Added: RHEL/CentOS 8.1 and 8.2 support.

  • Added: Improvements in reducing etcd load when querying system services during heavy usage.

  • Added: Improvements in debug reporting to include cluster configuration information.

  • Added: Checks to prevent cluster from entering an inconsistent state when executing a rollback.

  • Fixed: Issue with cluster status reporting healthy when few nodes are reported offline.

  • Updated: TLS config to use secure ciphers and TLSv1.2 for Kubernetes internal components.

1.1.1599670979-d08f56e - Sep 18, 2020

This release includes the following fixes and enhancements:

  • Added: Validation for proxy settings configured in the appliance.

  • Added: Pre-upgrade validation to mitigate overlay network failures.

  • Added: Improvements in appliance status to display detailed alerts and warnings.

  • Added: Improvements that increase the resiliency with the appliance upgrade process.

  • Fixed: Upgrades with etcd were not applied on worker nodes in some cases.

  • Fixed: Issue with cluster network which could in some cases cause node-to-node communication to hang indefinitely.

  • Fixed: Issue with log forwarding causing increased CPU utilization.

1.1.1597283557-2e1fc6a - Aug 19, 2020

This release includes the following fixes and enhancements:

  • Added: Patch for CVE-2020-8558.

  • Added: Automated pre-upgrade checks for validating cluster state before applying the upgrade.

  • Added: Ability to update auth servers in teleport node config.

  • Added: Resiliency improvements to the upgrade agent.

  • Added: RHEL/CentOS 8.0 support.

  • Added: Logging improvements and an additional command line option for following the plan progress during upgrade.

  • Fixed: InfluxDB continuous queries resulting in max series limit exhaustion.

  • Fixed: Cleaning up residual kube-dns resources when upgrading from older versions.

  • Fixed: Issue with etcd shutdown phase during upgrade.

1.1.1593137954-fe02b2c - July 9, 2020

This release includes the following fixes and enhancements:

  • Added: Patch for CVE-2020-13379.

  • Added: Pre-upgrade checks to ensure that the previous upgrade operation was not in progress.

  • Fixed: Kubernetes API server entering failed state during failover.

  • Fixed: Ops Center Monitoring tab displaying Dashboard not found error.

  • Fixed: Disk space check executing for volumes that don’t have disk requirements specified.

  • Fixed: Upgrade failure when manually resumed on a node with an incomplete state.

1.1.1591285019-e135da0 - June 4, 2020

This release includes the following fixes and enhancements:

  • Added: CentOS 7.8 support.

  • Added: Stability and performance improvements.

  • Fixed: Issue with restarting etcd due to large request size during an upgrade.

  • Fixed: Issue with RPC agent credentials not being rotated during an upgrade.

  • Fixed: Issue with pulling images on slow network environments.

  • Fixed: Security issues.

1.1.1588363273-4110aff - May 4, 2020

This release includes the following fixes and enhancements:

  • Added: RHEL 7.8 support.

  • Fixed: Issue with Influxdb consuming high CPU and Memory in some cases over time.

  • Fixed: Issue with Teleport nodes failing to join after expand operation.

  • Fixed: Issue with missed etcd events caused by a forced reboot.

  • Updated: kube-apiserver and kubelet to use Mozilla modern compatibility ciphers.

1.1.1586472858-1609d2f - April 15, 2020

This release includes the following fixes and enhancements:

  • Added: Cleanup mechanism within the appliance to prevent leaking cgroups.

  • Added: Detection for issues with the overlay network.

  • Added: Improvements with appliance upgrades and detection to prevent unsupported upgrade paths.

  • Fixed: Support for copying lengthy commands from the web terminal in the Ops Center.

1.1.1583954392-3121bcd - March 12, 2020

This release includes the following fixes and enhancements:

  • Fixed: Mitigated issues with Buster-based Docker containers in some environments by rolling back to stretch.

  • Fixed: Fixed issue with Teleport nodes failing to upload recorded sessions after upgrading from older clusters.

1.1.1581474166-1f657f1 - February 14, 2020

This release includes the following fixes and enhancements:

  • Fixed: Spurious error message from telegraf-node pod.

  • Fixed: Connectivity between nodes degraded after being restarted.

  • Fixed: A 500 internal error when accessing monitoring and authentication settings using Ops Center.

  • Added: Ability to configure a non-authenticating SMTP server to be used for sending alerts.

1.1.1572976203-3ad8a93 - November 5, 2019

This release includes the following fixes and enhancements:

  • Fixed: In some cases, HTTP and Anypoint Monitoring proxy configuration was removed and had to be re-applied.

  • Fixed: Unused docker0 interface, which had the potential to cause conflicts with existing services in the 172.17.0.0 range, was removed.

1.1.1571866618-0015ffd - October 28, 2019

This release includes the following fixes and enhancements:

  • Fixed: Upgrade fails when a directory which does not exist is listed in /etc/mtab

  • Added: Patch for CVE-2019-11253.

  • Updated: Kubernetes upgraded to v1.13.12.

Known Issues

  • Applying this upgrade will cause the Ops Center to stop reporting heap memory usage for applications. Redeploying your applications will resolve this issue.

1.1.1568899906-253f482 - September 19, 2019

This release includes the following fixes and enhancements:

  • Fixed: Connectivity between nodes was degraded in some cases after upgrading etcd.

  • Added: Patch for CVE-2019-11251.

  • Updated: Kubernetes upgraded to v1.13.11.

1.1.1568409420-d6dff88 - September 13, 2019

This release includes the following fixes and enhancements:

  • Added: Support for more than 3 controller nodes.

1.1.1567702318-6a0bb3f - September 5, 2019

This release includes the following fixes and enhancements:

  • Added: Patch for CVE-2019-9512, CVE-2019-9514, CVE-2019-9512, CVE-2019-9514.

  • Added: Support for RHEL/CentOS 7.7

  • Updated: Kubernetes upgraded to v1.13.10.

1.1.1565299957-f751c25 - August 16, 2019

This release includes the following fixes and enhancements:

  • Added: Patch for CVE-2019-11247 and CVE-2019-11249.

  • Updated: Kubernetes upgraded to v1.13.9.

  • Fixed: Permission error when managing monitoring resources via gravity resource command.

1.1.1561762676-fed2e0b - July 1, 2019

This release includes the following fixes and enhancements:

  • Added: Support for running backup and restore jobs through OpsCenter.

  • Added: Patches to address security vulnerabilities.

  • Updated: Kubernetes upgraded to v1.14.2.

  • Updated: kubedns replaced with coredns to align with upstream Kubernetes defaults.

  • Updated: The patch component versioning scheme is now based on the build time.

(Correction: Kubernetes was upgraded to v1.13.6)

1.0.7 - May 28, 2019

This release includes the following fixes and enhancements:

  • Fixed: Docker proxy to support authorization credentials with special characters.

1.0.6 - April 10, 2019

This release includes the following fixes and enhancements:

  • Added: Patch for CVE-2019-1002100 and CVE-2019-1002101.

1.0.5 - February 22, 2019

This release includes the following fixes and enhancements:

  • Added: Script to allow updating HTTP proxy configuration. (See scripts/ directory)

1.0.4 - February 13, 2019

This release includes the following fixes and enhancements:

  • Added: Security patch to address CVE-2019-5736

1.0.3 - February 6, 2019

This release includes the following fixes and enhancements:

  • Added: Support for RHEL/CentOS 7.6

1.0.2 - January 17, 2019

This release includes the following fixes and enhancements:

  • Added: Patch for internal component used by Ops Center

1.0.1 - December 13, 2018

This release includes the following fixes and enhancements:

  • Added: Security patch to address CVE-2018-1002105

  • Added: Support for RedHatEnterpriseServer

  • Fixed: Mule 4 license handling

1.0.0 - August 13, 2018

Initial release