Mirantis Container Cloud Release Notes latest documentation

Mirantis Container Cloud Release Notes

Releases summary

Version

Release date

Summary

2.2.0 (current)

November 5, 2020

  • Support for VMWare vSphere provider on RHEL

  • Kernel parameters management through BareMetalHostProfile

  • Support of multiple subnets per cluster

  • Optimization of the Container Cloud logs collection

  • Container Cloud API documentation for bare metal

2.1.0

October 19, 2020

  • Node labeling for machines

  • AWS resources discovery in the Container Cloud web UI

  • Credentials statuses for OpenStack and AWS in the Container Cloud web UI

  • StackLight improvements:

    • Grafana upgrade from version 6.6.2 to 7.1.5

    • Grafana Image Renderer pod to offload rendering of images from charts

    • Grafana home dashboard improvements

    • Splitting of the regional and management cluster function in StackLight telemetry to obtain aggregated metrics on the management cluster from regional and managed clusters

    • Amendments to the StackLight alerts

2.0.0

September 16, 2020

First GA release of Container Cloud with the following key features:

  • Container Cloud with Mirantis Kubernetes Engine (MKE) container clusters for the management plane

  • Support for managed Container Cloud with MKE container clusters on top of the AWS, OpenStack, and bare metal cloud providers

  • Support for attaching of the existing MKE standalone clusters

  • Ceph as a Kubernetes storage provider for the bare metal use case

  • Multi-region support for security and scalability

  • IAM integration with MKE container clusters to provide SSO

  • Logging, monitoring, and alerting tuned for MKE with data aggregation to the management cluster and telemetry sent to Mirantis

Product highlights

Mirantis Container Cloud enables you to create and manage Container Cloud clusters across multiple cloud and infrastructure platforms. Currently supported architectures include OpenStack, bare metal, AWS, and VMWare vSphere Technology Preview with more choice coming in the near future.

Container Cloud provides a web UI, CLI, and API to enable a self-service deployment of Container Cloud with Mirantis Kubernetes Engine (MKE) container clusters.

The major features of the Container Cloud GA release include:

  • Container Cloud with MKE multi-cluster
    • Create new fully managed Container Cloud with MKE container clusters on the Container Cloud supported infrastructure and operating system

    • Attach existing MKE 3.3.3 clusters that run on any infrastructure and operating system with a core set of most critical LCM operations

  • Automated software LCM

    Provide automated zero-touch update for Container Cloud and MKE, including Ubuntu operating system updates, with no workload impact

  • Multi-cloud infrastructure support

    Deploy Container Cloud with MKE container clusters through automated provisioning on the following infrastructure platforms: OpenStack, AWS, bare metal

  • Logging, monitoring, alerting

    Monitor individual managed Container Cloud with MKE container clusters as well as provide cluster metrics and alerts on resource utilization aggregated to the Container Cloud level

  • Bare Metal as a Service

    Provision pools of bare metal machines to use as a bare metal provider, which reduces layers of virtualization and provides efficient support for compute-intensive workloads

  • Ceph storage for bare metal

    Deploy Ceph utilizing Rook to provide and manage a robust and scalable persistent storage that can be used by Kubernetes workloads

  • User management

    Integrate IdP and user RBAC to assimilate with corporate single source of truth and assign role-based access

  • Intuitive web UIs for cluster management

    Provide a single UI for multiple cluster management as well as the Container Cloud with MKE container clusters UI for single cluster management

Mirantis Container Cloud releases

This section outlines the release notes for the Mirantis Container Cloud GA release. Within the scope of the Container Cloud GA release, minor releases are being published continuously with new features, improvements, and critical issues resolutions to enhance the Container Cloud GA version. For details, see Mirantis Container Cloud releases and Cluster releases (managed).

Once a new Container Cloud release is available, a management cluster automatically upgrades to a newer consecutive release unless this cluster contains managed clusters with a Cluster release unsupported by that Container Cloud release. For more details about the Container Cloud release mechanism, see Reference Architecture: Release controller.

2.2.0 (current)

This section outlines release notes for the Mirantis Container Cloud GA release 2.2.0. This release introduces support for the Cluster release 5.9.0 that is based on Mirantis Kubernetes Engine 3.3.3, Mirantis Container Runtime 19.03.12, and Kubernetes 1.18. This release also introduces support for the Cluster release 6.8.1 that introduces the support of the Mirantis OpenStack on Kubernetes (MOSK) product.

Enhancements

This section outlines new features and enhancements introduced in the Mirantis Container Cloud release 2.2.0. For the list of enhancements in the Cluster release 5.9.0 and Cluster release 6.8.1 introduced by the Container Cloud release 2.2.0, see 5.9.0 and 6.8.1.


Support for VMWare vSphere provider on RHEL

TECHNICAL PREVIEW

Introduced the Technology Preview support for the VMWare vSphere cloud provider on RHEL, including support for creation and operating of managed clusters using the Container Cloud web UI.

Deployment of an additional regional VMWare vSphere-based cluster or attaching an existing Mirantis Kubernetes Engine (MKE) cluster to a VMWare vSphere-based management cluster is on the development stage and will be announced in one of the following Container Cloud releases.

Note

For the Technology Preview feature definition, refer to the Container Cloud Reference Architecture.


Kernel parameters management through BareMetalHostProfile

Implemented the API for managing kernel parameters typically managed by sysctl for bare metal hosts through the BareMetalHost and BareMetalHostProfile objects fields.


Support of multiple subnets per cluster

Implemented support of multiple subnets per a Container Cloud cluster with an ability to specify a different network type for each subnet. Introduced the SubnetPool object that allows for automatic creation of the Subnet objects. Also, added the L3Layout section to L2Template.spec. The L3Layout configuration allows defining the subnets scopes to be used and to enable auto-creation of subnets from a subnet pool.


Optimization of the Container Cloud logs collection

Optimized user experience with the Container Cloud resources logs collection:

  • Added a separate file with a human-readable table that contains information about cluster events

  • Implemented collecting of system logs from cluster nodes


Container Cloud API documentation for bare metal

On top of continuous improvements delivered to the existing Container Cloud guides, added the Mirantis Container Cloud API section to the Operations Guide. This section is intended only for advanced Infrastructure Operators who are familiar with Kubernetes Cluster API.

Currently, this section contains descriptions and examples of the Container Cloud API resources for the bare metal cloud provider. The API documentation for the OpenStack, AWS, and VMWare vSphere API resources will be added in the upcoming Container Cloud releases.

Known issues

This section lists known issues with workarounds for the Mirantis Container Cloud release 2.2.0 including the Cluster release 5.9.0.

Note

This section also outlines still valid known issues from previous Container Cloud releases.


AWS
[6222] Managed cluster deployment requiring PVs may fail

On a management cluster with multiple AWS-based managed clusters, some clusters fail to complete the deployments that require persistent volumes (PVs), for example, Elasticsearch. Some of the affected pods get stuck in the Pending state with the pod has unbound immediate PersistentVolumeClaims and node(s) had volume node affinity conflict errors.

Warning

The workaround below applies to HA deployments where data can be rebuilt from replicas. If you have a non-HA deployment, back up any existing data before proceeding, since all data will be lost while applying the workaround.

Workaround:

  1. Obtain the persistent volume claims related to the storage mounts of the affected pods:

    kubectl get pod/<pod_name1> pod/<pod_name2> \
    -o jsonpath='{.spec.volumes[?(@.persistentVolumeClaim)].persistentVolumeClaim.claimName}'
    

    Note

    In the command above and in the subsequent steps, substitute the parameters enclosed in angle brackets with the corresponding values.

  2. Delete the affected Pods and PersistentVolumeClaims to reschedule them: For example, for StackLight:

    kubectl -n stacklight delete \
    
      pod/<pod_name1> pod/<pod_name2> ...
      pvc/<pvc_name2> pvc/<pvc_name2> ...
    

Bare metal
[6988] LVM fails to deploy if the volume group name already exists

During a management or managed cluster deployment, LVM cannot be deployed on a new disk if an old volume group with the same name already exists on the target hardware node but on the different disk.

Workaround:

In the bare metal host profile specific to your hardware configuration, add the wipe: true parameter to the device that fails to be deployed. For the procedure details, see Operations Guide: Create a custom host profile.

[7655] Wrong status for an incorrectly configured L2 template

If an L2 template is configured incorrectly, a bare metal cluster is deployed successfully but with the runtime errors in the IpamHost object.

Workaround:

If you suspect that the machine is not working properly because of incorrect network configuration, verify the status of the corresponding IpamHost object. Inspect the l2RenderResult and ipAllocationResult object fields for error messages.

[8560] Manual deletion of BareMetalHosts leads to its silent removal

If BareMetalHost is manually removed from a managed cluster, it is silently removed without a power-off and deprovision that leads to a managed cluster failures.

Workaround:

Do not manually delete a BareMetalHost that has the Provisioned status.


IAM
[2757] IAM fails to start during management cluster deployment

During a management cluster deployment, IAM fails to start with the IAM pods being in the CrashLoopBackOff status.

Workaround:

  1. Log in to the bootstrap node.

  2. Remove the iam-mariadb-state configmap:

    kubectl delete cm -n kaas iam-mariadb-state
    
  3. Manually delete the mariadb pods:

    kubectl delete po -n kaas mariadb-server-{0,1,2}
    

    Wait for the pods to start. If the mariadb pod does not start with the connection to peer timed out exception, repeat the step 2.

  4. Obtain the MariaDB database admin password:

    kubectl get secrets -n kaas mariadb-dbadmin-password \
    -o jsonpath='{.data.MYSQL_DBADMIN_PASSWORD}' | base64 -d ; echo
    
  5. Log in to MariaDB:

    kubectl exec -it -n kaas mariadb-server-0 -- bash -c 'mysql -uroot -p<mysqlDbadminPassword>'
    

    Substitute <mysqlDbadminPassword> with the corresponding value obtained in the previous step.

  6. Run the following command:

    DROP DATABASE IF EXISTS keycloak
    
  7. Manually delete the Keycloak pods:

    
    

Storage
[7073] Cannot automatically remove a Ceph node

When removing a worker node, it is not possible to automatically remove a Ceph node. The workaround is to manually remove the Ceph node from the Ceph cluster as described in Operations Guide: Add, remove, or reconfigure Ceph nodes before removing the worker node from your deployment.

Addressed issues

The following issues have been addressed in the Mirantis Container Cloud release 2.2.0 including the Cluster release 5.9.0:

  • [8012] Fixed the issue with helm-controller pod being stuck in the CrashLoopBackOff state after reattaching of a Mirantis Kubernetes Engine (MKE) cluster.

  • [7131] Fixed the issue with the deployment of a managed cluster failing during the Ceph Monitor or Manager deployment.

  • [6164] Fixed the issue with the number of placement groups (PGs) per Ceph OSD being too small and the Ceph cluster having the HEALTH_WARN status.

  • [8302] Fixed the issue with deletion of a regional cluster leading to the deletion of the related management cluster.

  • [7722] Fixed the issue with the Internal Server Error or similar errors appearing in the HelmBundle controller logs after bootstrapping the management cluster.

Components versions

The following table lists the major components and their versions of the Mirantis Container Cloud release 2.2.0.

Note

The components that are newly added, updated, deprecated, or removed as compared to the previous release version, are marked with a corresponding superscript, for example, lcm-ansible Updated.

Container Cloud release components versions

Component

Application/Service

Version

AWS Updated

aws-provider

1.14.0

aws-credentials-controller

1.14.0

Bare metal

baremetal-operator Updated

3.1.3

baremetal-public-api Updated

3.1.3

baremetal-provider Updated

1.14.0

httpd

2.4.46-20201001171500

ironic Updated

ussuri-bionic-20201021180016

ironic-operator Updated

base-bionic-20201023172943

kaas-ipam Updated

3.1.3

local-volume-provisioner

1.0.4-mcp

mariadb

10.4.14-bionic-20200812025059

IAM

iam Updated

1.1.22

iam-controller Updated

1.14.0

keycloak

9.0.0

Container Cloud Updated

admission-controller

1.14.0

byo-credentials-controller

1.14.0

byo-provider

1.14.3

kaas-public-api

1.14.0

kaas-exporter

1.14.0

kaas-ui

1.14.2

lcm-controller

0.2.0-178-g8cc488f8

release-controller

1.14.0

OpenStack Updated

openstack-provider

1.14.0

os-credentials-controller

1.14.0

Artifacts

This section lists the components artifacts of the Mirantis Container Cloud release 2.2.0.


Note

The components that are newly added, updated, deprecated, or removed as compared to the previous release version, are marked with a corresponding superscript, for example, lcm-ansible Updated.

Bare metal artifacts

Artifact

Component

Path

Binaries

Target system image (ubuntu-bionic)

https://binary.mirantis.com/bm/bin/efi/ubuntu/qcow2-bionic-debug-20200730084816

baremetal-operator Updated

https://binary.mirantis.com/bm/helm/baremetal-operator-3.1.3.tgz

baremetal-public-api Updated

https://binary.mirantis.com/bm/helm/baremetal-public-api-3.1.3.tgz

ironic-python-agent.kernel Updated

https://binary.mirantis.com/bm/bin/ironic/ipa/ubuntu/kernel-ussuri-bionic-debug-20201022084817

ironic-python-agent.initramfs Updated

https://binary.mirantis.com/bm/bin/ironic/ipa/ubuntu/initramfs-ussuri-bionic-debug-20201022084817

kaas-ipam Updated

https://binary.mirantis.com/bm/helm/kaas-ipam-3.1.3.tgz

local-volume-provisioner

https://binary.mirantis.com/bm/helm/local-volume-provisioner-1.0.4-mcp.tgz

Docker images

baremetal-operator Updated

mirantis.azurecr.io/bm/baremetal-operator:base-bionic-20201028131325

httpd

mirantis.azurecr.io/bm/external/httpd:2.4.46-20201001171500

ironic Updated

mirantis.azurecr.io/openstack/ironic:ussuri-bionic-20201021180016

ironic-inspector Updated

mirantis.azurecr.io/openstack/ironic-inspector:ussuri-bionic-20201021180016

ironic-operator Updated

mirantis.azurecr.io/bm/ironic-operator:base-bionic-20201023172943

kaas-ipam Updated

mirantis.azurecr.io/bm/kaas_ipam:base-bionic-20201026094912

mariadb

mirantis.azurecr.io/general/mariadb:10.4.14-bionic-20200812025059


Core artifacts

Artifact

Component

Path

Bootstrap tarball Updated

bootstrap-linux

https://binary.mirantis.com/core/bin/bootstrap-linux-1.14.0.tar.gz

bootstrap-darwin

https://binary.mirantis.com/core/bin/bootstrap-darwin-1.14.0.tar.gz

Helm charts Updated

admission-controller

https://binary.mirantis.com/core/helm/admission-controller-1.14.0.tgz

aws-credentials-controller

https://binary.mirantis.com/core/helm/aws-credentials-controller-1.14.0.tgz

aws-provider

https://binary.mirantis.com/core/helm/aws-provider-1.14.0.tgz

baremetal-provider

https://binary.mirantis.com/core/helm/baremetal-provider-1.14.0.tgz

byo-credentials-controller

https://binary.mirantis.com/core/helm/byo-credentials-controller-1.14.0.tgz

byo-provider

https://binary.mirantis.com/core/helm/byo-provider-1.14.3.tgz

iam-controller

https://binary.mirantis.com/core/helm/iam-controller-1.14.0.tgz

kaas-exporter

https://binary.mirantis.com/core/helm/kaas-exporter-1.14.0.tgz

kaas-public-api

https://binary.mirantis.com/core/helm/kaas-public-api-1.14.0.tgz

kaas-ui

https://binary.mirantis.com/core/helm/kaas-ui-1.14.2.tgz

lcm-controller

https://binary.mirantis.com/core/helm/lcm-controller-1.14.0.tgz

openstack-provider

https://binary.mirantis.com/core/helm/openstack-provider-1.14.0.tgz

os-credentials-controller

https://binary.mirantis.com/core/helm/os-credentials-controller-1.14.0.tgz

release-controller

https://binary.mirantis.com/core/helm/release-controller-1.14.0.tgz

Docker images for Container Cloud deployment

admission-controller Updated

mirantis.azurecr.io/core/admission-controller:1.14.0

aws-cluster-api-controller

mirantis.azurecr.io/core/aws-cluster-api-controller:1.14.0

aws-credentials-controller Updated

mirantis.azurecr.io/core/aws-credentials-controller:1.14.0

byo-credentials-controller Updated

mirantis.azurecr.io/core/byo-credentials-controller:1.14.0

cluster-api-provider-baremetal Updated

mirantis.azurecr.io/core/cluster-api-provider-baremetal:1.14.0

frontend

mirantis.azurecr.io/core/frontend:1.14.2

iam-controller Updated

mirantis.azurecr.io/core/iam-controller:1.14.0

lcm-controller Updated

mirantis.azurecr.io/core/lcm-controller:v0.2.0-178-g8cc488f8

openstack-cluster-api-controller

mirantis.azurecr.io/core/openstack-cluster-api-controller:1.14.0

os-credentials-controller Updated

mirantis.azurecr.io/core/os-credentials-controller:1.14.0

release-controller Updated

mirantis.azurecr.io/core/release-controller:1.14.0


IAM artifacts

Artifact

Component

Path

Binaries

hash-generate-linux

http://binary.mirantis.com/iam/bin/hash-generate-0.0.1-268-3cf7f17-linux

hash-generate-darwin

http://binary.mirantis.com/iam/bin/hash-generate-0.0.1-268-3cf7f17-darwin

iamctl-linux

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-linux

iamctl-darwin

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-darwin

iamctl-windows

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-windows

Helm charts

iam Updated

http://binary.mirantis.com/iam/helm/iam-1.1.22.tgz

iam-proxy

http://binary.mirantis.com/iam/helm/iam-proxy-0.2.2.tgz

keycloak-proxy Updated

http://binary.mirantis.com/core/helm/keycloak_proxy-1.14.3.tgz

Docker images

api

mirantis.azurecr.io/iam/api:0.3.18

auxiliary

mirantis.azurecr.io/iam/auxiliary:0.3.18

kubernetes-entrypoint

mirantis.azurecr.io/iam/external/kubernetes-entrypoint:v0.3.1

mariadb

mirantis.azurecr.io/iam/external/mariadb:10.2.18

keycloak Updated

mirantis.azurecr.io/iam/keycloak:0.3.19

keycloak-gatekeeper

mirantis.azurecr.io/iam/keycloak-gatekeeper:6.0.1

Obsolete releases

2.1.0

This section outlines release notes for the Mirantis Container Cloud GA release 2.1.0. This release introduces support for the Cluster release 5.8.0 that is based on Mirantis Kubernetes Engine 3.3.3, Mirantis Container Runtime 19.03.12, and Kubernetes 1.18.

Enhancements

This section outlines new features and enhancements introduced in the Mirantis Container Cloud release 2.1.0. For the list of enhancements in the Cluster release 5.8.0 introduced by the KaaS release 2.1.0, see 5.8.0.


Node labeling for machines

Implemented the possibility to assign labels to specific machines with dedicated system and hardware resources through the Container Cloud web UI. For example, you can label the StackLight nodes that run Elasticsearch and require more resources than a standard node to run the StackLight components services on the dedicated nodes. You can label a machine before or after it is deployed. The list of available labels is taken from the current Cluster release.

Node labeling greatly improves cluster performance and prevents pods from being quickly exhausted.


AWS resources discovery in Container Cloud web UI

Improved the user experience during a managed cluster creation using the Container Cloud web UI by implementing drop-down menus with available supported values for the following AWS resources:

  • AWS region

  • AWS AMI ID

  • AWS instance type

To apply the feature to existing deployments, update the IAM policies for AWS as described in Apply updates to the AWS-based management clusters.


Credentials statuses for OpenStack and AWS

Implemented the following statuses for the OpenStack-based and AWS-based credentials in the Container Cloud web UI:

  • Ready

    Credentials are valid and ready to be used for a managed cluster creation.

  • In Use

    Credentials are being used by a managed cluster.

  • Error

    Credentials are invalid. You can hover over the Error status to determine the reason of the issue.

Known issues

This section lists known issues with workarounds for the Mirantis Container Cloud release 2.1.0.

Note

This section also outlines still valid known issues from previous Container Cloud releases.


AWS
[6222] Managed cluster deployment requiring PVs may fail

On a management cluster with multiple AWS-based managed clusters, some clusters fail to complete the deployments that require persistent volumes (PVs), for example, Elasticsearch. Some of the affected pods get stuck in the Pending state with the pod has unbound immediate PersistentVolumeClaims and node(s) had volume node affinity conflict errors.

Warning

The workaround below applies to HA deployments where data can be rebuilt from replicas. If you have a non-HA deployment, back up any existing data before proceeding, since all data will be lost while applying the workaround.

Workaround:

  1. Obtain the persistent volume claims related to the storage mounts of the affected pods:

    kubectl get pod/<pod_name1> pod/<pod_name2> \
    -o jsonpath='{.spec.volumes[?(@.persistentVolumeClaim)].persistentVolumeClaim.claimName}'
    

    Note

    In the command above and in the subsequent steps, substitute the parameters enclosed in angle brackets with the corresponding values.

  2. Delete the affected Pods and PersistentVolumeClaims to reschedule them: For example, for StackLight:

    kubectl -n stacklight delete \
    
      pod/<pod_name1> pod/<pod_name2> ...
      pvc/<pvc_name2> pvc/<pvc_name2> ...
    

Bare metal
[6988] LVM fails to deploy if the volume group name already exists

During a management or managed cluster deployment, LVM cannot be deployed on a new disk if an old volume group with the same name already exists on the target hardware node but on the different disk.

Workaround:

In the bare metal host profile specific to your hardware configuration, add the wipe: true parameter to the device that fails to be deployed. For the procedure details, see Operations Guide: Create a custom host profile.


IAM
[2757] IAM fails to start during management cluster deployment

During a management cluster deployment, IAM fails to start with the IAM pods being in the CrashLoopBackOff status.

Workaround:

  1. Log in to the bootstrap node.

  2. Remove the iam-mariadb-state configmap:

    kubectl delete cm -n kaas iam-mariadb-state
    
  3. Manually delete the mariadb pods:

    kubectl delete po -n kaas mariadb-server-{0,1,2}
    

    Wait for the pods to start. If the mariadb pod does not start with the connection to peer timed out exception, repeat the step 2.

  4. Obtain the MariaDB database admin password:

    kubectl get secrets -n kaas mariadb-dbadmin-password \
    -o jsonpath='{.data.MYSQL_DBADMIN_PASSWORD}' | base64 -d ; echo
    
  5. Log in to MariaDB:

    kubectl exec -it -n kaas mariadb-server-0 -- bash -c 'mysql -uroot -p<mysqlDbadminPassword>'
    

    Substitute <mysqlDbadminPassword> with the corresponding value obtained in the previous step.

  6. Run the following command:

    DROP DATABASE IF EXISTS keycloak
    
  7. Manually delete the Keycloak pods:

    
    

Storage
[6164] Small number of PGs per Ceph OSD

Fixed in 2.2.0

After deploying a managed cluster with Ceph, the number of placement groups (PGs) per Ceph OSD may be too small and the Ceph cluster may have the HEALTH_WARN status:

health: HEALTH_WARN
        too few PGs per OSD (3 < min 30)

The workaround is to enable the PG balancer to properly manage the number of PGs:

kexec -it $(k get pod -l "app=rook-ceph-tools" --all-namespaces -o jsonpath='{.items[0].metadata.name}') -n rook-ceph bash
ceph mgr module enable pg_autoscaler
[7073] Cannot automatically remove a Ceph node

When removing a worker node, it is not possible to automatically remove a Ceph node. The workaround is to manually remove the Ceph node from the Ceph cluster as described in Operations Guide: Add, remove, or reconfigure Ceph nodes before removing the worker node from your deployment.

[7131] rook-ceph-mgr fails during managed cluster deployment

Fixed in 2.2.0

Occasionally, the deployment of a managed cluster may fail during the Ceph Monitor or Manager deployment. In this case, the Ceph cluster may be down and and a stack trace similar to the following one may be present in Ceph Manager logs:

kubectl -n rook-ceph logs rook-ceph-mgr-a-c5dc846f8-k68rs

/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/mon/MonMap.h: In function 'void MonMap::add(const mon_info_t&)' thread 7fd3d3744b80 time 2020-09-03 10:16:46.586388
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/mon/MonMap.h: 195: FAILED ceph_assert(addr_mons.count(a) == 0)
ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7fd3ca9b2875]
2: (()+0x253a3d) [0x7fd3ca9b2a3d]
3: (MonMap::add(mon_info_t const&)+0x80) [0x7fd3cad49190]
4: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x110) [0x7fd3cad493a0]
5: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xc9) [0x7fd3cad43849]
6: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x314) [0x7fd3cad45af4]
7: (MonClient::build_initial_monmap()+0x130) [0x7fd3cad2e140]
8: (MonClient::get_monmap_and_config()+0x5f) [0x7fd3cad365af]
9: (global_pre_init(std::map<std::string, std::string, std::less<std::string>, std::allocator<std::pair<std::string const, std::string> > > const*, std::vector<char const*, std::allocator<char const*> >&, unsigned int, code_environment_t, int)+0x524) [0x55ce86711444]
10: (global_init(std::map<std::string, std::string, std::less<std::string>, std::allocator<std::pair<std::string const, std::string> > > const*, std::vector<char const*, std::allocator<char const*> >&, unsigned int, code_environment_t, int, char const*, bool)+0x76) [0x55ce86711b56]
11: (main()+0x136) [0x55ce864ff9a6]
12: (__libc_start_main()+0xf5) [0x7fd3c6e73555]
13: (()+0xfc010) [0x55ce86505010]

The workaround is to start the managed cluster deployment from scratch.

Addressed issues

In the Mirantis Container Cloud release 2.1.0, the following issues have been addressed:

  • [7281] Fixed the issue with a management cluster bootstrap script failing if there was a space in the PATH environment variable.

  • [7205] Fixed the issue with some cluster objects being stuck during deletion of an AWS-based managed cluster due to unresolved VPC dependencies.

  • [7304] Fixed the issue with failure to reattach a Mirantis Kubernetes Engine (MKE) cluster with the same name.

  • [7101] Fixed the issue with the monitoring of Ceph and Ironic being enabled when Ceph and Ironic are disabled on the baremetal-based clusters.

  • [7324] Fixed the issue with the monitoring of Ceph being disabled on the baremetal-based managed clusters due to the missing provider: BareMetal parameter.

  • [7180] Fixed the issue with lcm-controller periodically failing with the invalid memory address or nil pointer dereference runtime error.

  • [7251] Fixed the issue with setting up the OIDC integration on the MKE side.

  • [7326] Fixed the issue with the missing entry for the host itself in etc/hosts causing failure of services that require node FQDN.

  • [6989] Fixed the issue with baremetal-operator ignoring the clean failed provisioning state if a node fails to deploy on a baremetal-based managed cluster.

  • [7231] Fixed the issue with the baremetal-provider pod not restarting after the ConfigMap changes and causing the telemeter-client pod to fail during deployment.

Components versions

The following table lists the major components and their versions of the Mirantis Container Cloud release 2.1.0.

Note

The components that are newly added, updated, deprecated, or removed as compared to the previous release version, are marked with a corresponding superscript, for example, lcm-ansible Updated.

Container Cloud release components versions

Component

Application/Service

Version

AWS Updated

aws-provider

1.12.2

aws-credentials-controller

1.12.2

Bare metal

baremetal-operator Updated

3.1.0

baremetal-public-api New

3.1.0

baremetal-provider Updated

1.12.2

httpd Updated

2.4.46-20201001171500

ironic

train-bionic-20200803180020

ironic-operator

base-bionic-20200805144858

kaas-ipam Updated

3.1.0

local-volume-provisioner

1.0.4-mcp

mariadb Updated

10.4.14-bionic-20200812025059

IAM

iam Updated

1.1.18

iam-controller Updated

1.12.2

keycloak

9.0.0

Container Cloud Updated

admission-controller

1.12.3

byo-credentials-controller

1.12.2

byo-provider

1.12.2

kaas-public-api

1.12.2

kaas-exporter

1.12.2

kaas-ui

1.12.2

lcm-controller

0.2.0-169-g5668304d

release-controller

1.12.2

OpenStack Updated

openstack-provider

1.12.2

os-credentials-controller

1.12.2

Artifacts

This section lists the components artifacts of the Mirantis Container Cloud release 2.1.0.


Note

The components that are newly added, updated, deprecated, or removed as compared to the previous release version, are marked with a corresponding superscript, for example, lcm-ansible Updated.

Bare metal artifacts

Artifact

Component

Path

Binaries

Target system image (ubuntu-bionic)

https://binary.mirantis.com/bm/bin/efi/ubuntu/qcow2-bionic-debug-20200730084816

baremetal-operator Updated

https://binary.mirantis.com/bm/helm/baremetal-operator-3.1.0.tgz

baremetal-public-api New

https://binary.mirantis.com/bm/helm/baremetal-public-api-3.1.0.tgz

ironic-python-agent.kernel

https://binary.mirantis.com/bm/bin/ironic/ipa/ubuntu/kernel-train-bionic-debug-20200730084816

ironic-python-agent.initramfs

https://binary.mirantis.com/bm/bin/ironic/ipa/ubuntu/initramfs-train-bionic-debug-20200730084816

kaas-ipam Updated

https://binary.mirantis.com/bm/helm/kaas-ipam-3.1.0.tgz

local-volume-provisioner

https://binary.mirantis.com/bm/helm/local-volume-provisioner-1.0.4-mcp.tgz

Docker images

baremetal-operator Updated

mirantis.azurecr.io/bm/baremetal-operator:base-bionic-20201005150946

httpd Updated

mirantis.azurecr.io/bm/external/httpd:2.4.46-20201001171500

ironic

mirantis.azurecr.io/openstack/ironic:train-bionic-20200803180020

ironic-inspector

mirantis.azurecr.io/openstack/ironic-inspector:train-bionic-20200803180020

ironic-operator

mirantis.azurecr.io/bm/ironic-operator:base-bionic-20200805144858

kaas-ipam Updated

mirantis.azurecr.io/bm/kaas_ipam:base-bionic-20201007180518

mariadb Updated

mirantis.azurecr.io/general/mariadb:10.4.14-bionic-20200812025059


Core artifacts

Artifact

Component

Path

Bootstrap tarball Updated

bootstrap-linux

https://binary.mirantis.com/core/bin/bootstrap-linux-1.12.2.tar.gz

bootstrap-darwin

https://binary.mirantis.com/core/bin/bootstrap-darwin-1.12.2.tar.gz

Helm charts Updated

admission-controller

https://binary.mirantis.com/core/helm/admission-controller-1.12.3.tgz

aws-credentials-controller

https://binary.mirantis.com/core/helm/aws-credentials-controller-1.12.2.tgz

aws-provider

https://binary.mirantis.com/core/helm/aws-provider-1.12.2.tgz

baremetal-provider

https://binary.mirantis.com/core/helm/baremetal-provider-1.12.2.tgz

byo-credentials-controller

https://binary.mirantis.com/core/helm/byo-credentials-controller-1.12.2.tgz

byo-provider

https://binary.mirantis.com/core/helm/byo-provider-1.12.2.tgz

iam-controller

https://binary.mirantis.com/core/helm/iam-controller-1.12.2.tgz

kaas-exporter

https://binary.mirantis.com/core/helm/kaas-exporter-1.12.2.tgz

kaas-public-api

https://binary.mirantis.com/core/helm/kaas-public-api-1.12.2.tgz

kaas-ui

https://binary.mirantis.com/core/helm/kaas-ui-1.12.2.tgz

lcm-controller

https://binary.mirantis.com/core/helm/lcm-controller-1.12.2.tgz

openstack-provider

https://binary.mirantis.com/core/helm/openstack-provider-1.12.2.tgz

os-credentials-controller

https://binary.mirantis.com/core/helm/os-credentials-controller-1.12.2.tgz

release-controller

https://binary.mirantis.com/core/helm/release-controller-1.12.2.tgz

Docker images for Container Cloud deployment Updated

admission-controller

mirantis.azurecr.io/core/admission-controller:1.12.3

aws-cluster-api-controller

mirantis.azurecr.io/core/aws-cluster-api-controller:1.12.2

aws-credentials-controller

mirantis.azurecr.io/core/aws-credentials-controller:1.12.2

byo-credentials-controller

mirantis.azurecr.io/core/byo-credentials-controller:1.12.2

cluster-api-provider-baremetal

mirantis.azurecr.io/core/cluster-api-provider-baremetal:1.12.2

frontend

mirantis.azurecr.io/core/frontend:1.12.2

iam-controller

mirantis.azurecr.io/core/iam-controller:1.12.2

lcm-controller

mirantis.azurecr.io/core/lcm-controller:v0.2.0-169-g5668304d

openstack-cluster-api-controller

mirantis.azurecr.io/core/openstack-cluster-api-controller:1.12.2

os-credentials-controller

mirantis.azurecr.io/core/os-credentials-controller:1.12.2

release-controller

mirantis.azurecr.io/core/release-controller:1.12.2


IAM artifacts

Artifact

Component

Path

Binaries

hash-generate-linux

http://binary.mirantis.com/iam/bin/hash-generate-0.0.1-236-9cea809-linux

hash-generate-darwin

http://binary.mirantis.com/iam/bin/hash-generate-0.0.1-236-9cea809-darwin

iamctl-linux

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-linux

iamctl-darwin

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-darwin

iamctl-windows

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-windows

Helm charts

iam Updated

http://binary.mirantis.com/iam/helm/iam-1.1.18.tgz

iam-proxy

http://binary.mirantis.com/iam/helm/iam-proxy-0.2.2.tgz

keycloak-proxy Updated

http://binary.mirantis.com/core/helm/keycloak_proxy-1.12.2.tgz

Docker images

api

mirantis.azurecr.io/iam/api:0.3.18

auxiliary

mirantis.azurecr.io/iam/auxiliary:0.3.18

kubernetes-entrypoint

mirantis.azurecr.io/iam/external/kubernetes-entrypoint:v0.3.1

mariadb

mirantis.azurecr.io/iam/external/mariadb:10.2.18

keycloak

mirantis.azurecr.io/iam/keycloak:0.3.18

keycloak-gatekeeper

mirantis.azurecr.io/iam/keycloak-gatekeeper:6.0.1

Apply updates to the AWS-based management clusters

To complete the AWS-based management cluster upgrade to version 2.1.0, manually update the IAM policies for AWS before updating your AWS-based managed clusters.

To update the IAM policies for AWS:

  1. Choose from the following options:

    • Update the IAM policies using get_container_cloud.sh:

      1. On any local machine, download and run the latest version of the Container Cloud bootstrap script:

        wget https://binary.mirantis.com/releases/get_container_cloud.sh
        
        chmod 0755 get_container_cloud.sh
        
        ./get_container_cloud.sh
        
      2. Change the directory to the kaas-bootstrap folder created by the get_container_cloud.sh script.

      3. Export the following parameters by adding the corresponding values for the AWS admin credentials:

        export AWS_SECRET_ACCESS_KEY=XXXXXXX
        export AWS_ACCESS_KEY_ID=XXXXXXX
        export AWS_DEFAULT_REGION=us-east-2
        
      4. Update the AWS CloudFormation template for IAM policy:

        ./kaas bootstrap aws policy
        
    • Update the IAM policies using the AWS Management Console:

      1. Log in to your AWS Management Console.

      2. Verify that the controllers.cluster-api-provider-aws.kaas.mirantis.com role or another AWS role that you use for Container Cloud users contains the following permissions:

        "ec2:DescribeRegions", "ec2:DescribeInstanceTypes"
        

        Otherwise, add these permissions manually.

  2. Proceed to updating your AWS-based managed clusters as described in Operations Guide: Update a managed cluster.

2.0.0

This section outlines release notes for the initial Mirantis Container Cloud GA release 2.0.0. This release introduces support for the Cluster release 5.7.0 that is based on Mirantis Kubernetes Engine 3.3.3, Mirantis Container Runtime 19.03.12, and Kubernetes 1.18.

Known issues

This section lists known issues with workarounds for the Mirantis Container Cloud release 2.0.0.


AWS
[6222] Managed cluster deployment requiring PVs may fail

On a management cluster with multiple AWS-based managed clusters, some clusters fail to complete the deployments that require persistent volumes (PVs), for example, Elasticsearch. Some of the affected pods get stuck in the Pending state with the pod has unbound immediate PersistentVolumeClaims and node(s) had volume node affinity conflict errors.

Warning

The workaround below applies to HA deployments where data can be rebuilt from replicas. If you have a non-HA deployment, back up any existing data before proceeding, since all data will be lost while applying the workaround.

Workaround:

  1. Obtain the persistent volume claims related to the storage mounts of the affected pods:

    kubectl get pod/<pod_name1> pod/<pod_name2> \
    -o jsonpath='{.spec.volumes[?(@.persistentVolumeClaim)].persistentVolumeClaim.claimName}'
    

    Note

    In the command above and in the subsequent steps, substitute the parameters enclosed in angle brackets with the corresponding values.

  2. Delete the affected Pods and PersistentVolumeClaims to reschedule them: For example, for StackLight:

    kubectl -n stacklight delete \
    
      pod/<pod_name1> pod/<pod_name2> ...
      pvc/<pvc_name2> pvc/<pvc_name2> ...
    

Bare metal
[6988] LVM fails to deploy if the volume group name already exists

During a management or managed cluster deployment, LVM cannot be deployed on a new disk if an old volume group with the same name already exists on the target hardware node but on the different disk.

Workaround:

In the bare metal host profile specific to your hardware configuration, add the wipe: true parameter to the device that fails to be deployed. For the procedure details, see Operations Guide: Create a custom host profile.


IAM
[2757] IAM fails to start during management cluster deployment

During a management cluster deployment, IAM fails to start with the IAM pods being in the CrashLoopBackOff status.

Workaround:

  1. Log in to the bootstrap node.

  2. Remove the iam-mariadb-state configmap:

    kubectl delete cm -n kaas iam-mariadb-state
    
  3. Manually delete the mariadb pods:

    kubectl delete po -n kaas mariadb-server-{0,1,2}
    

    Wait for the pods to start. If the mariadb pod does not start with the connection to peer timed out exception, repeat the step 2.

  4. Obtain the MariaDB database admin password:

    kubectl get secrets -n kaas mariadb-dbadmin-password \
    -o jsonpath='{.data.MYSQL_DBADMIN_PASSWORD}' | base64 -d ; echo
    
  5. Log in to MariaDB:

    kubectl exec -it -n kaas mariadb-server-0 -- bash -c 'mysql -uroot -p<mysqlDbadminPassword>'
    

    Substitute <mysqlDbadminPassword> with the corresponding value obtained in the previous step.

  6. Run the following command:

    DROP DATABASE IF EXISTS keycloak;
    
  7. Manually delete the Keycloak pods:

    kubectl delete po -n kaas iam-keycloak-{0,1,2}
    

StackLight
[7101] Monitoring of disabled components

Fixed in 2.1.0

On the baremetal-based clusters, the monitoring of Ceph and Ironic is enabled when Ceph and Ironic are disabled. The issue with Ceph relates to both management or managed clusters, the issue with Ironic relates to managed clusters only.

Workaround:

  1. Open the StackLight configuration manifest as described in Operations Guide: Configure StackLight.

  2. Add the following parameter to the StackLight helmReleases values of the Cluster object to explicitly disable the required component monitoring:

    • For Ceph:

      helmReleases:
        - name: stacklight
          values:
            ...
            ceph:
              disabledOnBareMetal: true
            ...
      
    • For Ironic:

      helmReleases:
        - name: stacklight
          values:
            ...
            ironic:
              disabledOnBareMetal: true
            ...
      
[7324] Ceph monitoring disabled

Fixed in 2.1.0

Ceph monitoring may be disabled on the baremetal-based managed clusters due to a missing provider: BareMetal parameter.

Workaround:

  1. Open the StackLight configuration manifest as described in Operations Guide: Configure StackLight.

  2. Add the provider: BareMetal parameter to the StackLight helmReleases values of the Cluster object:

    spec:
      providerSpec:
        value:
          helmReleases:
          - name: stacklight
            values:
              ...
              provider: BareMetal
              ...
    

Storage
[6164] Small number of PGs per Ceph OSD

Fixed in 2.2.0

After deploying a managed cluster with Ceph, the number of placement groups (PGs) per Ceph OSD may be too small and the Ceph cluster may have the HEALTH_WARN status:

health: HEALTH_WARN
        too few PGs per OSD (3 < min 30)

The workaround is to enable the PG balancer to properly manage the number of PGs:

kexec -it $(k get pod -l "app=rook-ceph-tools" --all-namespaces -o jsonpath='{.items[0].metadata.name}') -n rook-ceph bash
ceph mgr module enable pg_autoscaler
[7073] Cannot automatically remove a Ceph node

When removing a worker node, it is not possible to automatically remove a Ceph node. The workaround is to manually remove the Ceph node from the Ceph cluster as described in Operations Guide: Add, remove, or reconfigure Ceph nodes before removing the worker node from your deployment.

[7131] rook-ceph-mgr fails during managed cluster deployment

Fixed in 2.2.0

Occasionally, the deployment of a managed cluster may fail during the Ceph Monitor or Manager deployment. In this case, the Ceph cluster may be down and and a stack trace similar to the following one may be present in Ceph Manager logs:

kubectl -n rook-ceph logs rook-ceph-mgr-a-c5dc846f8-k68rs

/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/mon/MonMap.h: In function 'void MonMap::add(const mon_info_t&)' thread 7fd3d3744b80 time 2020-09-03 10:16:46.586388
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/gigantic/release/14.2.9/rpm/el7/BUILD/ceph-14.2.9/src/mon/MonMap.h: 195: FAILED ceph_assert(addr_mons.count(a) == 0)
ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x7fd3ca9b2875]
2: (()+0x253a3d) [0x7fd3ca9b2a3d]
3: (MonMap::add(mon_info_t const&)+0x80) [0x7fd3cad49190]
4: (MonMap::add(std::string const&, entity_addrvec_t const&, int)+0x110) [0x7fd3cad493a0]
5: (MonMap::init_with_ips(std::string const&, bool, std::string const&)+0xc9) [0x7fd3cad43849]
6: (MonMap::build_initial(CephContext*, bool, std::ostream&)+0x314) [0x7fd3cad45af4]
7: (MonClient::build_initial_monmap()+0x130) [0x7fd3cad2e140]
8: (MonClient::get_monmap_and_config()+0x5f) [0x7fd3cad365af]
9: (global_pre_init(std::map<std::string, std::string, std::less<std::string>, std::allocator<std::pair<std::string const, std::string> > > const*, std::vector<char const*, std::allocator<char const*> >&, unsigned int, code_environment_t, int)+0x524) [0x55ce86711444]
10: (global_init(std::map<std::string, std::string, std::less<std::string>, std::allocator<std::pair<std::string const, std::string> > > const*, std::vector<char const*, std::allocator<char const*> >&, unsigned int, code_environment_t, int, char const*, bool)+0x76) [0x55ce86711b56]
11: (main()+0x136) [0x55ce864ff9a6]
12: (__libc_start_main()+0xf5) [0x7fd3c6e73555]
13: (()+0xfc010) [0x55ce86505010]

The workaround is to start the managed cluster deployment from scratch.


Bootstrap
[7281] Space in PATH causes failure of bootstrap process

Fixed in 2.1.0

A management cluster bootstrap script fails if there is a space in the PATH environment variable. As a workaround, before running the bootstrap.sh script, verify that there are no spaces in the PATH environment variable.

Components versions

The following table lists the major components and their versions of the Mirantis Container Cloud release 2.0.0.

Container Cloud release components versions

Component

Application/Service

Version

AWS

aws-provider

1.10.12

aws-credentials-controller

1.10.12

Bare metal

baremetal-operator

3.0.7

baremetal-provider

1.10.12

httpd

2.4.43-20200710111500

ironic

train-bionic-20200803180020

ironic-operator

base-bionic-20200805144858

kaas-ipam

3.0.7

local-volume-provisioner

1.0.4-mcp

mariadb

10.4.12-bionic-20200803130834

IAM

iam

1.1.16

iam-controller

1.10.12

keycloak

9.0.0

Container Cloud

admission-controller

1.10.12

byo-credentials-controller

1.10.12

byo-provider

1.10.12

kaas-public-api

1.10.12

kaas-exporter

1.10.12

kaas-ui

1.10.12

lcm-controller

0.2.0-149-g412c5a05

release-controller

1.10.12

OpenStack

openstack-provider

1.10.12

os-credentials-controller

1.10.12

Artifacts

This section lists the components artifacts of the Mirantis Container Cloud release 2.0.0.


Bare metal artifacts

Artifact

Component

Path

Binaries

Target system image (ubuntu-bionic)

https://binary.mirantis.com/bm/bin/efi/ubuntu/qcow2-bionic-debug-20200730084816

baremetal-operator

https://binary.mirantis.com/bm/helm/baremetal-operator-3.0.7.tgz

ironic-python-agent.kernel

https://binary.mirantis.com/bm/bin/ironic/ipa/ubuntu/kernel-train-bionic-debug-20200730084816

ironic-python-agent.initramfs

https://binary.mirantis.com/bm/bin/ironic/ipa/ubuntu/initramfs-train-bionic-debug-20200730084816

kaas-ipam

https://binary.mirantis.com/bm/helm/kaas-ipam-3.0.7.tgz

local-volume-provisioner

https://binary.mirantis.com/bm/helm/local-volume-provisioner-1.0.4-mcp.tgz

Docker images

baremetal-operator

mirantis.azurecr.io/bm/baremetal-operator:base-bionic-20200812172956

httpd

mirantis.azurecr.io/bm/external/httpd:2.4.43-20200710111500

ironic

mirantis.azurecr.io/openstack/ironic:train-bionic-20200803180020

ironic-inspector

mirantis.azurecr.io/openstack/ironic-inspector:train-bionic-20200803180020

ironic-operator

mirantis.azurecr.io/bm/ironic-operator:base-bionic-20200805144858

kaas-ipam

mirantis.azurecr.io/bm/kaas_ipam:base-bionic-20200807130953

mariadb

mirantis.azurecr.io/general/mariadb:10.4.12-bionic-20200803130834


Core components artifacts

Artifact

Component

Path

Bootstrap tarball

bootstrap-linux

https://binary.mirantis.com/core/bin/bootstrap-linux-1.10.12.tar.gz

bootstrap-darwin

https://binary.mirantis.com/core/bin/bootstrap-darwin-1.10.12.tar.gz

Helm charts

admission-controller

https://binary.mirantis.com/core/helm/admission-controller-1.10.12.tgz

aws-credentials-controller

https://binary.mirantis.com/core/helm/aws-credentials-controller-1.10.12.tgz

aws-provider

https://binary.mirantis.com/core/helm/aws-provider-1.10.12.tgz

baremetal-provider

https://binary.mirantis.com/core/helm/baremetal-provider-1.10.12.tgz

byo-credentials-controller

https://binary.mirantis.com/core/helm/byo-credentials-controller-1.10.12.tgz

byo-provider

https://binary.mirantis.com/core/helm/byo-provider-1.10.12.tgz

iam-controller

https://binary.mirantis.com/core/helm/iam-controller-1.10.12.tgz

kaas-exporter

https://binary.mirantis.com/core/helm/kaas-exporter-1.10.12.tgz

kaas-public-api

https://binary.mirantis.com/core/helm/kaas-public-api-1.10.12.tgz

kaas-ui

https://binary.mirantis.com/core/helm/kaas-ui-1.10.12.tgz

lcm-controller

https://binary.mirantis.com/core/helm/lcm-controller-1.10.12.tgz

openstack-provider

https://binary.mirantis.com/core/helm/openstack-provider-1.10.12.tgz

os-credentials-controller

https://binary.mirantis.com/core/helm/os-credentials-controller-1.10.12.tgz

release-controller

https://binary.mirantis.com/core/helm/release-controller-1.10.12.tgz

Docker images for Container Cloud deployment

aws-cluster-api-controller

mirantis.azurecr.io/core/aws-cluster-api-controller:1.10.12

aws-credentials-controller

mirantis.azurecr.io/core/aws-credentials-controller:1.10.12

byo-credentials-controller

mirantis.azurecr.io/core/byo-credentials-controller:1.10.12

cluster-api-provider-baremetal

mirantis.azurecr.io/core/cluster-api-provider-baremetal:1.10.12

frontend

mirantis.azurecr.io/core/frontend:1.10.12

iam-controller

mirantis.azurecr.io/core/iam-controller:1.10.12

lcm-controller

mirantis.azurecr.io/core/lcm-controller:v0.2.0-149-g412c5a05

openstack-cluster-api-controller

mirantis.azurecr.io/core/openstack-cluster-api-controller:1.10.12

os-credentials-controller

mirantis.azurecr.io/core/os-credentials-controller:1.10.12

release-controller

mirantis.azurecr.io/core/release-controller:1.10.12


IAM artifacts

Artifact

Component

Path

Binaries

hash-generate-linux

http://binary.mirantis.com/iam/bin/hash-generate-0.0.1-236-9cea809-linux

hash-generate-darwin

http://binary.mirantis.com/iam/bin/hash-generate-0.0.1-236-9cea809-darwin

iamctl-linux

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-linux

iamctl-darwin

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-darwin

iamctl-windows

http://binary.mirantis.com/iam/bin/iamctl-0.3.18-windows

Helm charts

iam

http://binary.mirantis.com/iam/helm/iam-1.1.16.tgz

iam-proxy

http://binary.mirantis.com/iam/helm/iam-proxy-0.2.2.tgz

keycloak-proxy

http://binary.mirantis.com/core/helm/keycloak_proxy-1.10.12.tgz

Docker images

api

mirantis.azurecr.io/iam/api:0.3.18

auxiliary

mirantis.azurecr.io/iam/auxiliary:0.3.18

kubernetes-entrypoint

mirantis.azurecr.io/iam/external/kubernetes-entrypoint:v0.3.1

mariadb

mirantis.azurecr.io/iam/external/mariadb:10.2.18

keycloak

mirantis.azurecr.io/iam/keycloak:0.3.18

keycloak-gatekeeper

mirantis.azurecr.io/iam/keycloak-gatekeeper:6.0.1

Cluster releases (managed)

This section outlines the release notes for the Mirantis Container Cloud Cluster releases that are supported by specific Container Cloud releases. For details about the Container Cloud releases, see: Mirantis Container Cloud releases.

6.8.1

The Cluster release 6.8.1 is introduced in the Mirantis Container Cloud release 2.2.0. This Cluster release is based on the Cluster release 5.8.0 and the main difference is support of the Mirantis OpenStack on Kubernetes (MOSK) product.

For details about MOSK, see MOSK Release Notes.

For details about the Cluster release 5.8.0, refer to the 5.8.0 section.

5.9.0

This section outlines release notes for the Cluster release 5.9.0 that is introduced in the Mirantis Container Cloud release 2.2.0 and supports Mirantis Kubernetes Engine 3.3.3, Mirantis Container Runtime 19.03.12, and Kubernetes 1.18.

For the list of known and resolved issues, refer to the Container Cloud release 2.2.0 section.

Enhancements

This section outlines new features and enhancements introduced in the Cluster release 5.9.0.


Alerta upgrade

Upgraded Alerta from version 7.4.4 to 8.0.2.


File descriptors monitoring

Enhanced StackLight to monitor the number of file descriptors on nodes and raise FileDescriptorUsage* alerts when a node uses 80%, 90%, or 95% of file descriptors.

Learn more

General node alerts


Alerts improvements
  • Added the SSLProbesFailing alert that raises in case of an SSL certificate probes failure.

  • Improved alerts descriptions and raise conditions.

Components versions

The following table lists the components versions of the Cluster release 5.9.0.

Note

The components that are newly added, updated, deprecated, or removed as compared to the previous release version, are marked with a corresponding superscript, for example, lcm-ansible Updated.

Components versions of the Cluster release 5.9.0

Component

Application/Service

Version

Distributed storage

Ceph Updated

14.2.11 (Nautilus)

Rook Updated

1.4.4

Docker Enterprise

Mirantis Container Runtime

19.03.12 0

Mirantis Kubernetes Engine

3.3.3 1

LCM

ansible-docker Updated

0.3.5-147-g18f3b44

descheduler

0.8.0

Helm

2.16.9-39

helm-controller Updated

0.2.0-178-g8cc488f8

lcm-ansible Updated

0.2.0-132-g49f7591

lcm-agent Updated

0.2.0-178-g8cc488f8

metallb-controller

0.9.3-1

metrics-server

0.3.6-1

StackLight

Alerta Updated

8.0.2-20201014133832

Alertmanager

0.21.0

Elasticsearch

7.6.1

Elasticsearch curator

5.7.6

Elasticsearch exporter

1.0.2

Fluentd

1.10.2-20200609085335

Grafana

7.1.5

Grafana Image Renderer

2.0.0

IAM Proxy

6.0.1

Kibana

7.6.1

MCC Metric Collector

0.1-20201005141816

Metricbeat

7.6.1

Netchecker

1.4.1

Patroni

12-1.6p3

Prometheus Updated

2.19.3

Prometheus Blackbox Exporter

0.14.0

Prometheus ES Exporter

0.5.1-20201002144823

Prometheus libvirt Exporter

0.1-20200610164751

Prometheus Memcached Exporter

0.5.0

Prometheus MySQL Exporter

0.11.0

Prometheus Node Exporter

1.0.1

Prometheus NGINX Exporter

0.6.0

Prometheus Patroni Exporter

0.1-20200428121305

Prometheus Postgres Exporter

0.8.0-20201006113956

Prometheus RabbitMQ Exporter

0.29.0

Prometheus Relay

0.3-20200519054052

Pushgateway

1.2.0

telegraf-ds

1.9.1-20200901112858

telegraf-s

1.9.1-20200901112858

Telemeter

4.4.0-20200424

0

For the Mirantis Container Runtime release highlights, see Docker Enterprise documentation: Mirantis Container Runtime release notes.

1

For the Mirantis Kubernetes Engine 3.3.3 release highlights and components versions, see Docker Enterprise documentation: Mirantis Kubernetes Engine release notes.

Artifacts

This section lists the components artifacts of the Cluster release 5.9.0.


Note

The components that are newly added, updated, deprecated, or removed as compared to the previous release version, are marked with a corresponding superscript, for example, lcm-ansible Updated.

Ceph artifacts

Artifact

Component

Path

Helm chart

ceph-controller Updated

mirantis.azurecr.io/ceph/helm/ceph-controller-1.0.0-mcp-33.tgz

Docker images

ceph Updated

mirantis.azurecr.io/ceph/ceph:v14.2.11

ceph-controller Updated

mirantis.azurecr.io/ceph/mcp/ceph-controller:v1.0.0-20201022081323

cephcsi Updated

mirantis.azurecr.io/ceph/cephcsi/cephcsi:v3.1.0

csi-node-driver-registrar

mirantis.azurecr.io/ceph/k8scsi/csi-node-driver-registrar:v1.2.0

csi-provisioner Updated

mirantis.azurecr.io/ceph/k8scsi/csi-provisioner:v1.6.0

csi-snapshotter Updated

mirantis.azurecr.io/ceph/k8scsi/csi-snapshotter:v2.1.1

csi-attacher

mirantis.azurecr.io/ceph/k8scsi/csi-attacher:v2.1.0

rook Updated

mirantis.azurecr.io/ceph/rook/ceph:v1.4.4


LCM artifacts

Artifact

Component

Path

Binaries

ansible-docker Updated

https://binary.mirantis.com/lcm/bin/ansible-docker/v0.3.5-147-g18f3b44/ansible-docker.tar.gz

lcm-ansible Updated

https://binary.mirantis.com/lcm/bin/lcm-ansible/v0.2.0-132-g49f7591-1/lcm-ansible.tar.gz

lcm-agent Updated

https://binary.mirantis.com/lcm/bin/lcm-agent/v0.2.0-178-g8cc488f8/lcm-agent

Docker images

descheduler

mirantis.azurecr.io/lcm/descheduler/v0.8.0

helm

mirantis.azurecr.io/lcm/helm/tiller:v2.16.9-39

helm-controller Updated

mirantis.azurecr.io/lcm/lcm-controller:v0.2.0-178-g8cc488f8

metallb-controller

mirantis.azurecr.io/lcm/metallb/controller:v0.9.3-1

metallb-speaker

mirantis.azurecr.io/lcm/metallb/speaker:v0.9.3-1

metrics-server

mirantis.azurecr.io/lcm/metrics-server-amd64/v0.3.6-1


StackLight artifacts

Artifact

Component

Path

Helm charts

alerta Updated

https://binary.mirantis.com/stacklight/helm/alerta-0.1.0-mcp-13.tgz

elasticsearch

https://binary.mirantis.com/stacklight/helm/elasticsearch-7.1.1-mcp-20.tgz

elasticsearch-curator

https://binary.mirantis.com/stacklight/helm/elasticsearch-curator-1.5.0-mcp-2.tgz

elasticsearch-exporter

https://binary.mirantis.com/stacklight/helm/elasticsearch-exporter-1.2.0-mcp-2.tgz

fluentd

https://binary.mirantis.com/stacklight/helm/fluentd-2.0.3-mcp-15.tgz

fluentd-elasticsearch Updated

https://binary.mirantis.com/stacklight/helm/fluentd-elasticsearch-3.0.0-mcp-28.tgz

grafana Updated

https://binary.mirantis.com/stacklight/helm/grafana-3.3.10-mcp-66.tgz

kibana

https://binary.mirantis.com/stacklight/helm/kibana-3.2.1-mcp-20.tgz

mcc-metric-collector

https://binary.mirantis.com/stacklight/helm/mcc-metric-collector-0.1.0-mcp-22.tgz

metricbeat

https://binary.mirantis.com/stacklight/helm/metricbeat-1.7.1-mcp-8.tgz

netchecker

https://binary.mirantis.com/core/helm/netchecker-1.4.1.tgz

patroni

https://binary.mirantis.com/stacklight/helm/patroni-0.15.1-mcp-17.tgz

prometheus Updated

https://binary.mirantis.com/stacklight/helm/prometheus-8.11.4-mcp-83.tgz

prometheus-blackbox-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-blackbox-exporter-0.3.0-mcp-3.tgz

prometheus-es-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-es-exporter-1.0.0-mcp-3.tgz

prometheus-libvirt-exporter

https://binary.mirantis.com/stacklight/heprometheus-libvirt-exporter-0.1.0-mcp-2.tgz

prometheus-memcached-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-memcached-exporter-0.1.0-mcp-1.tgz

prometheus-mysql-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-mysql-exporter-0.3.2-mcp-1.tgz

prometheus-nginx-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-nginx-exporter-0.1.0-mcp-4.tgz

prometheus-rabbitmq-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-rabbitmq-exporter-0.4.1-mcp-1.tgz

stacklight Updated

https://binary.mirantis.com/stacklight/helm/stacklight-0.1.2-mcp-325.tgz

telegraf-ds

https://binary.mirantis.com/stacklight/helm/telegraf-ds-1.1.5-mcp-16.tgz

telegraf-s

https://binary.mirantis.com/stacklight/helm/telegraf-s-1.1.5-mcp-16.tgz

telemeter-server

https://binary.mirantis.com/stacklight/helm/telemeter-server-0.1.0-mcp-11.tgz

telemeter-client

https://binary.mirantis.com/stacklight/helm/telemeter-client-0.1.0-mcp-11.tgz

Docker images

alerta Updated

mirantis.azurecr.io/stacklight/alerta-web:8.0.2-20201014133832

alertmanager

mirantis.azurecr.io/stacklight/alertmanager:v0.21.0

alpine-python3-requests Updated

mirantis.azurecr.io/stacklight/alpine-python3-requests:latest-20200618

busybox

mirantis.azurecr.io/stacklight/busybox:1.30

configmap-reload

mirantis.azurecr.io/stacklight/configmap-reload:v0.3.0

curl

mirantis.azurecr.io/stacklight/curl:7.69.0

elasticsearch

mirantis.azurecr.io/stacklight/elasticsearch:7.6.1

elasticsearch-curator

mirantis.azurecr.io/stacklight/curator:5.7.6

elasticsearch-exporter

mirantis.azurecr.io/stacklight/elasticsearch_exporter:1.0.2

fluentd

mirantis.azurecr.io/stacklight/fluentd:1.10.2-20200609085335

gce-proxy

mirantis.azurecr.io/stacklight/gce-proxy:1.11

grafana

mirantis.azurecr.io/stacklight/grafana:7.1.5

grafana-image-renderer

mirantis.azurecr.io/stacklight/grafana-image-renderer:2.0.0

kubectl Updated

mirantis.azurecr.io/stacklight/kubectl:1.19.2

k8s-netchecker-agent

mirantis.azurecr.io/lcm/kubernetes/k8s-netchecker-agent/2019.1/

k8s-netchecker-server

mirantis.azurecr.io/lcm/kubernetes/k8s-netchecker-server/2019.1/

k8s-sidecar

mirantis.azurecr.io/stacklight/k8s-sidecar:0.1.178

kibana

mirantis.azurecr.io/stacklight/kibana:7.6.1

kube-state-metrics

mirantis.azurecr.io/stacklight/kube-state-metrics:v1.9.2

mcc-metric-collector

mirantis.azurecr.io/stacklight/mcc-metric-collector:v0.1-20201005141816

metricbeat

mirantis.azurecr.io/stacklight/metricbeat:7.6.1

node-exporter

mirantis.azurecr.io/stacklight/node-exporter:v1.0.1

origin-telemeter

mirantis.azurecr.io/stacklight/origin-telemeter:4.4.0-20200424

prometheus Updated

mirantis.azurecr.io/stacklight/prometheus:v2.19.3

prometheus-blackbox-exporter

mirantis.azurecr.io/stacklight/blackbox-exporter:v0.14.0

prometheus-es-exporter

mirantis.azurecr.io/stacklight/prometheus-es-exporter:v0.5.1-20201002144823

prometheus-libvirt-exporter

mirantis.azurecr.io/stacklight/libvirt-exporter:v0.1-20200610164751

prometheus-memcached-exporter

mirantis.azurecr.io/stacklight/memcached-exporter:v0.5.0

prometheus-mysql-exporter

mirantis.azurecr.io/stacklight/mysqld-exporter:v0.11.0

prometheus-nginx-exporter

mirantis.azurecr.io/stacklight/nginx-prometheus-exporter:0.6.0

prometheus-patroni-exporter

mirantis.azurecr.io/stacklight/prometheus-patroni-exporter:v0.1-20200428121305

prometheus-postgres-exporter

mirantis.azurecr.io/stacklight/prometheus-postgres-exporter:v0.8.0-20201006113956

prometheus-rabbitmq-exporter

mirantis.azurecr.io/stacklight/rabbitmq-exporter:v0.29.0

prometheus-relay

mirantis.azurecr.io/stacklight/prometheus-relay:v0.3-20200519054052

pushgateway

mirantis.azurecr.io/stacklight/pushgateway:v1.2.0

spilo

mirantis.azurecr.io/stacklight/spilo:12-1.6p3

telegraf

mirantis.azurecr.io/stacklight/telegraf:v1.9.1-20200901112858

telemeter-token-auth

mirantis.azurecr.io/stacklight/telemeter-token-auth:v0.1-20200406175600

Obsolete Cluster releases

This section describes the release notes for the obsolete Cluster releases.

5.x series

This section outlines release notes for the obsolete Cluster releases of the 5.x series.

5.8.0

This section outlines release notes for the Cluster release 5.8.0 that is introduced in the Mirantis Container Cloud release 2.1.0 and supports Mirantis Kubernetes Engine 3.3.3, Mirantis Container Runtime 19.03.12, and Kubernetes 1.18.

For the list of known issues, refer to the Container Cloud release 2.1.0 Known issues.

Enhancements

This section outlines new features and enhancements introduced in the Cluster release 5.8.0.


Grafana improvements
  • Upgraded Grafana from version 6.6.2 to 7.1.5.

  • Introduced Grafana Image Renderer, a separate Grafana container in a pod to offload rendering of images from charts. Grafana Image Renderer is enabled by default.

  • Configured a home dashboard to replace the Installation/configuration panel that opens when you access Grafana. By default, Kubernetes Cluster is set as a home dashboard. However, you can set any of the available Grafana dashboards.


Clusters telemetry improvement in StackLight
  • Split the regional and management cluster function in StackLight telemetry. Now, the metrics from managed clusters are aggregated on regional clusters, then both regional and managed clusters metrics are sent from regional clusters to the management cluster.

  • Added the capability to filter panels by regions in the Clusters Overview and Telemeter Server Grafana dashboards.


Alerts improvements
  • Improved alerts descriptions and raise conditions.

  • Changed severity in some alerts to improve operability.

  • Improved raise conditions of some alerts by adding the for clause and unifying the existing for clauses.

Components versions

The following table lists the components versions of the Cluster release 5.8.0.

Note

The components that are newly added, updated, deprecated, or removed as compared to the previous release version, are marked with a corresponding superscript, for example, lcm-ansible Updated.

Components versions of the Cluster release 5.8.0

Component

Application/Service

Version

Distributed storage

Ceph

14.2.9 (Nautilus)

Rook

1.3.8

Docker Enterprise

Mirantis Container Runtime

19.03.12 0

Mirantis Kubernetes Engine

3.3.3 1

LCM

ansible-docker Updated

0.3.5-141-g1007cc9

descheduler

0.8.0

Helm Updated

2.16.9-39

helm-controller Updated

0.2.0-169-g5668304d

lcm-ansible Updated

0.2.0-119-g8f05f58-1

lcm-agent

0.2.0-149-g412c5a05

metallb-controller

0.9.3-1

metrics-server

0.3.6-1

StackLight

Alerta

7.4.4-20200615123606

Alertmanager

0.21.0

Elasticsearch

7.6.1

Elasticsearch curator

5.7.6

Elasticsearch exporter

1.0.2

Fluentd

1.10.2-20200609085335

Grafana Updated

7.1.5

Grafana Image Renderer New

2.0.0

IAM Proxy

6.0.1

Kibana

7.6.1

MCC Metric Collector Updated

0.1-20201005141816

Metricbeat

7.6.1

Netchecker

1.4.1

Patroni

12-1.6p3

Prometheus

2.19.2

Prometheus Blackbox Exporter

0.14.0

Prometheus ES Exporter Updated

0.5.1-20201002144823

Prometheus libvirt Exporter

0.1-20200610164751

Prometheus Memcached Exporter

0.5.0

Prometheus MySQL Exporter

0.11.0

Prometheus Node Exporter

1.0.1

Prometheus NGINX Exporter

0.6.0

Prometheus Patroni Exporter

0.1-20200428121305

Prometheus Postgres Exporter Updated

0.8.0-20201006113956

Prometheus RabbitMQ Exporter

0.29.0

Prometheus Relay

0.3-20200519054052

Pushgateway

1.2.0

telegraf-ds Updated

1.9.1-20200901112858

telegraf-s Updated

1.9.1-20200901112858

Telemeter

4.4.0-20200424

0

For the Mirantis Container Runtime release highlights, see Docker Enterprise documentation: Mirantis Container Runtime release notes.

1

For the Mirantis Kubernetes Engine 3.3.3 release highlights and components versions, see Docker Enterprise documentation: Mirantis Kubernetes Engine release notes.

Artifacts

This section lists the components artifacts of the Cluster release 5.8.0.


Note

The components that are newly added, updated, deprecated, or removed as compared to the previous release version, are marked with a corresponding superscript, for example, lcm-ansible Updated.

Ceph artifacts

Artifact

Component

Path

Helm chart

ceph-controller Updated

mirantis.azurecr.io/ceph/helm/ceph-controller-1.0.0-mcp-18.tgz

Docker images

ceph

mirantis.azurecr.io/ceph/ceph:v14.2.9

ceph-controller Updated

mirantis.azurecr.io/ceph/mcp/ceph-controller:v1.0.0-20200903151423

cephcsi

mirantis.azurecr.io/ceph/cephcsi/cephcsi:v2.1.2

csi-node-driver-registrar

mirantis.azurecr.io/ceph/k8scsi/csi-node-driver-registrar:v1.2.0

csi-provisioner

mirantis.azurecr.io/ceph/k8scsi/csi-provisioner:v1.4.0

csi-snapshotter

mirantis.azurecr.io/ceph/k8scsi/csi-snapshotter:v1.2.2

csi-attacher

mirantis.azurecr.io/ceph/k8scsi/csi-attacher:v2.1.0

rook

mirantis.azurecr.io/ceph/rook/ceph:v1.3.8


LCM artifacts

Artifact

Component

Path

Binaries

ansible-docker Updated

https://binary.mirantis.com/lcm/bin/ansible-docker/v0.3.5-141-g1007cc9/ansible-docker.tar.gz

lcm-ansible Updated

https://binary.mirantis.com/lcm/bin/lcm-ansible/v0.2.0-119-g8f05f58-1/lcm-ansible.tar.gz

lcm-agent Updated

https://binary.mirantis.com/lcm/bin/lcm-agent/v0.2.0-169-g5668304d/lcm-agent

Docker images

descheduler

mirantis.azurecr.io/lcm/descheduler/v0.8.0

helm Updated

mirantis.azurecr.io/lcm/helm/tiller:v2.16.9-39

helm-controller Updated

mirantis.azurecr.io/lcm/lcm-controller:v0.2.0-169-g5668304d

metallb-controller

mirantis.azurecr.io/lcm/metallb/controller:v0.9.3-1

metallb-speaker

mirantis.azurecr.io/lcm/metallb/speaker:v0.9.3-1

metrics-server

mirantis.azurecr.io/lcm/metrics-server-amd64/v0.3.6-1


StackLight artifacts

Artifact

Component

Path

Helm charts

alerta

https://binary.mirantis.com/stacklight/helm/alerta-0.1.0-mcp-12.tgz

elasticsearch

https://binary.mirantis.com/stacklight/helm/elasticsearch-7.1.1-mcp-20.tgz

elasticsearch-curator

https://binary.mirantis.com/stacklight/helm/elasticsearch-curator-1.5.0-mcp-2.tgz

elasticsearch-exporter

https://binary.mirantis.com/stacklight/helm/elasticsearch-exporter-1.2.0-mcp-2.tgz

fluentd Updated

https://binary.mirantis.com/stacklight/helm/fluentd-2.0.3-mcp-15.tgz

fluentd-elasticsearch

https://binary.mirantis.com/stacklight/helm/fluentd-elasticsearch-3.0.0-mcp-25.tgz

grafana Updated

https://binary.mirantis.com/stacklight/helm/grafana-3.3.10-mcp-64.tgz

kibana Updated

https://binary.mirantis.com/stacklight/helm/kibana-3.2.1-mcp-20.tgz

mcc-metric-collector

https://binary.mirantis.com/stacklight/helm/mcc-metric-collector-0.1.0-mcp-22.tgz

metricbeat

https://binary.mirantis.com/stacklight/helm/metricbeat-1.7.1-mcp-8.tgz

netchecker

https://binary.mirantis.com/core/helm/netchecker-1.4.1.tgz

patroni

https://binary.mirantis.com/stacklight/helm/patroni-0.15.1-mcp-17.tgz

prometheus Updated

https://binary.mirantis.com/stacklight/helm/prometheus-8.11.4-mcp-80.tgz

prometheus-blackbox-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-blackbox-exporter-0.3.0-mcp-3.tgz

prometheus-es-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-es-exporter-1.0.0-mcp-3.tgz

prometheus-libvirt-exporter

https://binary.mirantis.com/stacklight/heprometheus-libvirt-exporter-0.1.0-mcp-2.tgz

prometheus-memcached-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-memcached-exporter-0.1.0-mcp-1.tgz

prometheus-mysql-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-mysql-exporter-0.3.2-mcp-1.tgz

prometheus-nginx-exporter Updated

https://binary.mirantis.com/stacklight/helm/prometheus-nginx-exporter-0.1.0-mcp-4.tgz

prometheus-rabbitmq-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-rabbitmq-exporter-0.4.1-mcp-1.tgz

stacklight Updated

https://binary.mirantis.com/stacklight/helm/stacklight-0.1.2-mcp-312.tgz

telegraf-ds Updated

https://binary.mirantis.com/stacklight/helm/telegraf-ds-1.1.5-mcp-16.tgz

telegraf-s Updated

https://binary.mirantis.com/stacklight/helm/telegraf-s-1.1.5-mcp-16.tgz

telemeter-server

https://binary.mirantis.com/stacklight/helm/telemeter-server-0.1.0-mcp-11.tgz

telemeter-client

https://binary.mirantis.com/stacklight/helm/telemeter-client-0.1.0-mcp-11.tgz

Docker images

alerta

mirantis.azurecr.io/stacklight/alerta-web:7.4.4-20200615123606

alertmanager

mirantis.azurecr.io/stacklight/alertmanager:v0.21.0

alpine-python3-requests

mirantis.azurecr.io/stacklight/alpine-python3-requests:latest-20200320

busybox

mirantis.azurecr.io/stacklight/busybox:1.30

configmap-reload

mirantis.azurecr.io/stacklight/configmap-reload:v0.3.0

curl

mirantis.azurecr.io/stacklight/curl:7.69.0

elasticsearch

mirantis.azurecr.io/stacklight/elasticsearch:7.6.1

elasticsearch-curator

mirantis.azurecr.io/stacklight/curator:5.7.6

elasticsearch-exporter

mirantis.azurecr.io/stacklight/elasticsearch_exporter:1.0.2

fluentd

mirantis.azurecr.io/stacklight/fluentd:1.10.2-20200609085335

gce-proxy

mirantis.azurecr.io/stacklight/gce-proxy:1.11

grafana Updated

mirantis.azurecr.io/stacklight/grafana:7.1.5

grafana-image-renderer New

mirantis.azurecr.io/stacklight/grafana-image-renderer:2.0.0

kubectl New

mirantis.azurecr.io/stacklight/kubectl:1.15.3

k8s-netchecker-agent

mirantis.azurecr.io/lcm/kubernetes/k8s-netchecker-agent/2019.1/

k8s-netchecker-server

mirantis.azurecr.io/lcm/kubernetes/k8s-netchecker-server/2019.1/

k8s-sidecar

mirantis.azurecr.io/stacklight/k8s-sidecar:0.1.178

kibana

mirantis.azurecr.io/stacklight/kibana:7.6.1

kube-state-metrics

mirantis.azurecr.io/stacklight/kube-state-metrics:v1.9.2

mcc-metric-collector Updated

mirantis.azurecr.io/stacklight/mcc-metric-collector:v0.1-20201005141816

metricbeat

mirantis.azurecr.io/stacklight/metricbeat:7.6.1

node-exporter

mirantis.azurecr.io/stacklight/node-exporter:v1.0.1

origin-telemeter

mirantis.azurecr.io/stacklight/origin-telemeter:4.4.0-20200424

prometheus

mirantis.azurecr.io/stacklight/prometheus:v2.19.2

prometheus-blackbox-exporter

mirantis.azurecr.io/stacklight/blackbox-exporter:v0.14.0

prometheus-es-exporter Updated

mirantis.azurecr.io/stacklight/prometheus-es-exporter:v0.5.1-20201002144823

prometheus-libvirt-exporter

mirantis.azurecr.io/stacklight/libvirt-exporter:v0.1-20200610164751

prometheus-memcached-exporter

mirantis.azurecr.io/stacklight/memcached-exporter:v0.5.0

prometheus-mysql-exporter

mirantis.azurecr.io/stacklight/mysqld-exporter:v0.11.0

prometheus-nginx-exporter

mirantis.azurecr.io/stacklight/nginx-prometheus-exporter:0.6.0

prometheus-patroni-exporter

mirantis.azurecr.io/stacklight/prometheus-patroni-exporter:v0.1-20200428121305

prometheus-postgres-exporter Updated

mirantis.azurecr.io/stacklight/prometheus-postgres-exporter:v0.8.0-20201006113956

prometheus-rabbitmq-exporter

mirantis.azurecr.io/stacklight/rabbitmq-exporter:v0.29.0

prometheus-relay

mirantis.azurecr.io/stacklight/prometheus-relay:v0.3-20200519054052

pushgateway

mirantis.azurecr.io/stacklight/pushgateway:v1.2.0

spilo

mirantis.azurecr.io/stacklight/spilo:12-1.6p3

telegraf Updated

mirantis.azurecr.io/stacklight/telegraf:v1.9.1-20200901112858

telemeter-token-auth

mirantis.azurecr.io/stacklight/telemeter-token-auth:v0.1-20200406175600

5.7.0

This section outlines release notes for the Cluster release 5.7.0 that is introduced in the Mirantis Container Cloud release 2.0.0 and supports Mirantis Kubernetes Engine 3.3.3, Mirantis Container Runtime 19.03.12, and Kubernetes 1.18.

For the list of known issues, refer to the Container Cloud release 2.0.0 Known issues.

Components versions

The following table lists the components versions of the Cluster release 5.7.0.

Components versions of the Cluster release 5.7.0

Component

Application/Service

Version

Distributed storage

Ceph

14.2.9 (Nautilus)

Rook

1.3.8

Docker Enterprise

Mirantis Container Runtime

19.03.12 0

Mirantis Kubernetes Engine

3.3.3 1

LCM

ansible-docker

0.3.5-136-g38653c7

descheduler

0.8.0

Helm

2.16.7-38

helm-controller

0.2.0-149-g412c5a05

lcm-ansible

0.2.0-110-g63cf88b

lcm-agent

0.2.0-149-g412c5a05

metallb-controller

0.9.3-1

metrics-server

0.3.6-1

StackLight

Alerta

7.4.4-20200615123606

Alertmanager

0.21.0

Elasticsearch

7.6.1

Elasticsearch curator

5.7.6

Elasticsearch exporter

1.0.2

Fluentd

1.10.2-20200609085335

Grafana

6.6.2

IAM Proxy

6.0.1

Kibana

7.6.1

MCC Metric Collector

0.1-20200806113043

Metricbeat

7.6.1

Netchecker

1.4.1

Patroni

12-1.6p3

Prometheus

2.19.2

Prometheus Blackbox Exporter

0.14.0

Prometheus ES Exporter

0.5.1-20200313132957

Prometheus libvirt Exporter

0.1-20200610164751

Prometheus Memcached Exporter

0.5.0

Prometheus MySQL Exporter

0.11.0

Prometheus Node Exporter

1.0.1

Prometheus NGINX Exporter

0.6.0

Prometheus Patroni Exporter

0.1-20200428121305

Prometheus Postgres Exporter

0.8.0-20200715102834

Prometheus RabbitMQ Exporter

0.29.0

Prometheus Relay

0.3-20200519054052

Pushgateway

1.2.0

telegraf-ds

1.9.1-20200806073506

telegraf-s

1.9.1-20200806073506

Telemeter

4.4.0-20200424

0

For the Mirantis Container Runtime release highlights, see Docker Enterprise documentation: Mirantis Container Runtime release notes.

1

For the Mirantis Kubernetes Engine 3.3.3 release highlights and components versions, see Docker Enterprise documentation: Mirantis Kubernetes Engine release notes.

Artifacts

This section lists the components artifacts of the Cluster release 5.7.0.


Ceph artifacts

Artifact

Component

Path

Helm chart

ceph-controller

mirantis.azurecr.io/ceph/helm/ceph-controller-1.0.0-mcp-16.tgz

Docker images

ceph

mirantis.azurecr.io/ceph/ceph:v14.2.9

ceph-controller

mirantis.azurecr.io/ceph/mcp/ceph-controller:v1.0.0-20200805103414

cephcsi

mirantis.azurecr.io/ceph/cephcsi/cephcsi:v2.1.2

csi-node-driver-registrar

mirantis.azurecr.io/ceph/k8scsi/csi-node-driver-registrar:v1.2.0

csi-provisioner

mirantis.azurecr.io/ceph/k8scsi/csi-provisioner:v1.4.0

csi-snapshotter

mirantis.azurecr.io/ceph/k8scsi/csi-snapshotter:v1.2.2

csi-attacher

mirantis.azurecr.io/ceph/k8scsi/csi-attacher:v2.1.0

rook

mirantis.azurecr.io/ceph/rook/ceph:v1.3.8


LCM artifacts

Artifact

Component

Path

Binaries

ansible-docker

https://binary.mirantis.com/lcm/bin/ansible-docker/v0.3.5-136-g38653c7/ansible-docker.tar.gz

lcm-ansible

https://binary.mirantis.com/lcm/bin/lcm-ansible/v0.2.0-110-g63cf88b/lcm-ansible.tar.gz

lcm-agent

https://binary.mirantis.com/lcm/bin/lcm-agent/v0.2.0-149-g412c5a05/lcm-agent

Docker images

descheduler

mirantis.azurecr.io/lcm/descheduler/v0.8.0

helm

mirantis.azurecr.io/lcm/helm/tiller:v2.16.9-39

helm-controller

mirantis.azurecr.io/lcm/lcm-controller:v0.2.0-149-g412c5a05

metallb-controller

mirantis.azurecr.io/lcm/metallb/controller:v0.9.3-1

metallb-speaker

mirantis.azurecr.io/lcm/metallb/speaker:v0.9.3-1

metrics-server

mirantis.azurecr.io/lcm/metrics-server-amd64/v0.3.6-1


StackLight artifacts

Artifact

Component

Path

Helm charts

alerta

https://binary.mirantis.com/stacklight/helm/alerta-0.1.0-mcp-12.tgz

elasticsearch

https://binary.mirantis.com/stacklight/helm/elasticsearch-7.1.1-mcp-20.tgz

elasticsearch-curator

https://binary.mirantis.com/stacklight/helm/elasticsearch-curator-1.5.0-mcp-2.tgz

elasticsearch-exporter

https://binary.mirantis.com/stacklight/helm/elasticsearch-exporter-1.2.0-mcp-2.tgz

fluentd

https://binary.mirantis.com/stacklight/helm/fluentd-2.0.3-mcp-15.tgz

fluentd-elasticsearch

https://binary.mirantis.com/stacklight/helm/fluentd-elasticsearch-3.0.0-mcp-24.tgz

grafana

https://binary.mirantis.com/stacklight/helm/grafana-3.3.10-mcp-59.tgz

kibana

https://binary.mirantis.com/stacklight/helm/kibana-3.2.1-mcp-19.tgz

mcc-metric-collector

https://binary.mirantis.com/stacklight/helm/mcc-metric-collector-0.1.0-mcp-22.tgz

metricbeat

https://binary.mirantis.com/stacklight/helm/metricbeat-1.7.1-mcp-8.tgz

netchecker

https://binary.mirantis.com/core/helm/netchecker-1.4.1.tgz

patroni

https://binary.mirantis.com/stacklight/helm/patroni-0.15.1-mcp-17.tgz

prometheus

https://binary.mirantis.com/stacklight/helm/prometheus-8.11.4-mcp-73.tgz

prometheus-blackbox-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-blackbox-exporter-0.3.0-mcp-3.tgz

prometheus-es-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-es-exporter-1.0.0-mcp-3.tgz

prometheus-libvirt-exporter

https://binary.mirantis.com/stacklight/heprometheus-libvirt-exporter-0.1.0-mcp-2.tgz

prometheus-memcached-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-memcached-exporter-0.1.0-mcp-1.tgz

prometheus-mysql-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-mysql-exporter-0.3.2-mcp-1.tgz

prometheus-nginx-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-nginx-exporter-0.1.0-mcp-2.tgz

prometheus-rabbitmq-exporter

https://binary.mirantis.com/stacklight/helm/prometheus-rabbitmq-exporter-0.4.1-mcp-1.tgz

stacklight

https://binary.mirantis.com/stacklight/helm/stacklight-0.1.2-mcp-285.tgz

telegraf-ds

https://binary.mirantis.com/stacklight/helm/telegraf-ds-1.1.5-mcp-14.tgz

telegraf-s

https://binary.mirantis.com/stacklight/helm/telegraf-s-1.1.5-mcp-14.tgz

telemeter-server

https://binary.mirantis.com/stacklight/helm/telemeter-server-0.1.0-mcp-11.tgz

telemeter-client

https://binary.mirantis.com/stacklight/helm/telemeter-client-0.1.0-mcp-11.tgz

Docker images

alerta

mirantis.azurecr.io/stacklight/alerta-web:7.4.4-20200615123606

alertmanager

mirantis.azurecr.io/stacklight/alertmanager:v0.21.0

alpine-python3-requests

mirantis.azurecr.io/stacklight/alpine-python3-requests:latest-20200320

busybox

mirantis.azurecr.io/stacklight/busybox:1.30

configmap-reload

mirantis.azurecr.io/stacklight/configmap-reload:v0.3.0

curl

mirantis.azurecr.io/stacklight/curl:7.69.0

elasticsearch

mirantis.azurecr.io/stacklight/elasticsearch:7.6.1

elasticsearch-curator

mirantis.azurecr.io/stacklight/curator:5.7.6

elasticsearch-exporter

mirantis.azurecr.io/stacklight/elasticsearch_exporter:1.0.2

fluentd

mirantis.azurecr.io/stacklight/fluentd:1.10.2-20200609085335

gce-proxy

mirantis.azurecr.io/stacklight/gce-proxy:1.11

grafana

mirantis.azurecr.io/stacklight/grafana:6.6.2

k8s-netchecker-agent

mirantis.azurecr.io/lcm/kubernetes/k8s-netchecker-agent/2019.1/

k8s-netchecker-server

mirantis.azurecr.io/lcm/kubernetes/k8s-netchecker-server/2019.1/

k8s-sidecar

mirantis.azurecr.io/stacklight/k8s-sidecar:0.1.178

kibana

mirantis.azurecr.io/stacklight/kibana:7.6.1

kube-state-metrics

mirantis.azurecr.io/stacklight/kube-state-metrics:v1.9.2

mcc-metric-collector

mirantis.azurecr.io/stacklight/mcc-metric-collector:v0.1-20200806113043

metricbeat

mirantis.azurecr.io/stacklight/metricbeat:7.6.1

node-exporter

mirantis.azurecr.io/stacklight/node-exporter:v1.0.1

origin-telemeter

mirantis.azurecr.io/stacklight/origin-telemeter:4.4.0-20200424

prometheus

mirantis.azurecr.io/stacklight/prometheus:v2.19.2

prometheus-blackbox-exporter

mirantis.azurecr.io/stacklight/blackbox-exporter:v0.14.0

prometheus-es-exporter

mirantis.azurecr.io/stacklight/prometheus-es-exporter:v0.5.1-20200313132957

prometheus-libvirt-exporter

mirantis.azurecr.io/stacklight/libvirt-exporter:v0.1-20200610164751

prometheus-memcached-exporter

mirantis.azurecr.io/stacklight/memcached-exporter:v0.5.0

prometheus-mysql-exporter

mirantis.azurecr.io/stacklight/mysqld-exporter:v0.11.0

prometheus-nginx-exporter

mirantis.azurecr.io/stacklight/nginx-prometheus-exporter:0.6.0

prometheus-patroni-exporter

mirantis.azurecr.io/stacklight/prometheus-patroni-exporter:v0.1-20200428121305

prometheus-postgres-exporter

mirantis.azurecr.io/stacklight/prometheus-postgres-exporter:v0.8.0-20200715102834

prometheus-rabbitmq-exporter

mirantis.azurecr.io/stacklight/rabbitmq-exporter:v0.29.0

prometheus-relay

mirantis.azurecr.io/stacklight/prometheus-relay:v0.3-20200519054052

pushgateway

mirantis.azurecr.io/stacklight/pushgateway:v1.2.0

spilo

mirantis.azurecr.io/stacklight/spilo:12-1.6p3

telegraf

mirantis.azurecr.io/stacklight/telegraf:v1.9.1-20200806073506

telemeter-token-auth

mirantis.azurecr.io/stacklight/telemeter-token-auth:v0.1-20200406175600