Known issues¶
MKE 3.6.13 known issues with available workaround solutions include:
[MKE-10956] Upgrade on SLESS12 SP5 since 3.6.11 causes Calico CNI error
[MKE-10152] Upgrading large Windows clusters can initiate a rollback
[MKE-9699] Ingress Controller with external load balancer can enter crashloop
[MKE-8914] Windows Server Core with Containers images incompatible with GCP
[MKE-8814] Mismatched MTU values cause Swarm overlay network issues on GCP
[MKE-8662] Swarm only manager nodes are labeled as mixed mode
[MKE-11281] cAdvisor Pods on Windows nodes cannot enter ‘Running’ state
[MKE-11282] –swarm-only upgrade fails due to ‘unavailable’ manager ports
[MKE-10956] Upgrade on SLESS12 SP5 since 3.6.11 causes Calico CNI error¶
On SLES12 SP5, beginning with MKE 3.6.11, upgrade causes the “Calico CNI Plugin Pod is Unhealthy” error.
Workaround:
Manually start cri-dockerd:
sudo systemctl start cri-dockerd-mke
[MKE-10152] Upgrading large Windows clusters can initiate a rollback¶
Upgrades can rollback on a cluster with a large number of Windows worker nodes.
Workaround:
Invoke the --manual-worker-upgrade option and then manually upgrade the workers.
[MKE-9699] Ingress Controller with external load balancer can enter crashloop¶
Due to the upstream Kubernetes issue 73140, rapid toggling of the Ingress Controller with an external load balancer in use can cause the resource to become stuck in a crashloop.
Workaround:
Log in to the MKE web UI as an administrator.
In the left-side navigation panel, navigate to <user name> > Admin Settings > Ingress.
Click the Kubernetes tab to display the HTTP Ingress Controller for Kubernetes pane.
Toggle the HTTP Ingress Controller for Kubernetes enabled control to the left to disable the Ingress Controller.
Use the CLI to delete the Ingress Controller resources:
kubectl delete service ingress-nginx-controller-admission --namespace ingress-nginx kubectl delete deployment ingress-nginx-controller --namespace ingress-nginx
Verify the successful deletion of the resources:
kubectl get all --namespace ingress-nginx
Example output:
No resources found in ingress-nginx namespace.
Return to the HTTP Ingress Controller for Kubernetes pane in the MKE web UI and change the nodeport numbers for HTTP Port, HTTPS Port and TCP Port.
Toggle the HTTP Ingress Controller for Kubernetes enabled control to the right to re-enable the Ingress Controller.
[MKE-8914] Windows Server Core with Containers images incompatible with GCP¶
The use of Windows ServerCore with Containers images will prevent kubelet
from starting up, as these images are not compatible with GCP.
As a workaround, use Windows Server or Windows Server Core images.
[MKE-8814] Mismatched MTU values cause Swarm overlay network issues on GCP¶
Communication between GCP VPCs and Docker networks that use Swarm overlay networks will fail if their MTU values are not manually aligned. By default, the MTU value for GCP VPCs is 1460, while the default MTU value for Docker networks is 1500.
Workaround:
Select from the following options:
Create a new VPC and set the MTU value to 1500.
Set the MTU value of the existing VPC to 1500.
For more information, refer to the Google Cloud Platform documentation, Change the MTU setting of a VPC network.
[MKE-8662] Swarm only manager nodes are labeled as mixed mode¶
When MKE is installed in swarm only mode, all nodes manager nodes and nodes with DTR start off in mixed mode. As Kubernetes installation is skipped altogether, however, they should be labeled as swarm mode.
Workaround:
Change the labels following installation.
[MKE-11281] cAdvisor Pods on Windows nodes cannot enter ‘Running’ state¶
When you enable cAdvisor, Pods are deployed to every node in the cluster. These cAdvisor Pods only work on Linux nodes, however, so the Pods that are inadvertently targeted to Windows nodes remain perpetually suspended and never actually run.
we inadvertently target Windows nodes with cAdvisor and the workaround updates the DaemonSet such that only Linux nodes are targeted.
Workaround:
Update the DaemonSet so that only Linux nodes are targeted by patching the
ucp-cadvisor
DaemonSet to include a node selector for Linux:
kubectl patch daemonset ucp-cadvisor -n kube-system --type='json' \
-p='[{"op": "replace", "path": "/spec/template/spec/nodeSelector", "value":
{"kubernetes.io/os": "linux"}}]'