VMWare vSphere-based cluster

VMWare vSphere-based cluster

Caution

This feature is available as Technology Preview. Use such configuration for testing and evaluation purposes only. For details about the Mirantis Technology Preview support scope, see the Preface section of this guide.

Caution

This feature is available starting from the Container Cloud release 2.2.0.

Note

In scope of Technology Preview support for the VMWare vSphere cloud provider, StackLight deployed on a management cluster has limitations related to alerts and Grafana dashboards. For details, see StackLight support for VMWare vSphere.

In a Mirantis Container Cloud deployment on VMWare vSphere, the bootstrap and management clusters must have access to *.mirantis.com to download the release information and artifacts.

Note

Container Cloud is developed and tested on VMWare vSphere 7.0 and 6.7.

Requirements for a vSphere-based Container Cloud cluster

Resource

Bootstrap cluster 0

Management cluster

Managed cluster

Comments

# of nodes

1

3 (HA)

5 (6 with StackLight HA)

  • A bootstrap cluster requires access to the vSphere API.

  • A management cluster requires 3 nodes for the manager nodes HA. Adding more than 3 nodes to a management or regional cluster is not supported.

  • A managed cluster requires 3 nodes for the manager nodes HA and 2 nodes for the Container Cloud workloads. If the multiserver mode is enabled for StackLight, 3 nodes are required for the Container Cloud workloads.

# of vCPUs per node

2

8

8

Refer to the RAM recommendations described below to plan resources for different types of nodes.

RAM in GB per node

4

16

16

To prevent issues with low RAM, Mirantis recommends the following VM templates for a managed cluster with 50-200 nodes:

  • 16 vCPUs and 32 GB of RAM - manager node

  • 16 vCPUs and 128 GB of RAM - nodes where the StackLight server components run

Storage in GB per node

5 (available)

120

120

The listed amount of disk space must be available as a shared datastore of any type, for example, NFS or vSAN, mounted on all hosts of the vCenter cluster.

Operating system

Ubuntu 16.04 or 18.04

RHEL 7.8

RHEL 7.8

For a management and managed cluster, a base RHEL 7.8 VM template must be present in the VMWare VM templates folder available to Container Cloud. For details about the template, see Deployment Guide: Prerequisites.

RHEL license

-

RHEL licenses for Virtual Datacenters

RHEL licenses for Virtual Datacenters

This license type allows running unlimited guests inside one hypervisor. The amount of licenses is equal to the amount of hypervisors in vCenter Server, which will be used to host RHEL-based machines. Container Cloud will schedule machines according to scheduling rules applied to vCenter Server. Therefore, make sure that your RedHat Customer portal account has enough licenses for allowed hypervisors.

Docker version

18.09

-

-

For a management and managed cluster, Mirantis Container Runtime 19.03.12 In 2.2.0 or 19.03.13 Starting 2.3.0

VMWare vSphere version

-

7.0, 6.7

7.0, 6.7

Obligatory vSphere capabilities

-

DRS,
Shared datastore
DRS,
Shared datastore

A shared datastore must be mounted on all hosts of the vCenter cluster. Combined with Distributed Resources Scheduler (DRS), it ensures that the VMs are dynamically scheduled to the cluster hosts.

IP subnet size

-

/24

/24

The vSphere network must have an external DHCP server on the primary cluster network to assign IP addresses to the node VMs.

IP addresses distribution:

  • Management cluster: 1 for Kubernetes, 3 for the manager nodes (one per node), 4 for Container Cloud, 5 for StackLight

  • Managed cluster: 1 for Kubernetes, 3 for the manager nodes, 2 for the worker nodes, 5 for StackLight

0

The bootstrap cluster is necessary only to deploy the management cluster. When the bootstrap is complete, this cluster can be deleted and its resources can be reused for a managed cluster workloads.