Physical networks layout

The diagrams below illustrate the recommended physical networks layout for a Mirantis OpenStack for Kubernetes (MOSK) deployment with Ceph.

The following recommendations apply to all types of nodes:

  • Use the Link Aggregation Control Protocol (LACP) bonding mode with MC-LAG domains configured on leaf switches. This corresponds to the 802.3ad bond mode on hosts.

  • Configure Spanning Tree Protocol (STP) settings on the network switch ports to ensure that the ports start forwarding packets as soon as the link comes up. It helps avoid iPXE timeout issues and ensures reliable boot over network.

  • Use ports from different multi-port NICs when creating bonds. This makes network connections redundant if failure of a single NIC occurs.

  • Configure the ports that connect servers to the PXE network with PXE VLAN as native or untagged. On these ports, configure LACP fallback to ensure that the servers can reach DHCP server and boot over network.

Container Cloud Management cluster physical networking

The following diagram illustrates physical and L2 connections of the Container Cloud management cluster.

../../_images/os-cluster-mgmt-physical.png

MOSK managed cluster physical networking

Kubernetes manager nodes

The following diagram illustrates physical and L2 network connections of the Kubernetes manager nodes in a MOSK cluster.

Caution

Such configuration does not apply to a compact control plane MOSK installation. See Create a MOSK cluster.

../../_images/os-cluster-k8s-mgr-physical.png

OpenStack controller nodes

The following diagram illustrates physical and L2 network connections of the control plane nodes in a MOSK cluster.

../../_images/os-cluster-control-physical.png

OpenStack compute nodes

The following diagram illustrates physical and L2 network connections of the compute nodes in a MOSK cluster.

../../_images/os-cluster-compute-physical.png

OpenStack storage nodes

The following diagram illustrates physical and L2 network connections of the storage nodes in a MOSK cluster.

../../_images/os-cluster-storage-physical.png