Physical networks layout¶

The diagrams below illustrate the recommended physical networks layout for a Mirantis OpenStack for Kubernetes (MOSK) deployment with Ceph.

The following recommendations apply to all types of nodes:

Use the Link Aggregation Control Protocol (LACP) bonding mode with MC-LAG domains configured on leaf switches. This corresponds to the 802.3ad bond mode on hosts.
Configure Spanning Tree Protocol (STP) settings on the network switch ports to ensure that the ports start forwarding packets as soon as the link comes up. It helps avoid iPXE timeout issues and ensures reliable boot over network.
See also
- Cisco: Configuring a PortFast Edge Port on a Specified Interface
- Dell: How to manage Rapid Spanning Tree (RSTP) Thru Command Line on Dell Networking PowerConnect Switches: Enabling Portfast
Use ports from different multi-port NICs when creating bonds. This makes network connections redundant if failure of a single NIC occurs.
Configure the ports that connect servers to the PXE network with PXE VLAN as native or untagged. On these ports, configure LACP fallback to ensure that the servers can reach DHCP server and boot over network.

Container Cloud Management cluster physical networking¶

The following diagram illustrates physical and L2 connections of the Container Cloud management cluster.

The following diagram illustrates physical and L2 network connections of the Kubernetes manager nodes in a MOSK cluster.

Caution

Such configuration does not apply to a compact control plane MOSK installation. See Create a MOSK cluster.

The following diagram illustrates physical and L2 network connections of the control plane nodes in a MOSK cluster.

The following diagram illustrates physical and L2 network connections of the compute nodes in a MOSK cluster.

The following diagram illustrates physical and L2 network connections of the storage nodes in a MOSK cluster.