Contents Menu Expand Light mode Dark mode Auto light/dark mode
Documentation Portal
Logo
Mirantis OpenStack for Kubernetes
  • Product Overview
  • Reference Architecture
    • Deployment profiles
    • Components overview
    • Requirements
      • MOSK cluster hardware requirements
      • Management cluster storage
      • System requirements for the seed node
      • Components collocation
      • Infrastructure requirements
      • Automatic upgrade of a host operating system
    • Cloud services
      • Compute service
        • Resource oversubscription
        • Virtual CPU
        • Instance migration
        • Image storage backend
        • Remote console access to virtual machines
        • GPU virtualization
        • Graceful instance shutdown
      • Networking service
        • Backends
        • General configuration
        • BGP dynamic routing
        • DVR incompatibility with ARP announcements and VRRP
      • Block Storage service
        • Backup configuration
        • Volume encryption
        • Volume configuration
      • Identity service
        • Federation
        • Regions
        • Application credentials
        • Domain-specific configuration
      • Image service
      • Object Storage service
      • Dashboard
      • Bare Metal service
      • DNS service
      • Key Manager service
      • Instance High Availability service
        • Enabling the Instance HA service
        • Enabling introspective instance monitor
      • Shared Filesystems service
      • Dynamic Resource Balancer service
    • OpenStack
      • OpenStack cluster
      • OpenStack lifecycle management
        • OpenStack Controller (Rockoon)
        • OpenStackDeployment Admission Controller
        • OpenStack Exporter
      • OpenStack configuration
        • OpenStackDeployment custom resource
        • OpenStackDeploymentStatus custom resource
        • OpenStack Controller configuration
        • Custom OpenStack images
      • OpenStack database
        • Overview of the OpenStack database backup and restoration
        • Workflows of the OpenStack database backup and restoration
        • OpenStack database auto-cleanup
        • Periodic OpenStack database backups
        • Remote storage for OpenStack database backups
        • Synchronization of local MariaDB backups with a remote S3 storage
      • OpenStack message bus
    • Tungsten Fabric
      • Tungsten Fabric cluster
        • Tungsten Fabric cluster components
        • Tungsten Fabric traffic flow
      • Tungsten Fabric lifecycle management
        • Tungsten Fabric Operator
        • TFOperator custom resource
        • Key differences between TFOperator API v1alpha1 and v2
      • Tungsten Fabric configuration
        • Cassandra configuration
        • Custom vRouter settings
        • Control plane traffic interface
        • Traffic encapsulation
        • Autonomous System Number (ASN)
        • Access to external DNS
        • Gateway for vRouter data plane network
        • Tungsten Fabric image precaching
        • Graceful restart and long-lived graceful restart
        • Configuring the protocol for connecting to Cassandra clusters
        • SR-IOV Spoof Check control for Tungsten Fabric
        • Availability zones
      • Tungsten Fabric database
        • Periodic Tungsten Fabric database backups
        • Remote storage for Tungsten Fabric database backups
      • Tungsten Fabric services
        • Tungsten Fabric load balancing (HAProxy)
        • Octavia Amphora load balancing
      • Tungsten Fabric known limitations
      • Tungsten Fabric integration with OpenStack
      • Tungsten Fabric IPv6 support
    • Networking
      • Networking overview
      • Management cluster networking
      • MOSK cluster networking
      • Network types
      • Multi-rack architecture
      • Physical networks layout
      • Underlay networking: routing configuration
      • Performance optimization
    • Storage
      • Ceph overview
      • Ceph limitations
      • Ceph integration with OpenStack
    • Mirantis StackLight
      • Deployment architecture
      • Monitored components
      • OpenSearch and Prometheus storage sizing
      • StackLight integration with OpenStack
      • Workload monitoring
      • StackLight logging indices
    • Blueprints
      • Remote compute nodes
        • Introduction to edge computing
        • Overview of the remote compute nodes approach
        • Design considerations for a remote site
        • Remote compute nodes with Tungsten Fabric
      • Large clusters
      • Cephless cloud
    • Node maintenance API
      • Node maintenance API objects
      • OpenStack Controller maintenance API
      • Tungsten Fabric Controller maintenance API
      • Cluster update flow
      • Parallelizing node update operations
  • Deployment Guide
    • Plan the deployment
    • Provision and deploy a management cluster
      • Deploy a management cluster
        • Introduction
        • Overview of the deployment workflow
        • Set up a bootstrap cluster
        • Deploy a management cluster
        • Configure bare metal settings
          • Configure BIOS on a bare metal host
          • Customize the default bare metal host profile
          • Configure NIC bonding
          • Separate PXE and management networks
          • Configure multiple DHCP address ranges
          • Enable dynamic IP allocation
          • Set a custom external IP address for the DHCP service
        • Configure optional settings
        • Post-deployment steps
      • Create initial users after a management cluster bootstrap
      • Requirements for a MITM proxy
      • Configure external identity provider for IAM
        • Configure LDAP for IAM
        • Configure Google OAuth IdP for IAM
    • Create a managed cluster
      • Create a project for MOSK clusters
      • Add a bare metal host
        • Add a bare metal host using web UI
        • Add a bare metal host using CLI
      • Create a custom bare metal host profile
        • Default configuration of the host system storage
        • Wipe a device or partition
        • Create MOSK host profiles
        • Configure Ceph disks in a host profile
        • Enable huge pages in a host profile
        • Configure RAID support
          • Create an LVM software RAID (raid1)
          • Create LVM volume groups on top of RAID devices
          • Create an mdadm software RAID (raid0, raid1, raid10)
          • Create an mdadm software RAID level 10 (raid10)
      • Create a MOSK cluster
        • Create a managed bare metal cluster
        • Configure MetalLB
          • Configure and verify MetalLB
          • Configure node selectors for MetalLB speakers
          • MetalLB configuration guidelines for subnets
        • Configure BGP announcement for cluster API LB address
        • Obtain and use details about network interfaces
        • Create subnets
          • Service labels and their life cycle
          • Create subnets for a managed cluster using web UI
          • Create subnets for a managed cluster using CLI
        • Create L2 templates
          • Create an L2 template for a new cluster
          • Create L2 templates for a multi-rack MOSK cluster
          • Create an L2 template for a Kubernetes manager node
          • Create an L2 template for a MOSK controller node
          • Create an L2 template for a MOSK compute node
          • Create an L2 template for a MOSK storage node
          • L2 template example with bonds and bridges
          • L2 template example for automatic multiple subnet creation
        • Example of a complete template configuration for cluster creation
        • Automate multiple subnet creation using SubnetPool
      • Add a machine
        • Create a machine using CLI
        • Create a machine using web UI
        • Assign L2 templates to machines
        • Deploy a machine to a specific bare metal host
        • Override network interfaces naming and order
        • Manually allocate IP addresses for bare metal hosts
      • Add a Ceph cluster
    • Deploy OpenStack
      • Deploy an OpenStack cluster
      • Advanced OpenStack configuration (optional)
        • Enable LVM ephemeral storage
        • Enable LVM block storage
        • Enable DPDK with OVS
        • Enable SR-IOV with OVS
        • Enable BGP VPN
        • Encrypt the east-west traffic
        • Enable Cinder backend for Glance
        • Enable Cinder volume encryption
        • Advanced configuration for OpenStack compute nodes
          • Configuration recommendations for compute node types
          • Configure the CPU model
          • Enable huge pages for OpenStack
          • Configure CPU isolation for an instance
          • Configure custom CPU topologies
          • Configure PCI passthrough for guests
          • Configure initial resource oversubscription
          • Limit HW resources for hyperconverged OpenStack compute nodes
          • Configure GPU virtualization
        • Enable image signature verification
        • Configure LoadBalancer for PowerDNS
      • Access OpenStack after deployment
        • Configure DNS to access OpenStack
        • Access your OpenStack environment
      • Troubleshoot an OpenStack deployment
        • Debugging the Helm releases
        • Debugging the OpenStack Controller
        • Debugging the OsDpl CR
        • Support dump
    • Deploy Tungsten Fabric
      • Tungsten Fabric deployment prerequisites
      • Deploy Tungsten Fabric
      • Advanced Tungsten Fabric configuration (optional)
        • Enable huge pages for OpenStack with Tungsten Fabric
        • Enable DPDK for Tungsten Fabric
        • Enable SR-IOV for Tungsten Fabric
        • Configure multiple Contrail API workers
        • Disable Tungsten Fabric analytics services
      • Troubleshoot the Tungsten Fabric deployment
        • Enable debug logs for the Tungsten Fabric services
        • Troubleshoot access to the Tungsten Fabric web UI
        • Disable TX offloading on NICs used by vRouter
  • Operations Guide
    • Cluster update
      • Update to a major version
      • Update to a patch version
      • Verify the management cluster status before MOSK update
      • Change the upgrade order of a machine
      • Configure the parallel update of worker nodes
      • Create update groups for worker machines
      • Granularly update a managed cluster using the ClusterUpdatePlan object
      • Configure update auto-pause
      • Calculate a maintenance window duration for update Deprecated
    • Getting access
      • Generate a kubeconfig for a MOSK cluster using API
      • Connect to a MOSK cluster
      • Access the Keycloak Admin Console
      • Access the Tungsten Fabric web UI
      • Add a cluster to Lens
    • OpenStack operations
      • Upgrade OpenStack
      • Backup and restore OpenStack databases
        • Enable OpenStack database remote backups
        • Restore OpenStack databases from a backup
        • Verify the periodic backup jobs for the OpenStack database
      • Add a controller node
      • Replace a failed controller node
      • Add a compute node
      • Change oversubscription settings for existing compute nodes
      • Delete a compute node
      • Reschedule stateful applications
      • Run Tempest tests
      • Remove an OpenStack cluster
      • Remove an OpenStack service
      • Enable uploading of an image through Horizon with untrusted SSL certificates
      • Rotate OpenStack credentials
      • Customize OpenStack container images
      • Troubleshoot orphaned resource allocations
      • Start monitoring IP address capacity
    • OpenStack services configuration
      • Configure high availability with Masakari
      • Configure monitoring of cloud workload availability
    • Ceph operations
      • Ceph default configuration options
      • Ceph advanced configuration
      • Configure Ceph Object Gateway TLS
      • Use object storage server-side encryption
      • Set an Amazon S3 bucket policy
        • Create Ceph Object Storage users
        • Set a bucket policy for a Ceph Object Storage user
        • Set a bucket policy for OpenStack users
      • Calculate target ratio for Ceph pools
      • Ceph pools for Cinder multi-backend
      • Automated Ceph LCM
        • High-level workflow of Ceph OSD or node removal
          • Creating a Ceph OSD removal request
          • KaaSCephOperationRequest OSD removal specification
          • KaaSCephOperationRequest OSD removal status
        • Add, remove, or reconfigure Ceph nodes
        • Add, remove, or reconfigure Ceph OSDs
        • Add, remove, or reconfigure Ceph OSDs with metadata devices
        • Replace a failed Ceph OSD
        • Replace a failed Ceph OSD with a metadata device
          • Replace a failed Ceph OSD with a metadata device as a logical volume path
          • Replace a failed Ceph OSD disk with a metadata device as a device name
        • Replace a failed metadata device
        • Replace a failed Ceph node
      • Remove Ceph OSD manually
      • Migrate Ceph cluster to address storage devices using by-id
      • Obtain a by-id symlink of a storage device
      • Increase Ceph cluster storage size
      • Move a Ceph Monitor daemon to another node
      • Migrate a Ceph Monitor before machine replacement
      • Enable Ceph RGW Object Storage
      • Enable multisite for Ceph RGW Object Storage
      • Manage Ceph RBD or CephFS clients and RGW users
        • Manage Ceph RBD or CephFS clients
        • Manage Ceph Object Storage users
      • Verify Ceph
        • Verify the Ceph core services
        • Verify rook-discover
        • Verify Ceph cluster state through CLI
          • Verify Ceph cluster state
          • KaaSCephCluster.status description
        • View Ceph cluster summary through the Container Cloud web UI
        • Verify Ceph Controller and Rook
      • Enable Ceph tolerations and resources management
        • Enable Ceph tolerations and resources management
        • Verify Ceph tolerations and resources management
      • Enable Ceph multinetwork
      • Enable Ceph RBD mirroring
      • Configure Ceph Shared File System (CephFS)
      • Share Ceph across two managed clusters
      • Specify placement of Ceph cluster daemons
      • Migrate Ceph pools from one failure domain to another
      • Enable periodic Ceph performance testing
        • Create a Ceph performance test request
        • KaaSCephOperationRequest CR perftest specification
        • KaaSCephOperationRequest perftest status
    • StackLight operations
      • Configure StackLight
        • StackLight configuration procedure
        • StackLight configuration parameters
        • Verify StackLight after configuration
      • Tune OpenSearch performance
      • Export logs from OpenSearch Dashboards to CSV
      • OpenSearch Dashboards
        • View OpenSearch Dashboards
        • Search in OpenSearch Dashboards
      • View Grafana dashboards
      • Export data from Table panels of Grafana dashboards to CSV
      • StackLight alerts
        • OpenStack
          • OpenStack system services
            • Libvirt
            • MariaDB
            • Memcached
            • SSL certificates
            • RabbitMQ
          • OpenStack core services
            • OpenStack services API
            • Cinder
            • Ironic
            • Neutron
            • Nova
            • Cloudprober
            • Portprober
            • PowerDNS
            • Credential rotation
          • OpenStack Controller (Rockoon)
        • Tungsten Fabric
          • Cassandra
          • Kafka
          • Redis
          • Tungsten Fabric Operator
          • Tungsten Fabric
          • ZooKeeper
        • StackLight
          • Alertmanager
          • cAdvisor
          • Elasticsearch Exporter
          • Fluentd
          • General
          • Grafana
          • Monitoring of external endpoints
          • OpenSearch
          • PostgreSQL and Patroni
          • Prometheus
          • Prometheus MS Teams
          • Prometheus Relay
          • ServiceNow
          • Salesforce notifier
          • Telegraf
          • Telemeter
        • Ceph
        • Bare metal
          • Bond interface
          • Ironic
          • Kernel
          • Host Operating System Modules Controller
        • Generic
          • Calico
          • Etcd
        • Kubernetes
          • Kubernetes applications
          • Kubernetes resources
          • Kubernetes storage
          • Kubernetes system
        • Mirantis Container Cloud
          • Helm Controller
          • Container Cloud
          • Container Cloud cache
          • Container Cloud controllers
          • Container Cloud providers
          • Container Cloud SSL
          • Release Controller
        • Mirantis Kubernetes Engine
        • Node
          • General
          • Node network
          • Node time
      • Alert dependencies
      • Silence alerts
      • StackLight rules for Kubernetes network policies
      • Calculate the storage retention time
      • Tune StackLight for long-term log retention
      • Enable log forwarding to external destinations
      • Enable remote logging to syslog
      • Create logs-based metrics
      • Enable generic metric scraping
      • Manage metrics filtering
      • Use S.M.A.R.T. metrics for creating alert rules
      • Deschedule StackLight Pods from a worker machine
    • Tungsten Fabric operations
      • Update Tungsten Fabric
      • Back up TF databases
      • Restore Tungsten Fabric data
      • Convert v1alpha1 TFOperator custom resource to v2
      • Replace a failed TF controller node
      • Delete a vRouter node
      • Verify the Tungsten Fabric deployment
      • Configure load balancing
      • Enable Tungsten Fabric Cassandra repairs
      • Enable contrail-tools
      • Enable tf-api-cli
    • Bare metal operations
      • Upgrade an operating system distribution
      • Remove old Ubuntu kernel packages
      • Host operating system configuration
        • Host OS configuration management workflow
        • Global recommendations for implementation of custom modules
        • Format and structure of a module package
        • Modules provided by MOSK
        • HostOSConfiguration and HostOSConfigurationModules concepts
        • Internal API for host OS configuration management
        • Add a custom module to a MOSK deployment
        • Test a custom or MOSK module after creation
        • Retrigger a module configuration
        • Troubleshooting
      • Migrate container runtime from Docker to containerd
      • Change a user name and password for a bare metal host
      • Restart the inspection of a bare metal host
      • Restart a bare metal host
      • Replace a failed manager node
      • Modify network configuration on an existing machine
      • Add more racks to an existing MOSK cluster
      • Expand IP addresses capacity in an existing cluster
      • Run cluster self-diagnostics
        • Trigger self-diagnostics for a management or managed cluster
        • Self-upgrades of the Diagnostic Controller
        • Diagnostic checks for the bare metal provider
    • IAM operations
      • Manage user roles through Container Cloud API
        • Available IAM roles and use cases
        • Mapping of Keycloak roles to IAM*RoleBinding objects
      • Manage user roles through the Container Cloud web UI
      • Manage user roles through Keycloak
        • MOSK roles and scopes
        • Use cases
      • Change passwords for IAM users
      • Obtain MariaDB credentials for IAM
      • Manage Keycloak truststore using the Container Cloud web UI
    • Management cluster operations
      • Container Cloud CLI
      • Workflow and configuration of management cluster upgrade
      • Schedule Mirantis Container Cloud updates
      • Renew the Container Cloud and MKE licenses
      • Configure NTP server
      • Automatically propagate Salesforce configuration to all clusters
      • Update the Keycloak IP address on bare metal clusters
      • Configure host names for cluster machines
      • Back up MariaDB on a management cluster
        • Configure periodic backups of MariaDB
        • Verify operability of the MariaDB backup jobs
        • Restore MariaDB databases
        • Change the storage node for MariaDB
      • Remove a management cluster
      • Warm up the Container Cloud cache
    • General operations
      • Change a cluster configuration
      • Enable cluster and machine maintenance mode
        • Enable maintenance mode on a cluster and machine using web UI
        • Enable maintenance mode on a cluster and machine using CLI
      • Disable a machine
      • Perform a graceful reboot of a cluster
      • Delete a cluster machine
        • Precautions for a cluster machine deletion
        • Delete a cluster machine using web UI
        • Delete a cluster machine using CLI
      • Delete a managed cluster
      • Verify cluster status
      • Verify machine status
    • Underlay Kubernetes operations
      • Set the MTU size for Calico
      • Add or update a CA certificate for a MITM proxy using API
      • Configure TLS certificates for cluster applications
      • Define a custom CA certificate for a private Docker registry
      • Increase memory limits for cluster components
      • Increase storage quota for etcd
      • Configure Kubernetes auditing and profiling
    • Limitations
  • Troubleshooting Guide
    • Collect cluster logs
    • Inspect the history of a cluster and machine deployment or update
    • Cluster deletion or detachment freezes
    • Keycloak admin console becomes inaccessible after changing the theme
    • The ‘database space exceeded’ error on large clusters
    • The auditd events cause ‘backlog limit exceeded’ messages
    • Troubleshoot a management cluster bootstrap
      • Troubleshoot the bootstrap node configuration
        • DNS settings
        • Default network addresses
      • Troubleshoot the bootstrap region creation
      • Troubleshoot machine creation
      • Troubleshoot deployment stages
      • Collect the bootstrap logs
    • Troubleshoot bare metal
      • Log in to the IPA virtual console for hardware troubleshooting
      • Bare metal hosts in ‘provisioned registration error’ state after update
      • Inspection error on bare metal hosts after dnsmasq restart
      • Troubleshoot an operating system upgrade with host restart
      • Troubleshoot iPXE boot issues
      • Provisioning failure due to device naming issues in a bare metal host profile
    • Troubleshoot Ceph
      • Ceph disaster recovery
      • Ceph Monitors recovery
      • KaaSCephOperationRequest failure with a timeout during rebalance
      • Ceph Monitors store.db size rapidly growing
      • Replaced Ceph OSD fails to start on authorization
      • The ceph-exporter pods are present in the Ceph crash list
    • Troubleshoot StackLight
      • Patroni replication lag
      • Alertmanager does not send resolve notifications for custom alerts
      • Troubleshoot alerts
        • Troubleshoot cAdvisor alerts
        • Troubleshoot Helm Controller alerts
        • Troubleshoot Host Operating System Modules Controller alerts
        • Troubleshoot Ubuntu kernel alerts
        • Troubleshoot Kubernetes applications alerts
        • Troubleshoot Kubernetes resources alerts
        • Troubleshoot Kubernetes storage alerts
        • Troubleshoot Kubernetes system alerts
        • Troubleshoot Mirantis Container Cloud Exporter alerts
        • Troubleshoot Mirantis Kubernetes Engine alerts
        • Troubleshoot OpenSearch alerts
        • Troubleshoot Release Controller alerts
        • Troubleshoot Telemeter client alerts
      • OpenSearchPVCMismatch alert raises due to the OpenSearch PVC size mismatch
      • OpenSearch cluster deadlock due to the corrupted index
      • Failure of shard relocation in the OpenSearch cluster
      • StackLight pods get stuck with the ‘NodeAffinity failed’ error
      • No logs are forwarded to Splunk
  • API Reference
  • User Guide
    • Use the Instance HA service
    • Configure the introspective instance monitor
    • Manage application credentials
    • Authenticate in OpenStack API as a federated OIDC user
    • Use the Shared Filesystems service
      • Set up Shared Filesystems service with generic driver
      • Set up Shared Filesystems service with CephFS driver
    • Deploy your first cloud application using automation
    • Deploy your first cloud application using cloud web UI
    • Use Heat to create and manage Tungsten Fabric objects
    • Use S3 API for MOSK Object Storage
    • Run Windows guests
    • Use the Dynamic Resource Balancer service
    • Migrate instances
    • Configure network trunking in projects
    • Configure per-instance migration mode
  • Security Guide
    • CADF audit notifications in OpenStack services
    • Rotation of credentials in OpenStack
    • Firewall configuration
      • Container Cloud
      • Mirantis Kubernetes Engine
      • StackLight
      • Ceph
      • MOSK
      • OpenStack
      • Tungsten Fabric
    • OpenStack API access policies
    • Data protection
      • Data encryption capabilities
      • Encryption of live migration data
      • Encryption of cloud control plane communications
    • Compliance
      • FIPS compliance
    • Container images signing and validation
  • FAQ

Release notes

  • Release Notes
    • 25.1 series
      • 25.1
        • New features
        • Known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
    • 24.3 series
      • 24.3
        • New features
        • Major components versions
        • Known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • 24.3.1 patch
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.3.2 patch
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.3.3 patch
        • Release artifacts
        • Security notes
        • Known issues
        • Update notes
      • 24.3.4 patch
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
    • 24.2 series
      • 24.2
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues
          • Update known issues
          • Container Cloud web UI known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • 24.2.1 patch
        • Highlights
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.2.2 patch
        • Highlights
        • Release artifacts
        • Security notes
        • Known issues
        • Update notes
      • 24.2.3 patch
        • Highlights
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.2.4 patch
        • Highlights
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.2.5 patch
        • Highlights
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
    • 24.1 series
      • 24.1
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues
          • Update known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • 24.1.1 patch
        • Enhancements
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.1.2 patch
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.1.3 patch
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.1.4 patch
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.1.5 patch
        • Highlights
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.1.6 patch
        • Highlights
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
      • 24.1.7 patch
        • Highlights
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
        • Update notes
    • 23.3 series
      • 23.3
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues
          • StackLight known issues
          • Update known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • 23.3.1 patch
        • Release artifacts
        • Security notes
        • Addressed issues
      • 23.3.2 patch
        • Release artifacts
        • Security notes
      • 23.3.3 patch
        • Release artifacts
        • Security notes
        • Addressed issues
      • 23.3.4 patch
        • Release artifacts
        • Security notes
        • Addressed issues
    • 23.2 series
      • 23.2
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues
          • Wireguard known issues
          • Cluster update known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • 23.2.1 patch
        • Release artifacts
        • Security notes
        • Addressed issues
        • Cluster update known issues
      • 23.2.2 patch
        • Addressed issues
        • Release artifacts
        • Security notes
        • Cluster update known issues
      • 23.2.3 patch
        • Addressed issues
        • Release artifacts
        • Security notes
        • Cluster update known issues
    • 23.1 series
      • 23.1
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues
          • Ceph known issues
          • StackLight known issues
          • Cluster update known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • 23.1.1 patch
        • Release artifacts
        • Security notes
      • 23.1.2 patch
        • Release artifacts
        • Security notes
        • Known issues
      • 23.1.3 patch
        • Release artifacts
        • Security notes
      • 23.1.4 patch
        • Release artifacts
        • Security notes
        • Addressed issues
        • Known issues
    • Release notes for older product versions
      • 22.5
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues
          • Cluster update known issues
          • Ceph known issues
          • StackLight known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • 22.4
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues
          • Cluster update known issues
          • Ceph known issues
          • StackLight known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • 22.3
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues
          • Ceph known issues
          • Cluster update known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • MOSK 22.2 release
        • New features
        • Major components versions
        • Known issues
          • Tungsten Fabric known issues
          • OpenStack known issues
          • Cluster update known issues
        • Release artifacts
        • Addressed issues
        • Update notes
        • Security notes
      • MOSK 22.1 release
        • New features
        • Major components versions
        • Known issues
          • Tungsten Fabric known issues and limitations
          • OpenStack known issues
          • Cluster update known issues
        • Release artifacts
        • Addressed issues
        • Update notes
      • MOS 21.6 release
        • New features
        • Major components versions
        • Known issues
          • Tungsten Fabric known issues and limitations
          • OpenStack known issues
          • Cluster update known issues
          • Ceph known issues
        • Release artifacts
        • Addressed issues
      • MOS 21.5 release
        • New features
        • Major components versions
        • Known issues
          • Tungsten Fabric known issues and limitations
          • OpenStack known issues
          • Cluster update known issues
          • Ceph known issues
        • Release artifacts
        • Addressed issues
      • MOS 21.4 release
        • New features
        • Major components versions
        • Known issues
          • Tungsten Fabric known issues and limitations
          • OpenStack known issues
          • StackLight known issues
          • Cluster update known issues
        • Release artifacts
        • Addressed issues
      • MOS 21.3 release
        • New features
        • Major components versions
        • Known issues
          • Tungsten Fabric known issues and limitations
          • OpenStack known issues
          • Ceph known issues
          • StackLight known issues
        • Release artifacts
        • Addressed issues
      • MOS 21.2 release
        • New features
        • Major components versions
        • Known issues
          • Tungsten Fabric known issues and limitations
          • OpenStack known issues
          • StackLight known issues
        • Release artifacts
        • Addressed issues
      • MOS 21.1 release
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues
          • Tungsten Fabric known issues and limitations
        • Release artifacts
        • Addressed issues
      • MOS Ussuri GA Update release
        • New features
        • Major components versions
        • Known issues
          • OpenStack known issues and limitations
          • Tungsten Fabric known issues and limitations
        • Release artifacts
        • Addressed issues
      • MOS Ussuri GA release
        • Product highlights
        • Major components versions
        • Known issues
          • OpenStack known issues and limitations
          • Tungsten Fabric known issues and limitations
        • Release artifacts
  • Deprecation Notes
    • OpenStack
    • Tungsten Fabric
    • Bare metal
    • Container Cloud
    • Ceph
    • StackLight
  • Release cadence and support cycle
  • Release Compatibility Matrix
  • Container Cloud Release Compatibility Matrix

Obtain a by-id symlink of a storage device¶

You can start using a storage device only after a corresponding Machine becomes ready and accessible. Thus, KaaSCephCluster can be created only after all machines receive the status.providerStatus.hardware.storage configuration containing all required device by-id symlinks.

To obtain a device by-id symlink:

  1. Verify that the Machine is Ready:

    kubectl -n <managedClusterProject> get machine <machineName> -o jsonpath='{.status.phase}{"\n"}'
    

    Substitute <managedClusterProject> with the cluster namespace and <machineName> with the machine name.

  2. Obtain storage details for the Machine:

    kubectl -n <managedClusterProject> get machine <machineName> -o yaml
    

    Output example:

    status:
      providerStatus:
        hardware:
          storage:
          - byID: /dev/disk/by-id/wwn-0x05ad99618d66a21f
            byIDs:
            - /dev/disk/by-id/scsi-0QEMU_QEMU_HARDDISK_05ad99618d66a21f
            - /dev/disk/by-id/scsi-305ad99618d66a21f
            - /dev/disk/by-id/scsi-SQEMU_QEMU_HARDDISK_05ad99618d66a21f
            - /dev/disk/by-id/wwn-0x05ad99618d66a21f
            byPath: /dev/disk/by-path/pci-0000:00:05.0-scsi-0:0:0:0
            byPaths:
            - /dev/disk/by-path/pci-0000:00:05.0-scsi-0:0:0:0
            name: /dev/sda
            serialNumber: 05ad99618d66a21f
            size: 61
            type: hdd
          - byID: /dev/disk/by-id/wwn-0x26d546263bd312b8
            byIDs:
            - /dev/disk/by-id/scsi-0QEMU_QEMU_HARDDISK_26d546263bd312b8
            - /dev/disk/by-id/scsi-326d546263bd312b8
            - /dev/disk/by-id/scsi-SQEMU_QEMU_HARDDISK_26d546263bd312b8
            - /dev/disk/by-id/wwn-0x26d546263bd312b8
            byPath: /dev/disk/by-path/pci-0000:00:05.0-scsi-0:0:0:2
            byPaths:
            - /dev/disk/by-path/pci-0000:00:05.0-scsi-0:0:0:2
            name: /dev/sdb
            serialNumber: 26d546263bd312b8
            size: 32
            type: hdd
          - byID: /dev/disk/by-id/wwn-0x2e52abb48862dbdc
            byIDs:
            - /dev/disk/by-id/lvm-pv-uuid-MncrcO-6cel-0QsB-IKaY-e8UK-6gDy-k2hOtf
            - /dev/disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2e52abb48862dbdc
            - /dev/disk/by-id/scsi-32e52abb48862dbdc
            - /dev/disk/by-id/scsi-SQEMU_QEMU_HARDDISK_2e52abb48862dbdc
            - /dev/disk/by-id/wwn-0x2e52abb48862dbdc
            byPath: /dev/disk/by-path/pci-0000:00:05.0-scsi-0:0:0:1
            byPaths:
            - /dev/disk/by-path/pci-0000:00:05.0-scsi-0:0:0:1
            name: /dev/sdc
            serialNumber: 2e52abb48862dbdc
            size: 61
            type: hdd
    
  3. Obtain the item from the byIDs list from the status.providerStatus.hardware.storage section that contains serialNumber and does not contain wwn as a bus ID.

    In the example above, for the disk with the /dev/sdc name, you can use the /dev/disk/by-id/scsi-0QEMU_QEMU_HARDDISK_2e52abb48862dbdc symlink as a persistent identifier of the storage device because it contains the 2e52abb48862dbdc serial number and does not contain wwn.

    Note

    Do not rely on the byID field only. This field may contain a /dev/disk/by-id/wwn symlink that cannot be considered a persistent identifier of a storage device.

See also

  • Migrate Ceph cluster to address storage devices using by-id

  • Container Cloud documentation: Addressing storage devices

Next
Increase Ceph cluster storage size
Previous
Migrate Ceph cluster to address storage devices using by-id
  • Multi-page view
  • Single-page view

Mirantis Inc. 900 E Hamilton Avenue, Suite 650, Campbell, CA 95008 +1-650-963-9828

© 2005 - 2025 Mirantis, Inc. All rights reserved. "Mirantis" and "FUEL" are registered trademarks of Mirantis, Inc. All other trademarks are the property of their respective owners.