Ceph

This section provides information about deprecated and removed functionality in Mirantis Ceph.

MiraCeph resources

Deprecated

MOSK management 2.31.0

Unsupported

MOSK 26.1

Details

Deprecated the MiraCeph custom resources in favor of the CephDeployment custom resources.

MiraCeph is automatically migrated to CephDeployment during MOSK cluster update to 26.1. No manual action is required.

For details about the transition of Ceph resources in MOSK 25.2 clusters during the management cluster update to 2.31.0, see Deprecation notes 25.2: KaaSCephCluster API on management clusters.

For the detailed resource mapping, see Comparison of KaaSCephCluster, MiraCeph, and CephDeployment specifications.

Ceph Reef

Deprecated

MOSK 26.1

Unsupported

MOSK 26.2

Details

Deprecated support for Ceph deployments based on the Reef release due to its end of life, in favor of the Squid release. On existing clusters, the Reef release is automatically replaced by Squid during MOSK cluster update.

KaaSCephCluster API on management clusters

Deprecated

MOSK 25.2 and MOSK management 2.30.0

Unsupported

MOSK management 2.31.0

Details

Deprecated the KaaSCephCluster resource on management clusters and replaced it by the following resources on MOSK clusters: MiraCeph, MiraCephHealth, MiraCephSecret, and MiraCephMaintenance.

Also, the KaaSCephOperationRequest resource of the management cluster is replaced by CephOsdRemoveRequest of MOSK clusters.

In MOSK 25.2, migration of custom resources from management to MOSK clusters is optional and recommended to prepare for future migration, but irreversible. For migration details, see Update notes 25.2: Migrate KaaSCephCluster from a management to MOSK cluster.

After the management cluster update to 2.31.0, migration of Ceph resources occurs automatically on existing MOSK clusters. After this migration, any interaction with the Ceph cluster will be processed inside MiraCeph, MiraCephHealth, and MiraCephSecret resources.

For the detailed resource mapping, see Comparison of KaaSCephCluster, MiraCeph, and CephDeployment specifications.

The ingress section in the Ceph spec

Deprecated

MOSK 24.3

Unsupported

MOSK 25.1

Details

Deprecated the ingress section of the Ceph spec. Use the ingressConfig section instead.

On existing clusters, the ingress section is automatically replaced by ingressConfig since MOSK 25.1.

Ceph metrics

Deprecated

MOSK 24.2

Unsupported

MOSK 24.3

Details

Deprecated the performance metric exporter that is integrated into the Ceph Manager daemon for the sake of the dedicated Ceph Exporter daemon. Names of metrics will not be changed, no metrics will be removed.

All Ceph metrics to be collected by the Ceph Exporter daemon will change their labels job and instance due to scraping metrics from new Ceph Exporter daemon instead of the performance metric exporter of Ceph Manager:

  • Values of the job labels will be changed from rook-ceph-mgr to prometheus-rook-exporter for all Ceph metrics moved to Ceph Exporter. The full list of moved metrics is presented below.

  • Values of the instance labels will be changed from the metric endpoint of Ceph Manager with port 9283 to the metric endpoint of Ceph Exporter with port 9926 for all Ceph metrics moved to Ceph Exporter. The full list of moved metrics is presented below.

  • Values of the instance_id labels of Ceph metrics from the RADOS Gateway (RGW) daemons will be changed from the daemon GID to the daemon subname. For example, instead of instance_id="<RGW_PROCESS_GID>", the instance_id="a" (ceph_rgw_qlen{instance_id="a"}) will be used. The list of moved Ceph RGW metrics is presented below.

Therefore, if Ceph metrics to be collected by the Ceph Exporter daemon are used in any customizations, for example, custom alerts, Grafana dashboards, or queries in custom tools, update your customizations to use new labels since Container Cloud 2.28.0 (Cluster releases 16.3.0 and 17.3.0).

List of affected Ceph RGW metrics

  • ceph_rgw_cache_.*

  • ceph_rgw_failed_req

  • ceph_rgw_gc_retire_object

  • ceph_rgw_get.*

  • ceph_rgw_keystone_.*

  • ceph_rgw_lc_.*

  • ceph_rgw_lua_.*

  • ceph_rgw_pubsub_.*

  • ceph_rgw_put.*

  • ceph_rgw_qactive

  • ceph_rgw_qlen

  • ceph_rgw_req

List of all metrics to be collected by Ceph Exporter instead of Ceph Manager

  • ceph_bluefs_.*

  • ceph_bluestore_.*

  • ceph_mds_cache_.*

  • ceph_mds_caps

  • ceph_mds_ceph_.*

  • ceph_mds_dir_.*

  • ceph_mds_exported_inodes

  • ceph_mds_forward

  • ceph_mds_handle_.*

  • ceph_mds_imported_inodes

  • ceph_mds_inodes.*

  • ceph_mds_load_cent

  • ceph_mds_log_.*

  • ceph_mds_mem_.*

  • ceph_mds_openino_dir_fetch

  • ceph_mds_process_request_cap_release

  • ceph_mds_reply_.*

  • ceph_mds_request

  • ceph_mds_root_.*

  • ceph_mds_server_.*

  • ceph_mds_sessions_.*

  • ceph_mds_slow_reply

  • ceph_mds_subtrees

  • ceph_mon_election_.*

  • ceph_mon_num_.*

  • ceph_mon_session_.*

  • ceph_objecter_.*

  • ceph_osd_numpg.*

  • ceph_osd_op.*

  • ceph_osd_recovery_.*

  • ceph_osd_stat_.*

  • ceph_paxos.*

  • ceph_prioritycache.*

  • ceph_purge.*

  • ceph_rgw_cache_.*

  • ceph_rgw_failed_req

  • ceph_rgw_gc_retire_object

  • ceph_rgw_get.*

  • ceph_rgw_keystone_.*

  • ceph_rgw_lc_.*

  • ceph_rgw_lua_.*

  • ceph_rgw_pubsub_.*

  • ceph_rgw_put.*

  • ceph_rgw_qactive

  • ceph_rgw_qlen

  • ceph_rgw_req

  • ceph_rocksdb_.*

The cephDeviceMapping status fields

Deprecated

MOSK 23.1

Unsupported

MOSK 23.2

Details

Removed cephDeviceMapping from the status.fullClusterInfo.cephDetails section of the KaaSCephCluster object because its large size can potentially exceed the Kubernetes 1.5 MB quota.

The mgr.modules parameter

Deprecated

MOSK 22.4

Unsupported

To be decided

Details

Deprecated the mgr.modules parameter in favor of mgr.mgrModules.

Ceph RADOS Gateway users parameter

Deprecated

MOSK 22.4

Unsupported

To be decided

Details

Deprecated the Ceph RADOS Gateway users parameter in favor of objectUsers.

Ceph on management and regional clusters

Deprecated

Container Cloud 2.19.0 (Cluster releases 11.3.0 and 7.9.0)

Unsupported

Container Cloud 2.20.0 (Cluster releases 11.4.0 and 7.10.0)

Details

Removed Ceph cluster deployment from the management and regional clusters to reduce resource consumption. Ceph is automatically removed during the Cluster release update to 11.4.0 or 7.10.0.

The dataPool field in CephFS specification

Deprecated

MOSK 22.4 and Container Cloud 2.19.0

Unsupported

To be decided

Details

Deprecated the dataPool field in CephFS specification in favor of dataPools.

The manageOsds parameter in KaaSCephCluster

Deprecated

MOSK 22.1 and Container Cloud 2.14.0

Unsupported

MOSK 22.3 and Container Cloud 2.17.0

Details

Deprecated manageOsds in the KaaSCephCluster CR. To remove Ceph OSDs, see Operations Guide 25.2: Remove Ceph OSD manually or Automated Ceph LCM .

The maintenance flag

Deprecated

MOSK 21.5 and Container Cloud 2.12.0

Unsupported

MOSK 22.1 and Container Cloud 2.14.0

Details

Deprecated the Ceph maintenance flag as part of Ceph components refactoring.