1. HOME
  2. Fuel master documentation
  3. Fuel User Guide
  4. Verify your OpenStack environment
  5. About the Hadoop cluster service test

About the Hadoop cluster service test

About the Hadoop cluster service test

The Hadoop cluster service test verifies that Sahara can launch a Hadoop cluster using the Vanilla plugin.

The following table describes the details of the Hadoop cluster tests.

Sahara platform tests
Name Description Scenario
Test that Sahara can launch a Hadoop cluster using the Vanilla plugin. The test verifies successful launch of the Hadoop cluster.
  1. Log in to the OpenStack dashboard.
  2. Register an image:
    1. Select Project ‣ Data Processing ‣ Image Registry.
    2. Click Register Image.
    3. In the Image field, select an image.
    4. Specify the User Name value for the selected OS.
    5. Set the following values:
      • Plugin=vanilla
      • Version=2.6.0
    6. Click Add plugin tags.
    7. Click Done.
   
  1. Create a master node group template:
    1. Select Project ‣ Data Processing ‣ Node Group Templates.
    2. Click Create Template.
    3. In the Create Node Group template dialog, set the following values:
      • Plugin name=Vanilla Apache Hadoop
      • Hadoop version=2.6.0
    4. Click Create to proceed.
    5. In the second Create Node Group template dialog, set the following values:
      • Template Name=vanilla2-master
      • OpenStack Flavor=m1.small
      • Floating IP pool=(external network)
    6. In the Process section, select:
      • namenode
      • secondarynamenode
      • resourcemanager
      • historyserver
      • oozie
    7. Click Create.
   
  1. Create a worker node group template:
    1. Select :menuselection: Project –> Data Processing –> Node Group Templates.
    2. Click Create Template.
    3. In the Create Node Group template dialog, set the following values:
      • Plugin name=Vanilla Apache Hadoop
      • Hadoop version=2.6.0
    4. Click Create to proceed.
    5. In the second Create Node Group template dialog, set the following values:
      • Template Name=vanilla2-worker
      • OpenStack Flavor=m1.small
      • Floating IP pool=(external network)
    6. In the Process section, select:
      • datanode
      • nodemanager
    7. Click Create.
   
  1. Create a cluster template:
    1. Select Project ‣ Data Processing ‣ Cluster Templates.
    2. Click Create Template.
    3. In the Create Cluster Template dialog, set the following values:
      • Plugin name=Vanilla Apache Hadoop
      • Hadoop version=2.6.0
    4. Click Create.
    5. In the second Create Cluster Template dialog, set the following values:
      • In the Details tab, specify Template Name=vanilla2-template.
      • In the Node Groups tab, specify vanilla2-master and vanilla2-worker.
      • In the HDFS Parameters tab, specify dfs.replication=1.
    6. Click Create.
   
  1. Launch the cluster:
    1. Select Project –> Data Processing –> Clusters.
    2. Click Launch Cluster.
    3. In the Launch Cluster dialog, set the following values:
      • Plugin name=Vanilla Apache Hadoop
      • Hadoop version=2.6.0
    4. Click Create to proceed.
    5. In the second Launch Cluster dialog, set :guilabel:Cluster Name=vanilla2-cluster.
    6. Click Create.
    7. Wait until the cluster has the Active status.
   
  1. Delete the cluster:
    1. In the Clusters page, select the vanilla2-cluster cluster.
    2. Click Delete Cluster.
  2. Delete the templates:
    1. Select Project ‣ Data Processing ‣ Cluster Templates.
    2. Select the vanilla2-template template.
    3. Click Delete Templates.
    4. Select Project –> Data Processing –> Node Group Templates.
    5. Select vanilla2-master and vanilla2-worker templates.
    6. Click Delete Templates.
updated: 2018/03/27