Adding Block Storage to a Cluster

Attach extra block storage to the worker nodes of a cluster in Big Data Service. Block storage is a network-attached storage volume that you can use like a regular hard drive.

Note

Nodes in a cluster can have remote, network-attached, block storage or local, direct-attached, Non-Volatile Memory Express (NVMe) storage. Remote block storage is flexible and economical, but local NVMe storage provides the highest performance. The default storage type is determined when the cluster is created, based on the shape chosen for the cluster. The high-performance bare metal nodes and dense I/O virtual machine nodes are created with NVMe storage. Other kinds of virtual machine nodes are created with block storage.

You can attach extra storage to any cluster. You can't remove storage from a cluster.

    1. Open the navigation menu and click Analytics & AI. Under Data Lake, click Big Data Service.
    2. Under Compartment, select the compartment that contains the cluster.
    3. In the list of clusters, click the name of the cluster.
    4. On the Cluster details page, click Add block storage.
    5. In the Add block storage panel, enter following details:
      Node type
      Select the type of node you want to add.
      Additional block storage per node
      Enter a number to indicate the number of gigabytes (GB) of block storage to add (between 150 GB and 32 TB) in increments of 50 GB.
      Cluster admin password
      Enter the administration password for the cluster.
    6. Click Add.
  • Use the oci bds block-storage add command and required parameters to add block storage to worker nodes.

    oci bds block-storage add --bds-instance-id <bds_instance_id> --block-volume-size-in-gbs <block_volume_size_in_gbs> --cluster-admin-password <cluster_admin_password> --node-type <node_type> [OPTIONS]

    For a complete list of flags and variable options for CLI commands, see the Command Line Reference for Big Data.

  • Use the AddBlockStorage operation to to add block storage to nodes.