Oracle Cloud Infrastructure Documentation

Supported Compute Shapes

Data Science supports specific Compute shapes for various resources in the service.

VM Compute shapes and GPU Compute shapes describe these shapes in detail.

Tip

Sizing notebook sessions gives you tips about how to use shapes.

OCPUs represent physical CPU cores. Most CPU architectures, including x86, run two threads per physical core, so one OCPU is the equal of two vCPUs for x86-based compute. The cost per vCPU is half the cost of an OCPU, see Data Science pricing.

AMD CPU

Shape OCPUs GB Memory
VM.Standard.E3.Flex 1–64 1–1024 (dependent on OCPU count)
VM.Standard.E4.Flex 1–64 1–1024 (dependent on OCPU count)

For notebook sessions, the maximum memory for a standard flexible shape is 64 GB per OCPU up to the maximum allowed memory. For example, for two OCPUs, the maximum allowed memory is 2 * 64 = 128 GB. For 20 OCPUs, 20 * 64 = 1280 GB > 1024 GB. Therefore, for 20 OCPUs, the maximum allowed memory for both VM.Standard.E3. Flex and VM.Standard.E4.Flex is 1,024 GB.

Example:

OCPU GB Memory
1 1-64
2 1-128
3 1-192
4 1–256

When you use standard flexible shapes for model deployments:

  • The minimum memory is 6 GB per OCPU used for the model server and load.
  • The maximum memory is 64 GB per OCPU up to the allowed memory for each shape. For example, maximum allowed memory for the VM.Standard.E3. Flex shape is 1,024 GB.

ARM CPU

Shape OCPUs GB Memory
VM.Standard.A1.Flex 1–80 1–1024 (dependent on OCPU count)

For notebook sessions, the maximum memory for a standard flexible shape is 64 GB per OCPU up to the maximum allowed memory (1024 GB). For example, for two OCPUs, the maximum allowed memory is 2 * 64 = 128 GB. For 20 OCPUs, 20 * 64 = 1280 GB > 1024 GB.

OCPU GB Memory
1 1-64
2 1-128
3 1-192
4 1–256

Intel CPU (X9)

Shape OCPUs GB Memory
VM.Standard3.Flex 1–32 1–512 (dependent on OCPU count)
VM.Optimized3.Flex 1–18 1–256 (dependent on OCPU count)

Intel CPU (X7)

Shape OCPUs GB Memory
VM.Standard2.1 1 15
VM.Standard2.2 2 30
VM.Standard2.4 4 60
VM.Standard2.8 8 120
VM.Standard2.16 16 240
VM.Standard2.24 24 320

NVIDIA GPU

Shape GPU Type GPU Count

GPU Memory (GB)

 OCPU Count CPU Memory (GB) Available Regions

VM.GPU2.1

(older generation)

 P100 1 16 12 72 Germany Central (Frankfurt), US East (Ashburn)
VM.GPU3.1 V100 1 16 6 90

Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose)
VM.GPU3.2 V100 2 32 12 180

Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose)
VM.GPU3.4 V100 4 64 24 360

Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose)

BM.GPU2.2

 P100 2 32 28 192

Germany Central (Frankfurt), US East (Ashburn)
BM.GPU3.8 V100 8 128 52 768

Germany Central (Frankfurt), Japan Central (Osaka), Japan East (Tokyo), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (San Jose)
BM.GPU4.8 A100 8 320 64 2048

Australia East (Sydney), Australia Southeast (Melbourne), Brazil East (Sao Paulo), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Israel Central (Jerusalem), Italy Northwest (Milan), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UAE East (Dubai), US East (Ashburn), UK South (London), US West (Phoenix), US West (San Jose)
BM.GPUA10.4 A10 4 96 64 1024

Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose)
VM.GPU.A10.1 A10 1 24 15 240

Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose)

VM.GPU.A10.2 A10 2 48 30 480

Canada Southeast (Toronto), France Central (Paris), Germany Central (Frankfurt), India West (Mumbai), Israel Central (Jerusalem), Japan Central (Osaka), Japan East (Tokyo), Saudi Arabia West (Jeddah), Singapore (Singapore), South Korea Central (Seoul), UK South (London), US East (Ashburn), US West (Phoenix), US West (San Jose)