Tips for Using GPUs
Get information and statistics for GPUs.
From a JupyterLab terminal window, you can obtain the number of GPU machines and their specifications by entering this command:
nvidia-smi
The preinstalled GPU statistics let you monitor how the GPU machines are being used while building and training machine learning models. These statistics include utilization, memory, and power.
From a JupyterLab terminal window, enter:
gpustat
To get utilization, memory, and power statistics, enter:
gpustat -u -p -c -i 3 --show-power
The command details are in gpustat.
Important
To delete the data stored in the memory of the GPU, we recommend that you shut down the kernel of the notebook running the GPU workload.