How to use GPUs

If you need a GPU, you can request one by adding a resource limit for a number of nvidia.com/gpu, for example 1 (this is constrained by the number of GPUs available, and your quotas).

apiVersion: v1
kind: Pod
metadata:
  name: gpu-test
spec:
  containers:
    - name: cuda-container
      image: nvcr.io/nvidia/cuda:9.0-devel
      resources:
        limits:
          nvidia.com/gpu: 1 # Request 1 NVIDIA GPU

If you are using a Job, put the resource limit in the pod template:

apiVersion: batch/v1
kind: Job
metadata:
  name: gpu-test
spec:
  template:
    spec:
      restartPolicy: Never
      containers:
        - name: cuda-container
          image: nvcr.io/nvidia/cuda:9.0-devel
          resources:
            limits:
              nvidia.com/gpu: 1 # Request 1 NVIDIA GPU

List of available GPUs

• hsrn-ed7a-370j
  • NVIDIA A100 (40GB)
  • NVIDIA A100 (40GB)
• hsrn-edbse-12wvpl
  • NVIDIA Quadro RTX 8000 (48 GB)
• hsrn-ed2a-60fifthave
  • NVIDIA Quadro RTX 8000 (48 GB)
• hsrn-ed2n-rcdc
  • NVIDIA Quadro RTX 8000 (48 GB)
  • NVIDIA Quadro RTX 8000 (48 GB)
• hsrn-ed10d-7e12
  • NVIDIA A100 (80GB)
  • NVIDIA A100 (80GB)
• hsrn-ed2d-wwh
  • NVIDIA A100 (40GB)
  • NVIDIA A100 (40GB)
• hsrn-ed5a-meyer
  • NVIDIA A100 (80GB)
  • NVIDIA A100 (80GB)