Create PersistentVolumeClaim (PVC)

Create a PVC to provide storage for the model cache. If you are using a Linux operating system, then run the following syntax to create the pvc.yaml file.

nano pvc.yaml

If you are using a Windows operating system, open a text editor such as Notepad or Notepad++.

Text Editor

Enter the following syntax.

apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  name: llama-31-70b-instruct
  namespace: vllm
spec:
  accessModes:
  - ReadWriteMany
  resources:
    requests:
      storage: 250Gi
  storageClassName: storage-nvme-c1
  volumeMode: Filesystem

If you are using a Linux operating system, run the following syntax but If you are using a Windows operating system save the file as pvc.yaml. in CMD, navigate to the folder that contains the pvc.yaml file and run the following syntax.

kubectl apply -f pvc.yaml

Success Create PVC

To delete the pvc.yaml configuration that has been applied, run the following syntax.

kubectl delete -f pvc.yaml -n [namespace]

Replace [namespace] with the namespace you created in the sub-chapter Create Namespace.