Create Secret for Hugging Face Token

Create a secret to store the Hugging Face token. If you are using a Linux operating system, then run the following syntax to create the pvc.yaml file.

nano secret.yaml

If you are using a Windows operating system, open a text editor such as Notepad or Notepad++.

Text Editor

Enter the following syntax.

Replace your-hugging-face-token-base64with the base64-encoded version of your actual Hugging Face token. Click this link for further explanation.

apiVersion: v1
kind: Secret
metadata:
  name: hf-token-secret
  namespace: vllm
type: Opaque
data:
  token: your-hugging-face-token-base64

If you are using a Linux operating system, run the following syntax but If you are using a Windows operating system, after save the file as secret.yaml, in CMD navigate to the folder that contains the secret.yaml file and run the following syntax.

kubectl apply -f secret.yaml

success create

To delete the secret.yaml configuration that has been applied, run the following syntax.

kubectl delete -f secret.yaml -n [namespace]

Replace [namespace] with the namespace you created in the sub-chapter Create Namespace.