Deka GPU Documentations
  • Starter Guide
    • Introduction
    • Sign Up
    • Choose a Package
    • Top Up
    • Create a Virtual Machine
    • Download kubeconfig
    • Create a Deka LLM
    • Create a Deka Notebook
    • Conclusion
  • Service Portal
    • Introduction
    • Sign Up
    • Sign In
    • Sign Out
    • Forgot Password
    • Account Setting
      • Using MFA Google Authenticator
      • Using MFA Microsoft Authenticator
    • Project
      • Add Project
      • Delete Project
    • List Roles
    • Broadcast
    • Audit Log
    • Voucher
    • Security
      • AI Security AI Infrastructure Layer
      • AI Security AI Application Layer
    • Ticket
      • Create Ticket
      • Detail Ticket
    • Billing
      • Daily Cost Estimated
      • Monthly Cost
      • Invoice
      • Summary Monthly
    • Balance
      • Project Type: SME
        • GPU Merdeka
        • Choose Package
        • Top-Up
      • Project Type: Enterprise
      • History Balance
        • Balance
        • Transaction
      • Custom Resource Definition
  • Deka GPU
    • Deka GPU: Kubernetes
      • Introduction
      • GPU Type
      • Dashboard
        • Check Status Kubernetes
        • Download Kube Config
        • Access Console
      • Workloads
        • Pods
          • Create New Pod
          • Access Console
          • Configuration Pod
          • Delete Pod
          • How to Create a New Pod use CLI
        • Deployments
          • Create New Deployment
          • Configuring Deployment
          • Delete of a Deployment
          • How to Create a New Deployment use CLI
        • DaemonSets
          • Create a New DaemonSet
          • Configuring a DaemonSet
          • Delete DaemonSet
      • Services
      • Storages
        • Storage Class
        • Persistent Volume Claims
          • Create a New Persistent Volume Claim
          • How to Create a New Persistent Volume Claim use CLI
    • Deka GPU: VMs
      • Operating System
      • GPU Type
      • Machine Type
      • Namespace Type
      • Storage Class
      • How to Create a Virtual Machine on Service Portal
      • How to Manually Create a Virtual Machine
        • Download Kube Config
        • Running Kube Config
        • Configuration file dv.yaml
        • Configuration file vm.yaml
        • Configuration file svc.yaml
      • Feature Overview of Virtual Machine
        • Detail a Virtual Machine
        • Open Console
        • Turn Off a VM Instance
        • Turn On a VM Instance
        • Restart a Virtual Machine
        • How to Access Console
        • Show YAML File
      • Delete a Virtual Machine
    • Deka GPU: Registry
      • Create Registry
      • Quota
      • Detail Registry
        • Summary
        • Repository
        • Logs
        • Labels
        • Tag Immutability
        • Member
        • Resize Storage Registry
      • Delete Registry
    • Deka GPU: Security
      • Deka Guard
        • Introduction
        • Create Guard to Deny All Ingress
        • Create Guard to Allow Ingress
        • Create Guard to Allow Ingress with port
        • Create Guard to Allow Ingress with IP/CIDR
        • Create Guard to Deny All Egress
        • Create Guard to Allow Egress
        • Create guard to Allow Egress with Port
        • Create Guard to Allow Egress with IP/CIDR
    • Deka GPU: Service
      • Ingress
        • Install Ingress nginx
        • Install Cert Manager
        • Create Cluster Issuer
        • Create Ingress with TLS
    • Deka GPU: Autoscaling
      • Basic Autoscaling
    • Deka GPU: Network
      • Deka VPC
    • Deka GPU: MLOps
      • Introduction
      • Notebook
      • Tensorboards
      • Volumes
      • Endpoints
        • Create Endpoint
        • Delete Endpoint
      • Experiments (AutoML)
        • Create Experiments (AutoML)
        • Create Experiments (AutoML) using Python SDK
        • Get Experiments Results
      • Experiments (KFP)
        • Create Experiment
      • Pipelines
      • Runs
        • Create Run
        • Delete Active Run
      • Recurring Runs
        • Create Recurring Run
        • Delete Recurring Runs
        • Home
      • Artifacts
      • Executions
      • Manage Contributors
  • Deka LLM
    • Introduction
    • Check Project Type
    • Create a New LLM
    • Detail Deka LLM
      • Overview Tab
      • Keys Tab
        • Create a New Key
        • Detail a Key
        • Edit a Key
        • Get a Secret Key
        • Delete a Key
      • Usage Tab
      • Top Up Coin
    • API Deka LLM
      • Model Management
      • Completions
      • Embedding
    • Delete Deka LLM
    • How to Create Simple Prompt with Deka LLM
      • Create Deka LLM
      • Get URL API Deka LLM
      • Get Secret Key
      • Access API Deka LLM using Postman
      • Get Model
      • Post Chat Completions
  • Deka Notebook
    • Introduction
    • Namespace Type
    • Create a New Notebook
    • Detail Deka Notebook
      • Configuration Deka Notebook
      • Start Deka Notebook Service
      • Stop Deka Notebook Service
      • Get Token
      • Login Deka Notebook
      • Logout Deka Notebook
    • Delete Deka Notebook
  • Reference
    • How to use kubeconfig on Linux
    • How to use kubeconfig on Windows
    • Kubernetes Commands for Enhancing Security
    • How to add GPU in Kubernetes
    • How to Add GPU in VM
      • Download kubeconfig
      • Install kubectl
      • Add GPU
      • Install Driver NVIDIA
    • RAPIDS
      • How to Setup RAPIDS
      • How to make Custom Image
    • How to push image with Docker
    • Deployment LLaMA 3.1 70B with VLLM on Kubernetes
      • Getting the Hugging Face API Key
      • Requesting Access to the LLaMA Model
      • Connect Kubernetes on Computer
      • Create Namespace
      • Create PersistentVolumeClaim (PVC)
      • Create Secret for Hugging Face Token
      • Create Deployment
      • Create Service
      • Verify Deployment
      • Accessing the LLaMA Service
      • Troubleshooting
    • How to Get an API Key on NGC
    • Deployment LLM with Deka GPU + NIM
    • Deployment Deepseek R1 70B with VLLM on Deka GPU's Kubernetes
      • Prerequisites
      • Create Namespace
      • Create PersistentVolumeClaim (PVC)
      • Create Deployment
      • Create Service
      • Verify Deployment
      • Accessing the Deepsek Service
      • Troubleshooting
    • How to Upload and Download on FTP Web
  • Troubleshooting
    • Reinstall Driver NVIDIA on Linux
    • NVIDIA Driver Not Detected After Upgrade Kernel
Powered by GitBook
On this page
  • Create Notebooks
  • Choose Notebook: JupyterLab
  • Add CPU/RAM and GPUs
  • Add Workspace Volume
  • Add Data Volume
  • Choose GPU Type
  • Open JupyterLab Notebook
  • Stop JupyterLab Notebook
  • Delete Notebook
  1. Deka GPU
  2. Deka GPU: MLOps

Notebook

PreviousIntroductionNextTensorboards

Last updated 4 months ago

The Notebooks menu is used to create, data analysis, software development, or machine learning experiments using JupyterLab by running them in Pods on the cluster Deka Your GPU.

Create Notebooks

Create Notebooks is used to create new notebooks on the Deka GPU Portal Service. On the Notebooks page press the button “+ New Notebooks”.

Choose Notebook: JupyterLab

The New Notebook page appears and several columns must be filled in. In the Name column, fill in the name of the notebook that will be used. Need to know: The name must consist of lowercase alphanumeric characters or '-', start with an alphabetic character, and end with an alphanumeric character. In this guide we use JupyterLab. Adjust the name of the image created in the Registry via the Deka GPU Service Portal in the Custom Notebook section.

Add CPU/RAM and GPUs

In the CPU/RAM section in Minimum CPU and Minimum Memory GI, adjust to your needs. In the GPUs section, specify the GPU to be used and the GPU Vendor will automatically be filled with NVIDIA.

Add Workspace Volume

Workspace Volumes are used for storing data used by various components or pipelines and help in organizing and managing data during development. In Workspace Volume there are two features that you can use, namely "Add new volume” and “Attach existing volume”.

The first feature is the button “+Add new Volume” used to add new storage volumes that can be used by various components in a pipeline or notebook server.

To see the details of the new volume that will be added by pressing the icon next to the Delete icon, the new volume displays by default as follows:

a. In the type used empty volume,

b. The name used for the new volume is "-volume", you can customize the name to be used.

c. The size used is 5 Gibibyte,

d. The Storage class by default uses the default storage class, namely storage-nvme-c1, if you don't check Use Default Class there are several options including Empty Storage Class, storage-mgmt, storage-nlsas, storage-nvme-c2, and other built-in classes.

e. In access mode there are three types namely:

  • ReadWriteOnce (RWO) has exclusive access, namely read or write to the notebook server.

  • ReadOnlyMany (ROX) has read-only access on many server notebooks.

  • ReadWriteMany (RWX) have concurrent read or write access to multiple notebook servers.

f. The mount path is the location in the container where the volume will be accessed. In this Workspace Volume, the default directory used by Jupyter Notebook is /home/jovyan.

The second feature is the button “+Attach existing volume” used to connect existing storage volumes to the notebook server or machine learning pipeline in use.

To view the details of the volume attachment you want to add, press the icon next to the Delete icon, displayed by default as follows:

a. In the type used by Kubernetes volume,

b. You can check “Readonly” to ensure the access mode on volumes connected to a notebook server or pipeline is read-only without permission to write or modify data on them.

c. The Name is used to select data for the available workspace volume. To add new volume data, follow the Create Volumes sub-chapter in this guide.

d. The mount path is the location in the container where the volume will be accessed. In this Workspace Volume, the default directory used by Jupyter Notebook is /home/jovyan.

Add Data Volume

The Data Volumes section is used to store and manage data persistently beyond the life cycle of the notebook server used, so that the data remains even if the server is stopped or deleted. In Workspace Volume there are two features that you can use, namely "Add new volume” and “Attach existing volume”. You can add more than one data volume.

The first feature is the button “+Add new Volume” used to add new storage volumes that can be used by various components in a pipeline or notebook server.

To see the details of the new volume data that will be added by pressing the icon next to the Delete icon, the new volume data displays by default as follows:

a. In the type used empty volume,

b. The name used for the new volume is “-datavol-1”, You can customize the name that will be used.

c. The size used is 5 Gibibyte,

d. The Storage class by default uses the default storage class, namely storage-nvme-c1, if you don't check Use Default Class there are several options including Empty Storage Class, storage-mgmt, storage-nlsas, storage-nvme-c2 and other built-in classes.

e. There are three types of access modes, namely:

  • ReadWriteOnce (RWO) has exclusive access, namely read or write to the notebook server.

  • ReadOnlyMany (ROX) has read-only access on many server notebooks.

  • ReadWriteMany (RWX) have concurrent read or write access to multiple notebook servers.

f. The mount path is the location in the container where the volume will be accessed. In this Workspace Volume, the default directory used by Jupyter Notebook is /home/jovyan/-datavol-1.

Choose GPU Type

To be able to select the type of GPU used on the server notebook used, press Advanced Options.

Select the GPU used in Affinity Config. Currently there are only 5 GPUs available that can be used including:

  • NVIDIA HGX-H100 SXM 80GB

  • NVIDIA HGX-H100 SXM 10GB (MIG)

  • NVIDIA HGX-H100 SXM 40GB (MIG)

  • NVIDIA HGX-H100 SXM 20GB (MIG)

  • NVIDIA EGX-L40S 48GB

Click the Launch button to create a notebook.

Open JupyterLab Notebook

After creating and running a new notebook press the Connect button to open the notebook. Jupyter Notebook automatically opens.

Stop JupyterLab Notebook

Stop Notebook Server is used to temporarily stop or pause the running notebook server. It offers several important benefits, including resource conservation, preserving the current state, and better management.

Delete Notebook

Delete Notebooks is used to delete notebooks that are no longer used. On the Notebooks page, determine the notebook you want to delete by pressing the trash icon.

Click the Delete button to continue the process of deleting Notebooks.

Create Notebooks
Create Notebooks
Create Notebooks
Create Notebooks
Add Workspace
Attach Existing Volume
Attach Existing Volume
Data Volume
Add New Data Volume
Add Workspace
Choose GPU Type
Process Notebooks
Notebooks
Jupyter Notebooks
Delete Notebooks
Delete Notebooks
Notebooks
Create Notebooks
GPU Type
Stop Jupyter Notebook
Page cover image