Deka GPU Documentations
  • Starter Guide
    • Introduction
    • Sign Up
    • Choose a Package
    • Top Up
    • Create a Virtual Machine
    • Download kubeconfig
    • Create a Deka LLM
    • Create a Deka Notebook
    • Conclusion
  • Service Portal AI
    • Introduction
    • Sign Up
    • Sign In
      • Sign in using Email and Password
      • Sign in using Google Account
    • Sign Out
    • Forgot Password
    • End-User License Agreement
    • Account Setting
      • Edit Profile
      • Change Password
      • Multi Factor Authentication (MFA)
      • Using MFA Google Authenticator
      • Using MFA Microsoft Authenticator
    • Project
      • Add Project
      • Delete Project
    • List Roles
    • Broadcast
    • Audit Log
    • Voucher
      • Voucher Trial
      • Voucher Credit
    • Security
      • AI Security AI Infrastructure Layer
      • AI Security AI Application Layer
    • Ticket
      • Introduction
      • Create Ticket
      • Detail Ticket
      • Add Attachment
      • Discussion with Cloudeka Support Team
      • Rating and Comment
    • Billing
      • Daily Cost Estimated
      • Monthly Cost
      • Invoice
      • Summary Monthly
    • Balance
      • Introduction
      • Project Type: SME
        • Payment Method for SME Project
        • Package: Flavour Type
        • Package: GPU Types
        • Package: Storage Type
        • Choose Package
        • Top-Up
      • Project Type: Enterprise
      • History Balance
        • Balance
        • Transaction
      • Custom Resource Definition
  • Deka GPU
    • Deka GPU: Kubernetes
      • Introduction
      • GPU Type
      • Dashboard
        • Check Status Kubernetes
        • Download Kube Config
        • Access Console
      • Workloads
        • Pods
          • Create New Pod
          • Access Console
          • Configuration Pod
          • Delete Pod
          • How to Create a New Pod use CLI
        • Deployments
          • Create New Deployment
          • Configuring Deployment
          • Delete of a Deployment
          • How to Create a New Deployment use CLI
        • DaemonSets
          • Create a New DaemonSet
          • Configuring a DaemonSet
          • Delete DaemonSet
      • Services
      • Storages
        • Storage Class
        • Persistent Volume Claims
          • Create a New Persistent Volume Claim
          • How to Create a New Persistent Volume Claim use CLI
      • Resources
        • Ingresses
          • Create a New Ingresses
          • Configuring Ingresses
          • Delete Ingresses
        • Ingresses Classes
          • Create a New Ingresses Classes
          • Configuring Ingresses Classes
          • Delete Ingresses Classes
        • Secrets
          • Create a New Secret
          • Configuring a Secrets
          • Delete a Secrets
        • Config Maps
          • Create a New Config Maps
          • Configuring a Config Map
          • Delete a Config Map
    • Deka GPU: VMs
      • Operating System
      • GPU Type
      • Machine Type
      • Namespace Type
      • Storage Class
      • How to Create a Virtual Machine on Service Portal
      • How to Manually Create a Virtual Machine
        • Download Kube Config
        • Running Kube Config
        • Configuration file dv.yaml
        • Configuration file vm.yaml
        • Configuration file svc.yaml
      • Feature Overview of Virtual Machine
        • Detail a Virtual Machine
        • Open Console
        • Turn Off a VM Instance
        • Turn On a VM Instance
        • Restart a Virtual Machine
        • How to Access Console
        • Show YAML File
      • Delete a Virtual Machine
    • Deka GPU: Registry
      • Create Registry
      • Quota
      • Detail Registry
        • Summary
        • Repository
        • Logs
        • Labels
        • Tag Immutability
        • Member
        • Resize Storage Registry
      • Delete Registry
    • Deka GPU: Security
      • Deka Guard
        • Introduction
        • Create Guard to Deny All Ingress
        • Create Guard to Allow Ingress
        • Create Guard to Allow Ingress with port
        • Create Guard to Allow Ingress with IP/CIDR
        • Create Guard to Deny All Egress
        • Create Guard to Allow Egress
        • Create guard to Allow Egress with Port
        • Create Guard to Allow Egress with IP/CIDR
    • Deka GPU: Service
      • Ingress
        • Install Ingress nginx
        • Install Cert Manager
        • Create Cluster Issuer
        • Create Ingress with TLS
    • Deka GPU: Autoscaling
      • Basic Autoscaling
    • Deka GPU: Network
      • Deka VPC
    • Deka GPU: MLOps
      • Introduction
      • Notebook
      • Tensorboards
      • Volumes
      • Endpoints
        • Create Endpoint
        • Delete Endpoint
      • Experiments (AutoML)
        • Create Experiments (AutoML)
        • Create Experiments (AutoML) using Python SDK
        • Get Experiments Results
      • Experiments (KFP)
        • Create Experiment
      • Pipelines
      • Runs
        • Create Run
        • Delete Active Run
      • Recurring Runs
        • Create Recurring Run
        • Delete Recurring Runs
        • Home
      • Artifacts
      • Executions
      • Manage Contributors
  • Deka Guard
    • Introduction
    • Create Deka Guard
      • Create with Form
      • Create with YAML
      • Create Deny All Igress
      • Create Deny All Egress
    • Configuration Deka Guard
    • Delete Deka Guard
  • Deka Box
    • Introduction
    • Create Deka Box
    • Overview Deka Box
      • Add Bucket
      • Delete Bucket
      • CORS Settings
    • Resize Deka Box
    • Manage Access Key
      • Add Access Key
      • Delete Access Key
    • Access Deka Box using S3 Browser
    • Upload files and folders in S3
    • Enable versioning in S3
    • Create Static Web in S3
    • Delete Deka Box
    • Bucket and Group Access Policies
      • Specify permissions
      • Edit S3 Bucket Policies
  • Deka LLM
    • Introduction
    • Check Project Type
    • Create a New LLM
    • Detail Deka LLM
      • Overview Tab
      • Keys Tab
        • Create a New Key
        • Detail a Key
        • Edit a Key
        • Get a Secret Key
        • Delete a Key
      • Coin Usage Tab
      • Token Usage Tab
      • Playground Tab
        • Integrasi API Preview
        • Chat with your Deka LLM
      • Alert Tab
        • Create a New Alert
        • Update a Alert
        • Delete a Alert
      • Top Up Coin
      • Update Models
      • Download Report
    • API Deka LLM
      • Model Management
      • Completions
      • Embedding
    • Delete Deka LLM
    • How to Create Simple Prompt with Deka LLM
      • Create Deka LLM
      • Get URL API Deka LLM
      • Get Secret Key
      • Access API Deka LLM using Postman
      • Get Model
      • Post Chat Completions
  • Deka Notebook
    • Introduction
    • Namespace Type
    • Create a New Notebook
    • Detail Deka Notebook
      • Configuration Deka Notebook
      • Start Deka Notebook Service
      • Stop Deka Notebook Service
      • Get Token
      • Login Deka Notebook
      • Logout Deka Notebook
    • Delete Deka Notebook
  • Reference
    • How to use kubeconfig on Linux
    • How to use kubeconfig on Windows
    • Kubernetes Commands for Enhancing Security
    • How to add GPU in Kubernetes
    • How to Add GPU in VM
      • Download kubeconfig
      • Install kubectl
      • Add GPU
      • Install Driver NVIDIA
    • RAPIDS
      • How to Setup RAPIDS
      • How to make Custom Image
    • How to push image with Docker
    • Deployment LLaMA 3.1 70B with VLLM on Kubernetes
      • Getting the Hugging Face API Key
      • Requesting Access to the LLaMA Model
      • Connect Kubernetes on Computer
      • Create Namespace
      • Create PersistentVolumeClaim (PVC)
      • Create Secret for Hugging Face Token
      • Create Deployment
      • Create Service
      • Verify Deployment
      • Accessing the LLaMA Service
      • Troubleshooting
    • How to Get an API Key on NGC
    • Deployment LLM with Deka GPU + NIM
    • Deployment Deepseek R1 70B with VLLM on Deka GPU's Kubernetes
      • Prerequisites
      • Create Namespace
      • Create PersistentVolumeClaim (PVC)
      • Create Deployment
      • Create Service
      • Verify Deployment
      • Accessing the Deepsek Service
      • Troubleshooting
    • How to Upload and Download on FTP Web
  • Troubleshooting
    • Reinstall Driver NVIDIA on Linux
    • NVIDIA Driver Not Detected After Upgrade Kernel
Powered by GitBook
Page cover
On this page
  1. Reference
  2. RAPIDS

How to Setup RAPIDS

PreviousRAPIDSNextHow to make Custom Image
CtrlK
  • Data Processing - cuDF
  • Data Processing - cuGraph
  • Data Processing - cuML

This section of the guide will explain how to set up RAPIDS in the Deka GPU Portal Service. By using RAPIDS, operations that would normally run on the CPU can be significantly accelerated by running them on the GPU, providing improved performance in large-scale scenarios. The following are the steps for setting up RAPIDS in the Deka GPU Portal Service:

  • On the MLOps menu page on the left, select the Notebooks menu.

RAPIDS Setup
  • On the Notebooks page press the +New Notebooks button.

RAPIDS Setup
  • The New Notebooks page appears then fill in the name of the notebook and select Jupyterlab.

RAPIDS Setup
  • In the Custom Notebooks section you can use two options including:

  1. Image

In the Image section of existing Custom Notebooks, select "Image", and select zhydnytrat/rapids:1.06

Setup RAPIDS-Custom Notebooks
  1. Custom Image

In the Custom Image section, select "Advanced Options", check the "Custom Image" section, and enter the name of the image repository that will be used along with the tag. For example, the name of the image repository used in the following link https://hub.docker.com/u/ndominic100 then in the custom image name section use something like this ndominic100/rapids-23.08:latest. For further explanation on creating a Custom Image, see the guide in the sub-chapter 4.13.2 How to make Custom Image.

Setup RAPIDS-Custom Notebooks
  • In the CPU/RAM section, adjust it to your needs. Make sure the GPUs section in the Number of GPUs section is 1 and the GPU Vendor uses NVIDIA.

RAPIDS Setup
  • In the Workspace Volume section, determine the size that will be used, in the Access Mode section so that the volume can be used on several notebooks, select "ReadWriteMany" and in the Mount Path section, replace it with "/home/rapids/data".

RAPIDS Setup
  • In the Data Volumes section, make sure you have added a new volume and press the LAUNCH button to continue the RAPIDS creation process in the Deka GPU Portal Service.

RAPIDS Setup
  • Wait until the notebook creation process is complete and ready to use.

RAPIDS Setup

After you have successfully created RAPIDS in the Cloudeka Portal Service, for the next step you can add data processing that can be used. To be able to add processing data that will be used on the Notebooks page in the Deka GPU Portal Service, press the CONNECT button to run the Notebooks that were previously created.

Connect to this Notebooks

Automatically, you will be directed to the notebooks server page, namely Jupyter, select Python 3 in the Notebooks section.

Connect to this Notebooks

You can add a Data Frame that will be used in these notebooks.

Add Code

On RAPIDS there are several data processing that can be used and explained in this guide include the following:

Data Processing - cuDF

Data Processing-cuDF, used for operations such as merging, and filtering data. Main advantage cuDF is its ability to speed up big data processing by leveraging GPUs, thereby reducing data processing time significantly. For further explanation about Data Processing-cuDF, see this link. The following is an example of using Data Processing-cuDF:

Example Syntax for Data Processing cuDF

When DataFrame is already using data processing cuDF then you can perform Pandas operations as usual. For other alternatives, you can use magic line so that there is no need to change all Pandas code to cuDF so that it will automatically switch to CPU if in cuDF there is no method defined by running the syntax below this.

%load_ext cudf.pandas 
Example Syntax for Data Processing cuDF

If you often work with large datasets and are already familiar with pandas, this command is very useful for improving your data processing performance by taking advantage of the GPU.

Data Processing - cuGraph

Data Processing-cuGraph, to run graph analysis on a large scale using GPU. For further explanation about Data Processing-cuGraph, see this link. The following is an example of using Data Processing-cuGraph:

Example Syntax for Data Processing cuGraph

Data Processing - cuML

Data Processing-cuML, is a GPU-based machine learning library developed by NVIDIA as part of the RAPIDS ecosystem. cuML is designed to speed up machine learning workflows by utilizing the parallelism capabilities of GPUs, thus enabling faster data processing and model training compared to CPUs. It provides various algorithms such as linear regression, clustering, PCA, and many more. cuML is compatible with the APIs of the Scikit-Learn library, so users can easily migrate existing code to take advantage of GPU acceleration. For further explanation about Data Processing-cuML, see this link. The following is an example of using Data Processing-cuML:

Example Syntax for Data Processing cuDF