Create a New LLM
Create a New LLM for Enterprise Project or Small Medium Enterprise (SME) is a feature provided in the Service Portal AI to create a new Large Language Model. Before creating a new LLM in the Service Portal AI, you need to determine the project type you are using. To check your project type, refer to the sub-section Check Project Type. This guide uses the Postpaid project type. In the Service Portal AI, go to the LLM menu and click the Create LLM button.

On the Create LLM page, enter the Team Name that will use the LLM model.
Notes: For users with a Prepaid account type, there are differences in the service configuration steps: 1. The system displays two additional mandatory fields:
Billing Type
Purpose of Use
2. Both fields must be completed before the user can proceed with the service creation process.
3. This mechanism is required because token consumption will directly deduct from the prepaid balance according to the selected billing settings.

In the Filter by Type option, select one of the model types you want to use → select Quick Presets → select the model configuration, then enter the token.
Notes: If the user selects the Chat type in the Filter by Type, then:
The recommended Quick Presets option is Text Generation.
The system (OpenAI) will display models that fall under the Chat Model category.
The model configuration on the page will automatically adjust to the selected Chat type.

Chat
Functions to display models designed for interactive conversations.
Code
Functions to display models optimized for programming. This type of model is used for code generation, debugging, code explanation, or assisting developer tasks.
Vision
Functions to display models capable of processing figures/images.
Embedding
Functions to display models that generate vector representations of text. These are used for semantic search, recommendations, clustering, or integration with vector databases.
Enter the number of tokens to be added; the total cost will appear automatically.

Click the Submit button after all required fields have been completed to create the Deka LLM.

If the LLM is successfully created, a notification saying “LLM has been successfully created” will appear, and the system will automatically redirect you to the LLM detail page. For more information, see the Deka LLM Detail subsection.

Last updated
