For the complete documentation index, see llms.txt. This page is also available as Markdown.

Deka LLM Detail

This guide provides detailed information about the Deka LLM service that has been provisioned for a specific project through the Cloudeka Service Portal. There are six main tabs available:

  • Overview Tab

  • Keys Tab

  • Usage Tab

  • Performance Tab

  • Playground Tab

  • Alert Tab

To view the details of Deka LLM, go to the LLM menu on the Manage Module. The system will automatically display the Deka LLM Detail page, which provides comprehensive information about the LLM team, including service URL, team name, status, created date, and remaining coins. This page also allows you to manage the LLM team through available actions such as Top up, API Keys, and Usage Stats, as well as access advanced settings through the gear icon.

Overview Tab

The Overview tab summarises the team configuration, including service URL, team name, status, created date, and remaining coins balance. There are three buttons you can use: Top up, API Keys, and Usage Stats.

Column
Description

Service URL

The endpoint URL used to call the Deka LLM API.

Team Name

The name of the LLM team provisioned in this project.

Status

The current state of the LLM team (Active / Inactive).

Created Date

The date the LLM team was created.

Remaining Coins

The current coin balance available for model consumption.

Keys Tab

The Keys tab displays the list of API keys that have been created for the LLM team. Each key is used to authenticate requests to the Deka LLM endpoint. From this tab you can create a new key via the Create Key button.

Usage Tab

The Usage tab presents analytics of LLM consumption, including total spend, remaining coins, spending trends, breakdown per API Key, and breakdown per Model. You can filter the period using 2 Days, 7 Days, 30 Days, or Custom range.

Performance Tab

The Performance tab presents request-level metrics of the Deka LLM service, including average Time to First Token (TTFT), average Tokens per Second (TPS), average latency, and total request count, accompanied by a detailed transaction table. You can filter by API Key, Model, and Status, and export the data using the Export Excel button.

Playground Tab

The Playground tab provides an interactive chat interface to test the Deka LLM directly from the portal before integrating into your application. Select a model from the Choose Model dropdown, enter your API Key, and start chatting. The right panel automatically generates ready-to-copy code snippets in cURL, Python, and Node.js.

Alert Tab

The Alert tab displays the list of alerts that have been configured to send email notifications when a metric crosses a defined threshold. From this tab you can create a new alert via the Create Alert button, and manage existing alerts through the More action.