The genai_output_cost function calculates the cost of output tokens (completion tokens) for a GenAI API call based on the model name and number of output tokens. This helps you understand and track the cost of generated responses separately from prompts.
You can use this function to analyze generation costs, optimize response length for cost efficiency, track output spending separately, or create detailed cost breakdowns.
For users of other query languages
If you come from other query languages, this section explains how to adjust your existing queries to achieve the same results in APL.
In Splunk SPL, you would need to lookup pricing and calculate costs manually.
['ai-logs']
| extend output_cost = genai_output_cost(model, output_tokens)In ANSI SQL, you would join with a pricing table and calculate output costs.
['ai-logs']
| extend output_cost = genai_output_cost(model, output_tokens)Usage
Syntax
genai_output_cost(model, output_tokens)Parameters
| Name | Type | Required | Description |
|---|---|---|---|
| model | string | Yes | The name of the AI model (for example, 'gpt-4', 'claude-3-opus', 'gpt-3.5-turbo'). |
| output_tokens | long | Yes | The number of output tokens (completion tokens) generated by the API call. |
Returns
Returns a real number representing the cost in dollars (USD) for the output tokens based on the model's pricing.
Example
Calculate the cost of output tokens for a GenAI chat operation.
Query
['otel-demo-genai']
| extend model = ['attributes.gen_ai.response.model']
| extend output_tokens = tolong(['attributes.gen_ai.usage.output_tokens'])
| extend output_cost = genai_output_cost(model, output_tokens)
| summarize total_output_cost = sum(output_cost), avg_output_cost = avg(output_cost)Output
| total_output_cost | avg_output_cost |
|---|---|
| 78.34 | 0.0321 |
This query calculates the total and average cost of output tokens, helping you understand generation spending patterns.
List of related functions
- genai_input_cost: Calculates input token cost. Use this alongside output costs to understand the full cost breakdown.
- genai_cost: Calculates total cost (input + output). Use this when you need combined costs.
- genai_get_pricing: Gets pricing information. Use this to understand the pricing structure behind cost calculations.
- genai_extract_assistant_response: Extracts the response text. Combine with output costs to analyze cost per response.
- genai_is_truncated: Checks if responses were truncated. Use this to understand if token limits affected output costs.