{"id":462402,"date":"2024-10-09T08:23:02","date_gmt":"2024-10-09T08:23:02","guid":{"rendered":"https:\/\/webkul.com\/blog\/?p=462402"},"modified":"2025-09-29T13:27:18","modified_gmt":"2025-09-29T13:27:18","slug":"large-language-model-price-estimation","status":"publish","type":"post","link":"https:\/\/webkul.com\/blog\/large-language-model-price-estimation\/","title":{"rendered":"Large Language Model Price Estimation"},"content":{"rendered":"\n

Large Language Models<\/h2>\n\n\n\n

Large language models<\/a> (LLM) are AI<\/a> systems capable of understanding and generating human language by processing vast amounts of text data.<\/p>\n\n\n\n

They are deep-learning models pre-trained on enormous amounts of data, allowing them to learn complex patterns, perform analyses, and generate human-like responses.<\/p>\n\n\n\n

Moreover, their ability to analyze and produce complex natural language makes them invaluable for businesses and developers across multiple industries.<\/p>\n\n\n\n

In recent years, Large Language Model<\/a> has taken the limelight of various tech giants as well as innovative startups. All striving to deliver the best possible results through their respective LLMs.<\/p>\n\n\n\n

As these models become more sophisticated, the competition has intensified, with each player seeking to outdo the others by improving accuracy, scalability, and accessibility.<\/p>\n\n\n\n

With so many options available in the market with different abilities and prices With so many options available in the market with different abilities and prices. <\/p>\n\n\n\n

It has been an overhead for consumers to calculate the overall cost of utilizing the LLM model in their project.<\/p>\n\n\n\n

As LLMs become more prevalent across various industries, understanding the cost structure behind them is crucial for businesses looking to integrate these powerful AI tools into their operations. <\/p>\n\n\n\n

Factors Affecting LLM Price Estimation<\/h2>\n\n\n\n

LLM price calculation is based on different providers, model selection, input tokens, and generated output tokens.<\/p>\n\n\n\n

Tokens<\/h3>\n\n\n\n

A token is a unit of text that is used to represent a word, phrase, or other piece of text. For example, “What is Bagisto?” in this line there are 4 tokens “What,”  “is”, “Bagisto” and “?”.<\/p>\n\n\n\n

Providers set the prices on input tokens and output tokens. Moreover, Every LLM have a different tokenization algorithms, thus token count for the same input may vary for different LLMs.<\/p>\n\n\n\n

\"token-vs-character\"<\/figure>\n\n\n\n

Models and pricing<\/strong><\/h2>\n\n\n\n

1 Hosted LLM models:-<\/h3>\n\n\n\n

There are many LLM providers like OpenAI, Gemini, Groq, Openrouter, Cerebras\u202c, Anthropic, Qwen Llama<\/a>, etc., who provide APIs for their cloud hosted models at different costs.<\/p>\n\n\n\n

These models differ in Context length, parameters and their ability to understand and generate responses and thus price according to their ability.<\/p>\n\n\n\n

Here is the list of some hosted LLM models and their price per million token :<\/h4>\n\n\n\n
MODELS<\/strong><\/td>API Provider<\/strong><\/strong><\/td>INPUT PRICE\u202c
\u202d PER MILLION\u202c
TOKEN\u202c<\/strong><\/td>		OUTPUT PRICE\u202c
\u202d PER MILLION\u202c
TOKEN\u202c<\/strong><\/td><\/tr>
Gemini-2.5-flash<\/td>Google\u202c<\/td>$0.30<\/td>$2.50\u202c<\/td><\/tr>
GPT OSS 120B\u202c\u202c<\/td>Cerebras\u202c<\/td>$0.35\u202c<\/td>$0.75<\/td><\/tr>
GPT OSS 120B\u202c<\/td>Groq\u202c<\/td>$0.15<\/td>$0.75<\/td><\/tr>
GPT OSS 120B<\/td>Openrouter\u202c<\/td>$0.05<\/td>$0.25\u202c<\/td><\/tr>
GPT-4.1 mini<\/td>Openai\u202c<\/td>$0.40\u202c<\/td>$1.60\u202c<\/td><\/tr>
Qwen 3 235B\u202c<\/td>Cerebras\u202c<\/td>$0.60<\/td>$1.20<\/td><\/tr>
GPT-5 mini\u202c<\/td>Openai\u202c<\/td>$0.25\u202c<\/td>$2.00\u202c<\/td><\/tr>
GPT-5\u202c<\/td>Openai\u202c<\/td>$1.25<\/td>$10.00<\/td><\/tr>
Gemini-2.5-pro\u202c<\/td>Google\u202c<\/td>$2.50<\/td>$15.00<\/td><\/tr>
GPT OSS 20B\u202c<\/td>Openrouter\u202c<\/td>$0.04<\/td>$0.15<\/td><\/tr>
Claude Sonnet 3.7\u202c<\/td>Anthropic\u202c<\/td>$3.00\u202c<\/td>$15.00\u202c<\/td><\/tr>
GPT OSS 20B<\/td>Groq\u202c \u202c<\/td>$0.10\u202c<\/td>$0.50<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

How to Estimate Price for a query in RAG Chatbot<\/h2>\n\n\n\n

1) Price Calculation for Input<\/h4>\n\n\n\n

Step-1 : <\/strong>Calculate the number of Token in a query, For example, for a simple query like\u202c \u202d\u201cshow me some t-shirts\u201d. We have utilized 5 tokens i.e – “show”, “me”, “some”, “t”, “-shirts”.<\/p>\n\n\n\n

Step-2 :<\/strong> Moreover, calculate the number of Token utilized in prompt. In our product chatbot, the prompt uses approximately 200 tokens.<\/p>\n\n\n\n

Step 3 :<\/strong> Calculate the token consumed by the retrieved document\/data from vector DB for RAG. Roughly, around 2000 tokens were consumed by data of 12 products retrieved from vector database.<\/p>\n\n\n\n

Step 4 :<\/strong> Calculate the cost of input for the above query by using formula below:-<\/p>\n\n\n\n

Input Cost = ((query tokens + prompt tokens + document\/data tokens) *<\/strong> Input price of model)\/1,000,000<\/p>\n\n\n\n

For example<\/strong>: If Gemini-2.5-flash model is used, then the cost for input for above query to the RAG chatbot will be around $0.00066<\/strong> <\/p>\n\n\n\n

2) Price Calculation for Output<\/h4>\n\n\n\n

After LLM generates the response, you can calculate the output tokens. Our chatbot consumed around 2000 tokens for the above query. Now you can calculate the output using formula:-<\/p>\n\n\n\n

Output Cost = (output tokens *<\/strong> output price of model)\/1,000,000<\/p>\n\n\n\n

For example<\/strong>: If Gemini-2.5-flash model is used, then the cost of output for the response generated by chatbot will be around $0.00450\u202c<\/strong><\/p>\n\n\n\n

3) Total Price Calculation<\/h4>\n\n\n\n

Total Cost = Input Cost + Output Cost<\/p>\n\n\n\n

Total cost for the query can be calculated by adding input cost and output cost. Thus, for the above query, “show me some t-shirts\u201d the price for Gemini-2.5-flash model will be $0.00516<\/strong> <\/p>\n\n\n\n

NOTE: <\/strong>This is the estimated cost for the above query; however, it can vary depending on the query itself, the data retrieved, and the response generated by the LLM. <\/p>\n\n\n\n

Here is the list of prices for different LLMs based on the above query example<\/strong><\/p>\n\n\n\n

MODELS<\/strong><\/td>API Provider<\/strong><\/strong><\/td>ESTIMATED\u202c
INPUT PRICE\u202c
PER QUERY\u202c <\/strong><\/td>		ESTIMATED\u202c
OUTPUT PRICE\u202c
PER QUERY\u202c<\/strong><\/td>		ESTIMATED\u202c
TOTAL PRICE PER\u202c
QUERY<\/strong><\/td><\/tr>
Gemini-2.5-flash<\/td>Google\u202c<\/td>$0.00066\u202c <\/td>$0.00450\u202c <\/td>$0.00516\u202c<\/td><\/tr>
GPT OSS 120B\u202c\u202c<\/td>Cerebras\u202c<\/td>$0.00077\u202c <\/td>$0.00135\u202c <\/td>$0.00212\u202c<\/td><\/tr>
GPT OSS 120B\u202c<\/td>Groq\u202c<\/td>$0.00033\u202c <\/td>$0.00135\u202c <\/td>$0.00168<\/td><\/tr>
GPT OSS 120B<\/td>Openrouter\u202c<\/td>$0.00011\u202c <\/td>$0.00045 <\/td>$0.00056\u202c<\/td><\/tr>
GPT-4.1 mini<\/td>Openai\u202c<\/td>$0.00088\u202c <\/td>$0.00288\u202c <\/td>$0.00376\u202c<\/td><\/tr>
Qwen 3 235B\u202c<\/td>Cerebras\u202c<\/td>$0.00132\u202c <\/td>$0.00216\u202c <\/td>$0.00348\u202c<\/td><\/tr>
GPT-5 mini\u202c<\/td>Openai\u202c<\/td>$0.00055\u202c <\/td>$0.00360\u202c <\/td>$0.00415<\/td><\/tr>
GPT-5\u202c<\/td>Openai\u202c<\/td>$0.00275\u202c <\/td>$0.01800\u202c <\/td>$0.02075\u202c<\/td><\/tr>
Gemini-2.5-pro\u202c<\/td>Google\u202c<\/td>$0.00550\u202c <\/td>$0.02700\u202c <\/td>$0.03250<\/td><\/tr>
GPT OSS 20B\u202c<\/td>Openrouter\u202c<\/td>$0.00009\u202c <\/td>$0.00027\u202c <\/td>$0.00036<\/td><\/tr>
Claude Sonnet 3.7\u202c<\/td>Anthropic\u202c<\/td>$0.06600\u202c <\/td>$0.02700\u202c <\/td>$0.09300<\/td><\/tr>
GPT OSS 20B<\/td>Groq\u202c \u202c<\/td>$0.00022\u202c <\/td>$0.00090\u202c <\/td>$0.00112<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Check our RAG based chatbot<\/a> for Magento e-commerce platform.<\/p>\n\n\n\n

2 Locally hosted LLM models:-<\/h3>\n\n\n\n

There are various open source Large Language Models that can be deployed locally on a GPU instance that is wholly available for you only. <\/p>\n\n\n\n

Moreover, these Models have more privacy than hosted models as your data is not sent to a third party models, and it is not subject to their terms of service.<\/p>\n\n\n\n

The cost of these models do not depend on the number of hits and tokens used, but on the size of the GPU instance required to host the LLM model. The exact requirements depend on the model size.<\/p>\n\n\n\n

a) Small to Medium LLMs (less than 8B parameters)<\/h4>\n\n\n\n

There are various small open source models like Owen 1.7 B\/4B \/ 8B models, Llama 3.1 8B etc. These models can be hosted with instance having configuration given below :<\/p>\n\n\n\n