Costs only become real money once you have real traffic. The confusing part isn't the math, it's that nobody tells you what you're actually being charged for until you get a bill that doesn't match what you expected.
You're Not Paying for "an AI," You're Paying by the Word (Sort Of)
When you use an AI API (the thing that lets your app talk to a model like GPT, Claude, or Gemini behind the scenes), you're charged based on how much text goes in and how much text comes out. Not per question, not per app, not per user. Per chunk of text, called a token.
A token is roughly three-quarters of a word. "I want to build an app" is about 6 tokens. That's the whole billing unit: providers count how many tokens you sent (your prompt), and how many tokens the model generated back (its response), and charge you for both, separately.
Why Input and Output Cost Different Amounts
Every provider charges more for the text the model generates than the text you send. Sending text just means the model has to read it. Generating text means the model has to actively produce something new, word by word, which takes more computing work. As a rough rule of thumb, generated (output) text usually costs several times more per token than the text you send it.
This matters in practice: a chatbot that gives long, detailed answers costs more to run than one that gives short answers, even for the exact same questions asked the exact same number of times.
A Real Example, With Small Numbers
Say you're building a simple app: a user types a question (about 50 tokens) and the AI replies with a helpful answer (about 200 tokens). One exchange like that, on a typical mid-range model, costs a fraction of a cent. Genuinely tiny.
The part that surprises people isn't the price per exchange, it's what happens at scale, and what happens with conversations:
- Scale: a fraction of a cent times 10 users a day is nothing. Times 10,000 users a day, it adds up to real monthly spend.
- Conversations: if your app remembers earlier messages (most chat-style apps do), each new message resends the entire conversation so far, not just the new question. A 10-message conversation isn't 10 small charges, it's a growing one, since message 10 re-sends messages 1 through 9 along with it.
That second point is the one almost nobody explains up front, and it's usually the actual reason a first AI app's bill looks bigger than expected.
See this in real numbers, not estimates
The calculator handles the conversation-growth math for youWhat Actually Drives Your Bill
Three things determine what you'll pay, in order of how much they usually matter:
- Which model you pick. Providers offer a range, from small, fast, cheap models to large, capable, expensive ones. A small model can be 10 to 50 times cheaper per token than a flagship model. For a lot of simple tasks (basic Q&A, formatting, simple chat), a small model does the job fine.
- How much text you're sending and generating. Longer conversations, longer documents, longer answers all cost more, directly and proportionally.
- How many people are actually using it. This is the multiplier on everything above. It's also the part that's hardest to estimate before you launch, since you genuinely don't know your usage yet.
The Honest Beginner Mistake to Avoid
The most common early mistake isn't picking the "wrong" model. It's not checking real numbers before building, and then being surprised later. Model pricing is public and changes fairly often, so a number you saw in a tutorial six months ago may already be out of date.
Before you write any code, it's worth doing five minutes of math: pick a model, estimate roughly how long your typical prompts and responses will be, estimate a rough number of users, and see what a month actually looks like. That's a much better foundation than guessing.
Try This Before You Build
You don't need to do this math by hand. Plug your expected token counts, model choice, and rough usage into the free LLM cost calculator, which uses current, verified pricing across major providers and handles the conversation-growth math automatically. It's built for exactly this: figuring out what a real project will actually cost before you commit to building it. The calculator doesn't require an account to use.
Estimate your first AI app's real monthly cost
Pick a model, enter rough usage, see the number