Claude token basics

What is a Claude token and how does it affect context and cost?

A token is a unit the model uses to process text and other serialized context. It is not the same as a word or character: code, punctuation, whitespace and language can tokenize differently. In Claude applications, input tokens can include far more than the visible user message, such as instructions, documents, history and tool definitions.

Results vary by workload. Provider prices and limits remain controlled by the provider.

Input tokens represent the context sent to the model

Depending on the integration, input can include system instructions, user and assistant history, retrieved documents, tool schemas and tool results. Long-running agents may carry substantial context across turns, which is why provider-reported usage is more reliable than counting words in one prompt.

Output tokens represent generated content

Generated answers, code and structured tool arguments consume output tokens under the provider billing rules that apply to the selected model. Input and output can have different prices, so cost estimates should keep them separate.

Local token estimate

This is an approximate comparison, not provider billing data.

Use estimates for comparison and provider data for accounting

A browser estimator can help compare two pieces of visible text, but the provider is the source of truth for billable usage. Capture reported input, cached input and output for representative tasks before making a budget or optimisation decision.

Measurement checklist

  1. Choose a representative completed task, not an artificial one-line prompt.
  2. Record the selected model, provider input, cached input, output, retries and final result.
  3. Change one optimization mechanism at a time so the cause remains visible.
  4. Verify required identifiers, tool calls, code changes or business fields.
  5. Keep passthrough available when the reduced request does not pass.

Varion commercial evaluation

Varion keeps proprietary product implementation details private. Evaluate Token Optimisation on representative traffic and judge it by the measured commercial result. New verified users receive 100,000 processed input tokens and 50 local test runs.

Frequently asked questions

How many words are in one Claude token?

There is no fixed words-per-token ratio. Tokenization depends on language, code, symbols and the tokenizer used by the model.

Does Claude Code only count the text I type?

No. Coding workflows can include project context, files, tools and conversation state beyond the visible user instruction.