How to use
- Paste your prompt, document or chat transcript.
- Choose the tokenizer:
o200k_basefor current OpenAI models, orcl100k_basefor GPT-4 and GPT-3.5. - See the token, character and word counts update live, and turn on the visualizer to see exactly where tokens are split.
FAQ
Is the count accurate for Claude, Gemini, DeepSeek or Qwen?
No tool outside the vendor can be exact for those models: each uses its own tokenizer, and Anthropic and Google do not publish theirs for offline use. The OpenAI count is a reasonable ballpark (often within 10–30%), but use the vendor’s token-counting API when you need exact numbers.
Why does Chinese text use more tokens?
Tokenizers are trained mostly on English, so common English words are often a single token while CJK characters may take one or more tokens each. Newer tokenizers like o200k_base are noticeably more efficient for Chinese than cl100k_base.
Is my text uploaded?
No. The tokenizer (the open-source gpt-tokenizer library) is downloaded once and runs entirely in your browser.