Llama 3 Tokenizer
Use this tool below to understand how a piece of text might be tokenized by Llama 3 models (Llama 3.1 70B, Llama 3 70B, Llama 3.1 8B) and the total count of tokens in that piece of text.
Maximum 128 KB of text. Large token breakdowns show the first 1,000 tokens.
Tokens
—
Characters
5
Loading models…
Token breakdown
Building an AI chatbot?
GenAI monitoring, prompt management, and magic.
Own Your Data
Self Hostable
1-line Integration
Prompt Templates
Chat Replays
Analytics
Topic Classification
Agent Tracing
Custom Dashboards
Score LLM responses
PII Masking
Feedback Tracking
Own Your Data
Self Hostable
1-line Integration
Prompt Templates
Chat Replays
Analytics
Topic Classification
Agent Tracing
Custom Dashboards
Score LLM responses
PII Masking
Feedback Tracking