Community Article

LLM Fundamentals: Tokens, Context, and Cost

Tokens are not characters or words. Context is not free. Cost is per-token in both directions. The three fundamentals that determine 80% of how an LLM-backed feature performs and bills.