Estimate how many tokens a piece of text will consume, so you can keep prompts inside the context window and control cost.
不同分詞器結果差異較大。