How can changes to the Llama 3 tokenizer help drive down inference costs? #llama3

Name: How can changes to the Llama 3 tokenizer help drive down inference costs? #llama3
Uploaded: 2024-07-16T00:00:00.000Z
Duration: 55 s
Description: The new Llama 3 tokenizer compresses text better than Llama 2's, producing about 15% fewer tokens on English and, per early open-source findings, possibly under half the tokens in some other languages. Inference effic...

AI at Meta · 0:55

The new Llama 3 tokenizer compresses text better than Llama 2's, producing about 15% fewer tokens on English and, per early open-source findings, possibly under half the tokens in some other languages. Inference effic...

Read the full summary on tuber