Why LLM APIs Shouldn't Ship UTF-8", "Stop Wasting Bandwidth on LLM Text APIs
3 points
1 hour ago
| 1 comment
| github.com
| HN
oofbey
46 minutes ago
[-]
The README claims that it costs 50-100 bytes per token when rendered to UTF8 text and wrapped in JSON. Citation needed please? JSON can be inefficient if you have lots of keys or use pretty whitespace. But UTF8 is very efficient. I don’t see it.
reply