points
3 months ago
| 1 comment
| HN
TPS is the Ghz of AI models. Both are related to the the propagation time of data.
▲
idonotknowwhy
3 months ago
[-]
Then i guess vocab is the IPC. 10k mistral tokens are about 8k llama3 tokens
reply