Q4_0 KV cache collapses 92.5% at 64K on DGX Spark GB10 (unified memory paradox)
2 points
2 hours ago
| 0 comments
| github.com
| HN
No one has commented on this post.