Model can accept 1M tokens doesn't mean it can reason across those 1M tokens
1 points
1 hour ago
| 1 comment
| twitter.com
| HN
▲
turtleyacht
1 hour ago
[-]
Looks like there is a memory hierarchy [1] even in LLMs.

[1] https://en.wikipedia.org/wiki/Memory_hierarchy

reply