The context window has been shattered: Subquadratic debuts a 12M token window
30 points
3 hours ago
| 4 comments
| thenewstack.io
| HN
refibrillator
2 hours ago
[-]
Previous discussion here (with links to actual primary source):

https://news.ycombinator.com/item?id=48023079

No technical report published yet, unlikely code or weights will be either given VC funding.

reply
Chance-Device
1 hour ago
[-]
It’s probably something like deepseek’s native sparse attention with content based granularity. They might not be publishing anything because it’s not such a strong value proposition and doing so would lead to commentary that would tank their investment opportunities.
reply
SilverElfin
42 minutes ago
[-]
Or maybe because giving it away would tank their investment opportunities.
reply
regularfry
28 minutes ago
[-]
There's ways and means. Pushing something out in the sub-30B range would gain them mindshare and they could keep bigger models to themselves. I can't see any indication of what size their model is though.
reply
roger_
2 hours ago
[-]
Have they published?
reply
Bombthecat
2 hours ago
[-]
I believe it, when I see it.
reply