Compiling models to megakernels
15 points
1 day ago
| 1 comment
| blog.luminal.com
| HN
measurablefunc
1 hour ago
[-]
There are only 4 optimizations in computer science: inlining, partial evaluation, dead code elimination, & caching. It looks like AI researchers just discovered inlining & they already knew about caching so eventually they'll get to partial evaluation & dead code elimination.
reply
fragmede
56 minutes ago
[-]
Dead code elimination is already a technique in AI when someone takes an MoE model and removes an unused "E" from it.
reply
mxkopy
36 minutes ago
[-]
AI actually has some optimizations unique to the field. You can in fact optimize a model to make it work; not a lot of other disciplines put as much emphasis on this as AI
reply
tossandthrow
25 minutes ago
[-]
Can you list these optimizations?
reply
mxkopy
19 minutes ago
[-]
RLHF is one that comes to mind
reply