Modern GPU Programming for MLSys
54 points
3 days ago
| 3 comments
| mlc.ai
| HN
throwaw12
37 minutes ago
[-]
So many frameworks are being built.

What are the state of the art frameworks in ML programming area? Similar to what React is for web and tailwind for CSS

Triton, ONNX, JAX, PyTorch, cublass, .....

I know they might be for different purposes, but having some idea what is for what and when to use would be helpful

reply
mathisfun123
30 minutes ago
[-]
> ONNX, JAX, PyTorch

these are model-level frameworks

> Triton

this is a kernel DSL

> [cublas]

this is a BLAS library built atop CUDA

> I know they might be for different purposes, but having some idea what is for what and when to use would be helpful

when people ask this question i always ask: who are you and what is your job? if you're not an ML/DL/AI person then you knowing the specifics is about as useful as me knowing the specifics of react/express/angular/tailwind/django/whatever as an ML person. this is not meant to be condescending, this is meant to allay your anxiety, ie that if you ever find yourself in the position where you have to know these things for your job, it won't be that hard to figure out (just like it isn't that hard to figure out the difference between react and express and django if you're a webdev).

reply
throwaw12
15 minutes ago
[-]
I am a product engineer in yet another enterprise SaaS CRUD shop, who wants to learn more about the landscape and find the way to enter it eventually.
reply
mathisfun123
5 hours ago
[-]
"Modern [NVIDIA GPU] Programming for ..."

Everything after "Pipelining GEMM with TMA" (inclusive) is specific to NVIDIA. Which is fine but the title (of the guide itself) is clearly misleading.

reply
nh23423fefe
3 hours ago
[-]
> Our main target is the Blackwell generation,

misleading?

reply
mathisfun123
2 hours ago
[-]
what is it with hn people where they willfully misinterpret the simplest observations;

> the title (of the guide itself) is clearly misleading.

...

> title: the distinguishing name of a written, printed, or filmed production

do you understand now? or do i need to also define for you the word misleading?

reply
nh23423fefe
2 hours ago
[-]
nah talking to you sucks.
reply
hazard
3 hours ago
[-]
This looks great, but I'd really like to see associated exercises (and solutions) to make it useful for self-study
reply