FilterHN

The annotated PyTorch training loop

65 points

by smaddrellmander

3 days ago

| past

| 4 comments

| idlemachines.co.uk

| HN

▲

GL26

6 hours ago

[-]

PyTorch already does a huge job at keeping DL not verbose. It captures the complexity to allow you to make a whole GPT model with it, running on your GPU, and keep the code readable. Yes, there are a lot of breaking points, but at some point, DL is supposed to be non trivial, it handles math concepts most people don’t understand. That is why Data Scientists have a job ;)

▲

sva_

5 hours ago

[-]

I mean partial derivatives aren't that complicated if you know normal derivatives, which most people do. And backpropagation isn't too difficult either.

The value of PyTorch lies more in utilizing accelerators like GPUs while offering a nice abstraction. But you can build your own (inefficient) tensor library without too much effort as e.g. Andrej Karpathy has shown in his "NN zero to hero" youtube series.

▲

vovavili

6 hours ago

[-]

The host website seems extremely interesting in general. Anyone here used it before?

▲

f3408fh

6 hours ago

[-]

The design is similar to what Claude generates. Makes me skeptical that all the content is AI-generated.

▲

vovavili

6 hours ago

[-]

This looks better than 90% of websites I visited. The palette is pleasant, content has the right density and spacing is very relaxed. If this is AI-generated without some clever prompt tuning, frontend as a profession is done.

▲

f3408fh

6 hours ago

[-]

I am 95% sure Claude came up with the design. It has all the tell-tale signs like the all-caps bold letter-spaced microcopy (See the orange "Sharpen your AI fundamentals" on the landing page.) Many card-like elements with a colored border on one side only. The italic serif font as subtitle. Etc. That being said I'm not judging. It's competently done.

I also put the content of a workshop into an LLM detector and it said 100% of the text was likely AI generated.

I'd just like the author to disclose how much of the content is entirely LLM-generated.

▲

CamperBob2

21 minutes ago

[-]

It's surprising to say people complimenting the color palette on this site. It's almost unreadable on my (very nice) monitor but clearly it works for many readers.

▲

panarky

2 hours ago

[-]

Most people here seem to think the content is high quality.

Do you disagree?

▲

f3408fh

52 minutes ago

[-]

Uhhh apart from OP I don’t see anyone commenting on the content quality?

Also OP didn’t even praise the content. They said it “seems interesting.”

▲

Synthetic7346

7 hours ago

[-]

https://idlemachines.co.uk/courses/foundations doesn't render correctly on mobile

▲

moelf

7 hours ago

[-]

even the submitted page doesn't, huge margin if you zoom out on mobile (Firefox)

▲

LoganDark

6 hours ago

[-]

I've seen that huge margin when zooming out issue before. I'm using Safari on iOS, but have also experienced this issue in Chrome on Android. It's probably some sort of weird compatibility thing for desktop websites. You start zoomed correctly, but for some reason, there's horizontal scroll and you can also zoom out. For seemingly no reason, as I doubt any of the websites where this happens intended it.

Note that I can't reproduce it myself on this submission, but I've seen it so many times and in so many different places that I don't think it's a website issue.

▲

brcmthrowaway

1 hour ago

[-]

Does Anthropic/OpenAI use PyTorch to train?