So if I'm at the point that math skills, rather than programming skills are my barrier to interesting courses like this one, does anyone know of any good resources? I don't seem able to teach myself calc from a book like I did Python.
Probability https://youtube.com/playlist?list=PLoROMvodv4rOpr_A7B9SriE_i...
Basic algebra and calculus https://tutorial.math.lamar.edu/
Real analysis https://youtube.com/playlist?list=PL0E754696F72137EC
All those are really basics and start from (almost) nothing
After that, I can't recommend enough Bishop, machine learning, and the Bishop on deep learning (books)
Soren Rasted?? Which year was it. Mind blown.
https://news.ycombinator.com/item?id=43391604
https://news.ycombinator.com/item?id=43395172
These resources were helpful for me. Note that, [1] and [2] are concerned about systematic understanding rather than hands on. [3] is a hands on exercise to build neural networks from ground up.
1. A fantastic resource and best resourse IMO, for getting probablistic perspective about machine learning from ground up:
https://www.youtube.com/watch?v=2MuDZIAzBMY&list=PLoROMvodv4...
2. Another good free course.
https://work.caltech.edu/telecourse
3. For hands on after getting some knowledge and building things from ground up:
https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxb...
No doubt CMU's intro to deep learning course is good, you might find some other goodies in that link too.
The other thing is this seems to be very CNN heavy. Four lectures on the topic seems like a lot.
Also, I don’t see embeddings explicitly mentioned as a topic. They’re a huge component of industrial research, and creating good embeddings and retrieving them quickly is a topic I feel students should also be exposed to. (Yes, they mention “representation” with autoencoders but quite frankly the code bit is generally not useful for similarity metrics.)
Finally, it would be nice to expose students to multimodal learning. Something like CLIP would be pretty neat to expose students to. It’s a great insight when you realize that you can train projections of multiple modalities into a shared high dimensional space. If they’re going to cover diffusion models certainly complexity isn’t a concern.
That seems plausible to learn in a semester long course, especially at an institution like CMU
Welcome to CMU :)