Karpathy's book is very good. I learned Pytorch from it.

If you don't know Linear Algebra at all you might want to get a textbook (I learned from Anton's, I'm not sure it matters.) You'll also want to have a rough understanding of vector calculus if you never took that (but you wouldn't need to be good enough to pass a class.)

This might sound crazy but I've had good luck asking AI to write me a lesson plan for learning things, topics and etc.