Ask HN: How to try out AIML finetuning on a laptop?
5 points
18 hours ago
| 1 comment
| HN
I want to try out AI/ML finetuning on a laptop.

Nothing too involved. I just want to see the output of the model improve in a couple of hours as I finetune it.

Is there a pre-trained model out there that is small enough to do this? (Ideally something that can be installed via a single Docker-Compose command.)

PLBjt
18 hours ago
[-]
Hi, depends on what kind of model you want to fine-tune. Could you be a little more specific?
reply
profsummergig
13 hours ago
[-]
I am looking for an aha moment, a eureka moment, where after a bit of finetuning I start to see the model responding.

It literally doesn't matter to me what exact domain problem is solved.

I want something that's easy to set up and could produce (at least some verifiable) results in under an hour.

Some sort of toy problem would be ideal.

reply