Ask HN: How to try out AIML finetuning on a laptop?

I want to try out AI/ML finetuning on a laptop.

Nothing too involved. I just want to see the output of the model improve in a couple of hours as I finetune it.

Is there a pre-trained model out there that is small enough to do this? (Ideally something that can be installed via a single Docker-Compose command.)

3 comments

[ 13.0 ms ] story [ 492 ms ] thread

PLBjt 1y ago ↗

Hi, depends on what kind of model you want to fine-tune. Could you be a little more specific?

profsummergig 1y ago ↗

I am looking for an aha moment, a eureka moment, where after a bit of finetuning I start to see the model responding.

It literally doesn't matter to me what exact domain problem is solved.

I want something that's easy to set up and could produce (at least some verifiable) results in under an hour.

Some sort of toy problem would be ideal.

parentheses 1y ago ↗

Just fine tune one of OpenAIs models. Try doing it with GPT 4 and use outputs from GPT o1/o3 to produce data.