Show HN: Offline Tiny-LMs 25MB for personal goals, career and pitch deck advice (github.com)

1 points by andyvane ↗ HN
I wanted tiny models that could quickly match what I was writing with advice from books, so while I typed I could see ideas and concepts related to what I was doing, 28,000+ advice rules.

WEB DEMO: the web app and models run in-browser, nothing is uploaded (demo link in github)

CLI: a package manager for models and source data (pipx install etiny && etiny pull personal-goals)

TECH: 3 tiny fine-tuned embedding models, trained on 5GB of synth data using 4x NVIDIA H100s (EuroHPC credit)

Ideas for other models would be much appreciated! a friend suggested a 'preppers model'? not sure... tks, Shane

0 comments

[ 0.23 ms ] story [ 2.3 ms ] thread

No comments yet.