HN Explorer

33 comments

[ 4.9 ms ] story [ 72.4 ms ] thread
jawerty
Excited to use this been using unsloth models for the past couple years
meowokIknewit
The GUI for the fine tuning looks interesting. Hopefully this leads to a lot of new custom models
saberience
Who's the intended user for this?

Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?

Is it a competitor to LMStudio?

trvz
Installing with pip on macOS is just not an acceptable option. It'll mess up your system just like npm or gem.

This needs to go on homebrew or be a zip file with an app for manual download.

mmis1000
Uv helps you up though. Use a pyproject.toml and uv sync. Everything will be put into the venv only, nothing spread across the whole system.

The pyproject.toml can even handles build env for you, so you no longer need a setup.sh that installs 10 tool in specific order with specific flag to produce working environment. A single uv sync, and the job is done.

Plus the result is reproducible, so if this time uv sync work, then it also work next time.

Highly recommend if you are still on pip.

Note: Take a example that I used to install unsloth with rocm setup that based on unreleased git version dependencies and graphic card specific build flag, all of them can be handled with one command 'uv sync'. This will require a big pile of shell script if doing another way. https://github.com/unslothai/unsloth/issues/4280#issuecommen...

smcleod
Ah yes, came to say something similar, Python dependencies are an absolute nightmare, even with uv it feels like there's always a battle to make other peoples Python apps install.

Update: It looks like it doesn't work with the current Python version, you might have to downgrade to Python 3.13 (however even then I still get `error: unexpected argument '--torch-backend' found`)

zokier
What is unsloths business/income? They seem to be publishing lot of stuff for free, with no clear product to back them?
danielhanchen
Hey! Our primary objective for now is to provide the open source community with cool and useful tooling - we found closed source to be much more popular because of better tooling!

We have much much in the pipeline!!

throwa356262
With a team size of eight (!) I think they are not exactly bleeding money
car
Can Unsloth Studio use already downloaded models?
car
Tried to build from source on MacOS, but got this error:

  (base)   unsloth git:(main) unsloth studio setup
  ╔══════════════════════════════════════╗
  ║     Unsloth Studio Setup Script      ║
  ╚══════════════════════════════════════╝ 
   Node v25.8.1 and npm 11.11.0 already meet requirements. Skipping nvm install.
   Node v25.8.1 | npm 11.11.0
   npm run build failed (exit code 2):

  > unsloth-theme@0.0.0 build
  > tsc -b && vite build

  src/features/chat/shared-composer.tsx(366,17): error TS6133: 'status' is declared but its value is never read.
danielhanchen
Apologies on the delay - we fixed it! Please re-try with:

curl -LsSf https://astral.sh/uv/install.sh | sh

uv venv unsloth_studio --python 3.13

source unsloth_studio/bin/activate

uv pip install unsloth --torch-backend=auto

unsloth studio setup

unsloth studio -H 0.0.0.0 -p 8888

car
Thank you for the follow up! Big fan of your models here, thanks for everything you are doing!

Works fine on MacOS now (chat only).

On Ubuntu 24.04 with two GPU's (3090+3070), it appears that Llama.cpp sometimes uses the CPU and not GPU. This is judging from the tk/s and CPU load for identical models run with US-studio vs. just Llama.cpp (bleeding edge).

illusive4080
Apache license. Can’t wait to try it out at work! LMStudio’s proprietary license makes getting permission hard.
yomansat
FYI, if any devs are around, the privacy policy still links to the gitbook.
jacquesm
Unsloth is the real thing. Highly recommended for those running their own AI engines and that want to get the most out of them.
yacin
wish there were an option to disable the annoying startup messages with emojis when using the library.
ma2kx
Nice! Is there something planned to run the finetuning via hf jobs or runpod?
peddling-brink
This looks really cool. Any chance you'll support pretraining runs as well?
claaams
Will check back when there's AMD support.
[deleted]
(comment deleted)
kuon
I hope you will support AMD. This looks Nice but I went the complicated route with AMD GPUs.
fl0id
Does it use gpu support on mac? At least when running setup, it said cpu only.
keyle
I noticed the training part, that was interesting for my use case. Unfortunately it's said 'on NVIDIA'.

Is there an alternative, tutorial, or project you'd recommend that would help me do supervised fine tuning (SFT) with the metal stack / macOS?

[deleted]
(comment deleted)
Havoc
Congrats to team. Busy build a dataset for training so will def test it out
pentagrama
LM Studio user here. Unsloth looks great, wanted to check it out, but there is no app file to download and install? Sorry I'm not familiar with the command line.