FilterHN

Hey! Our primary objective for now is to provide the open source community with cool and useful tooling - we found closed source to be much more popular because of better tooling!

We have much much in the pipeline!!

▲

brainless

12 hours ago

[-]

Thanks! How do you earn or keep yourself afloat? I really like what you guys are doing. And similar orgs. I am personally doing the same, full-time. But I am worried when I will run out of personal savings.

▲

richardw

3 hours ago

[-]

Daniel is a very impressive guy. Well within the realm of “fund the people not the idea” that YC seems to do. Got a few bucks from them and probably earning from collaborations etc. Odds of them not figuring out a business model seem slim.

https://www.ycombinator.com/companies/unsloth-ai

▲

csomar

11 hours ago

[-]

You didn't answer the parent question.

▲

segmondy

2 hours ago

[-]

They don't owe anyone an answer.

▲

kartaka83838

8 hours ago

[-]

that doesnt sound reassuring?

▲

throwa356262

46 minutes ago

[-]

With a team size of eight (!) I think they are not exactly bleeding money

▲

jacquesm

12 hours ago

[-]

Unsloth is the real thing. Highly recommended for those running their own AI engines and that want to get the most out of them.

▲

illusive4080

14 hours ago

[-]

Apache license. Can’t wait to try it out at work! LMStudio’s proprietary license makes getting permission hard.

▲

halJordan

12 hours ago

[-]

Some of it is Apache

▲

smcnally

11 hours ago

[-]

Some of unsloth studio’s code is Apache? Or some of lmstudio is?

▲

mkl

6 hours ago

[-]

From the README at https://github.com/unslothai/unsloth: "Unsloth uses a dual-licensing model of Apache 2.0 and AGPL-3.0. The core Unsloth package remains licensed under Apache 2.0, while certain optional components, such as the Unsloth Studio UI are licensed under AGPL-3.0."

▲

illusive4080

3 hours ago

[-]

Good to know. AGPL is fine at my workplace too, whereas the custom LMStudio license has been in review since mid January with no ETA in sight.

▲

solomatov

44 minutes ago

[-]

What do you mean by custom LMStudio license? Your employer requires reviews of proprietary EULAs or do you try to get a custom licensing deal from LMStudio?

▲

car

16 hours ago

[-]

Tried to build from source on MacOS, but got this error:

  (base)   unsloth git:(main) unsloth studio setup
  ╔══════════════════════════════════════╗
  ║     Unsloth Studio Setup Script      ║
  ╚══════════════════════════════════════╝ 
   Node v25.8.1 and npm 11.11.0 already meet requirements. Skipping nvm install.
   Node v25.8.1 | npm 11.11.0
   npm run build failed (exit code 2):

  > unsloth-theme@0.0.0 build
  > tsc -b && vite build

  src/features/chat/shared-composer.tsx(366,17): error TS6133: 'status' is declared but its value is never read.

▲

danielhanchen

16 hours ago

[-]

Hey will check ASAP and fix - sorry about that

▲

fl0id

3 hours ago

[-]

Does it use gpu support on mac? At least when running setup, it said cpu only.

▲

kuon

5 hours ago

[-]

I hope you will support AMD. This looks Nice but I went the complicated route with AMD GPUs.

▲

trvz

17 hours ago

[-]

Installing with pip on macOS is just not an acceptable option. It'll mess up your system just like npm or gem.

This needs to go on homebrew or be a zip file with an app for manual download.

▲

DIVx0

17 hours ago

[-]

Agree with you, a slightly more maintainable way to use it now is with "uv" or mise. i've used `uv tool install unsloth` for this one.

▲

danielhanchen

16 hours ago

[-]

Yep - uv is a better fit - and you get parallel downloads as well

▲

saagarjha

4 hours ago

[-]

It's not just uv, it also will drop an nvm install in your home directory :(

▲

danielhanchen

16 hours ago

[-]

Hey we're still working on making installation much better - appreciate the feedback!

We come from Python land mainly so packaging and distribution is all very new to us - homebrew will definitely be next!

▲

bityard

16 hours ago

[-]

I recommend installing uv first, then you can install any Python code you want inside a virtual environment to keep it isolated from the rest of the system.

▲

danielhanchen

16 hours ago

[-]

Yep uv pip install unsloth works as well - we probably should have just made that the default - in fact Unsloth makes its own venv using UV if you have it dynamically

▲

mmis1000

11 hours ago

[-]

I think the website should probably mention those installation preset in unsloth pyproject.toml though. The website instruct you to install dependencies separately. But it turns out there are dedicated preset that install specific rocm/cuda/xpu version in the project.

▲

anentropic

5 hours ago

[-]

or `uv tool install unsloth` for a safe 'global' installation

▲

mmis1000

12 hours ago

[-]

Uv helps you up though. Use a pyproject.toml and uv sync. Everything will be put into the venv only, nothing spread across the whole system.

The pyproject.toml can even handles build env for you, so you no longer need a setup.sh that installs 10 tool in specific order with specific flag to produce working environment. A single uv sync, and the job is done.

Plus the result is reproducible, so if this time uv sync work, then it also work next time.

Highly recommend if you are still on pip.

Note: Take a example that I used to install unsloth with rocm setup that based on unreleased git version dependencies and graphic card specific build flag, all of them can be handled with one command 'uv sync'. This will require a big pile of shell script if doing another way. https://github.com/unslothai/unsloth/issues/4280#issuecommen...

▲

jszymborski

13 hours ago

[-]

Would pipx solve the problem?

https://pipx.pypa.io/stable/installation/

▲

gessha

16 hours ago

[-]

I know the whole package system across most languages is a dumpster fire but for Python, uv solves a lot of problems.

uv init

uv add unsloth

uv run main.py % or whatever

▲

danielhanchen

16 hours ago

[-]

Yep UV is fantastic - should have just that default!

▲

smcleod

7 hours ago

[-]

Ah yes, came to say something similar, Python dependencies are an absolute nightmare, even with uv it feels like there's always a battle to make other peoples Python apps install.

Update: It looks like it doesn't work with the current Python version, you might have to downgrade to Python 3.13 (however even then I still get `error: unexpected argument '--torch-backend' found`)

▲

Computer0

16 hours ago

[-]

On my linux systems I use venv to not affect system packages, is that not an option for this situation?

▲

beernet

16 hours ago

[-]

Agreed, feels like a vibe-coded frontend based on already given backend features.

Also, never saw any Unsloth related software in production to this day. Feels strongly like a non-essential tool for hobby LLM wizards.

▲

danielhanchen

16 hours ago

[-]

You would be surprised - we're the 4th largest independent distributor of LLMs in the world - and nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - we for example collab directly with large labs to release models with bug fixes.

▲

airspresso

15 hours ago

[-]

Unsloth is providing the best and most reliable libraries for finetuning LLMs. We've used it for production use-cases where I work, definitely solid.

▲

danielhanchen

12 hours ago

[-]

Glad it was helpful!

▲

ta9000

13 hours ago

[-]

Even a brief reading of their site would have spared you this embarrassment.

▲

claaams

9 hours ago

[-]

Will check back when there's AMD support.

▲

yomansat

14 hours ago

[-]

FYI, if any devs are around, the privacy policy still links to the gitbook.

▲

danielhanchen

12 hours ago

[-]

Oh will check and fix - thanks

▲

meowokIknewit

17 hours ago

[-]

The GUI for the fine tuning looks interesting. Hopefully this leads to a lot of new custom models

▲

danielhanchen

16 hours ago

[-]

Thank you! We're still iterating on it so any suggestions are welcome!

▲

jawerty

19 hours ago

[-]

Excited to use this been using unsloth models for the past couple years

▲

danielhanchen

16 hours ago

[-]

Thank you for your continued support - we have much more planned for it!

▲

peddling-brink

10 hours ago

[-]

This looks really cool. Any chance you'll support pretraining runs as well?

▲

ma2kx

11 hours ago

[-]

Nice! Is there something planned to run the finetuning via hf jobs or runpod?

▲

yacin

11 hours ago

[-]

wish there were an option to disable the annoying startup messages with emojis when using the library.

▲

car

16 hours ago

[-]

Can Unsloth Studio use already downloaded models?

▲

nodja

13 hours ago

[-]

IDK how it did but it detected my LM studio downloaded models I have on a spinning drive (they're not in the default location).

▲

saberience

17 hours ago

[-]

Who's the intended user for this?

Is it like, for AI hobbyists? I.e. I have a 4090 at home and want to fine-tune models?

Is it a competitor to LMStudio?

▲

danielhanchen

16 hours ago

[-]

You would be surprised! Nearly every Fortune 500 company has utilized either our RL fine-tuning package or used our quants and models - the UI was primarily a culmination of pain points folks had when doing either training or inference!

We're complimentary to LM Studio - they have a great tool as well!

▲

TheTaytay

14 hours ago

[-]

I don’t know why this is being downvoted. Danielhanchen is legit, and unsloth was early to the fine-tuning on a budget party.

▲

danielhanchen

12 hours ago

[-]

Haha no worries at all :)

▲

huydotnet

16 hours ago

[-]

you just answered your own question, "AI hobbyists who has 4090 at home". And they are pretty much targeted user of Unsloth since the start.

▲

danielhanchen

16 hours ago

[-]

Actually the opposite haha- more than 50% of our audience comes from large organizations eg Meta, NASA, the UN, Walmart, Spotify, AWS, Google, and the list goes on!

▲

lastdong

17 hours ago

[-]

From the homepage looks like it: “Training: Works on NVIDIA GPUs: RTX 30, 40, 50, Blackwell, DGX Spark/Station etc.”

▲

mlnj

17 hours ago

[-]

I am unaware lm studio is being used for fine tuning. I believe it only does inference.

Happy to see unsloth making it even easier for people like me to get going with fine tuning. Not that I am unable to I'm just lazy.

Fine tuning with a UI is definitely targeted towards hobbyists. Sadly I'll have to wait for AMD ROCm support.

▲

danielhanchen

15 hours ago

[-]

Thanks! We do have normal AMD support for Unsloth but yes the UI doesn't support it just yet! Will keep you posted!