Ask HN: Why is so many packages in LLM dev brittle?

1 points by Exorust ↗ HN
I've been a Software engineer for 5 years now, and recently started LLM dev.

A lot of the huggingface, accelerate and bitsandbytes are exceptionally brittle and newer models somehow get stuck in dependecy hell.

1 comment

[ 3.0 ms ] story [ 14.8 ms ] thread
you can probably blame pip