12 comments

[ 481 ms ] story [ 2873 ms ] thread
Tried to run Jan but it does not start llama server. It also tries to allocate 30gb that is the size of the model but my vram is only 10gb and machine is 32gb, so it does not make sense. Ollama works perfect with 30b models. Another thing that is not good is that it make constant connections to github and other sites.
[dead]
Im confused. Isn’t the whole premise of Ollama that its locallt ran? What’s the difference or USP when comparing the two.
I tried Jan last year, but the UI was quite buggy. But maybe they fixed it.
still looking for vLLM to support Mac ARM Metal GPUs
I really like Jan, especially the organization's principles: https://jan.ai/

Main deal breaker for me when I tried it was I couldn't talk to multiple models at once, even if they were remote models on OpenRouter. If I ask a question in one chat, then switch to another chat and ask a question, it will block until the first one is done.

Also Tauri apps feel pretty clunky on Linux for me.

> Main deal breaker for me when I tried it was I couldn't talk to multiple models at once […]

… which seems particularly strange considering the size of the cloned GitHub repository to be 1.8GiB which swells up to 4.8GiB after running «make build» – I tried to build it locally (which failed anyway).

It is startling that a relatively simple UI frontend can add 3Gb+ of build artefacts alone – that is the scale of a Linux kernel build.

How does this compare to LM studio ?
Tried to run the gpt-oss:20b in ollama (runs perfectly) and tried to connect ollama to jan but it didn't work.
So this is how women named Siri felt in 2011.
My name is Jan and I am not an AI thingy. Just FTR. :)