Talking to a local LLM in the Firefox sidebar (code.mendhak.com)

TL;DR

Open `about:config`

Set `browser.ml.chat.hideLocalhost` to `false`

Chatbot sidebar shows "localhost" when Open WebUI runs there.

Change `browser.ml.chat.provider` to the correct URL.

Despite the common plan for many browsers to include their own local model, I feel nobody is really promoting a practical workflow for in-browser LLM side-usage. It's a good time to explore designs like this.

I tried this a few months back, but the LLM sidebar doesn't offer any extra integration that I saw? No variables and no ability to include the page you're looking at as context by doing something like "@selection" or "@currentpage" or similar. I don't understand what the point of having it in your sidebar is when most people already have shortcuts or workflows already setup for their favorite LLM chat applicacations.