chat completions is stateless — you must provide the entire conversation history with each new message; openai stores nothing (at least nothing that the downstream product _can use_) beyond the life of the request.…
simple as two config options in `.zed/settings.json` (or `~/.config/zed/settings.json`): ``` { "telemetry": { "diagnostics": false, "metrics": false } } ``` for anyone who wants a fast, modern, resource-minimal,…
I’m very sorry to hear you had such a poor experience as well. I’m sure it’s little consolation at this point having been inconvenienced as you have — it’s certainly not what I aim for in my work! I’ve just submitted a…
Quick follow-up: I’ve just submitted a new update for review with a few small but hopefully noticeable changes, thanks to your feedback: 1. StableLM Zephyr 3b Q4_K_M is now the built-in model, replacing the Q6_K…
Sorry for the confusing experience, and thank you for sharing this! I’ve just submitted a new update for review with a few small but hopefully noticeable changes, thanks in no small part to your feedback: 1. StableLM…
FYI, just submitted a new update for review with a few small but hopefully noticeable changes, thanks in no small part to your feedback: 1. StableLM Zephyr 3b Q4_K_M is now the built-in model, replacing the Q6_K…
Thank you so much for taking the time to try it out!
Oh man I’m a big fan, swyx!! Latent Space & AI.engineer are fantastic resources to the community. Thank you for the kind words & the prompt! It’s still early days, but at a high level, I have a few goals: - expand…
Yes of course, I would very much appreciate that, if you’d be so generous — thank you! You can email britt [at] bl3 [dot] dev
That’s great to hear. I’m sorry again about that poor experience, and please do reach out if you have any other feedback! Britt
Conceptually, to the best of my understanding, nothing too serious; perhaps the inefficiency of processing a larger input than necessary? Practically, a few things: If you want to have your cake & eat it too, they…
I’m very sorry about your experience. That’s definitely not what I was aiming for, and I can imagine that was a nasty surprise. Any hang like that is unacceptable, full stop. My understanding is Metal is currently…
Wow, thanks so much for taking the time to test it out and share such great feedback! Thrilled about all those developments! More model options as well as link-based GGUF downloads on the way. On the 7b models: I’m very…
TL;DR: No, nearly all these apps will use GPU (via Metal), or CPU, not Neural Engine (ANE). Why? I suggest a few main reasons: 1) No Neural Engine API 2) CoreML has challenges modeling LLMs efficiently right now. 3) Not…
you can absolutely access and continue all your past chats in cnvrs! would love to hear what you think: https://testflight.apple.com/join/ERFxInZg
would love for you to give cnvrs a shot! - save characters (system prompt + temperature, and a name & cosmetic color) - download & experiment with models from 1b, 3b, & 7b, and quant options q2k, q4km, q6k - save,…
chat completions is stateless — you must provide the entire conversation history with each new message; openai stores nothing (at least nothing that the downstream product _can use_) beyond the life of the request.…
simple as two config options in `.zed/settings.json` (or `~/.config/zed/settings.json`): ``` { "telemetry": { "diagnostics": false, "metrics": false } } ``` for anyone who wants a fast, modern, resource-minimal,…
I’m very sorry to hear you had such a poor experience as well. I’m sure it’s little consolation at this point having been inconvenienced as you have — it’s certainly not what I aim for in my work! I’ve just submitted a…
Quick follow-up: I’ve just submitted a new update for review with a few small but hopefully noticeable changes, thanks to your feedback: 1. StableLM Zephyr 3b Q4_K_M is now the built-in model, replacing the Q6_K…
Sorry for the confusing experience, and thank you for sharing this! I’ve just submitted a new update for review with a few small but hopefully noticeable changes, thanks in no small part to your feedback: 1. StableLM…
FYI, just submitted a new update for review with a few small but hopefully noticeable changes, thanks in no small part to your feedback: 1. StableLM Zephyr 3b Q4_K_M is now the built-in model, replacing the Q6_K…
Thank you so much for taking the time to try it out!
Oh man I’m a big fan, swyx!! Latent Space & AI.engineer are fantastic resources to the community. Thank you for the kind words & the prompt! It’s still early days, but at a high level, I have a few goals: - expand…
Yes of course, I would very much appreciate that, if you’d be so generous — thank you! You can email britt [at] bl3 [dot] dev
That’s great to hear. I’m sorry again about that poor experience, and please do reach out if you have any other feedback! Britt
Conceptually, to the best of my understanding, nothing too serious; perhaps the inefficiency of processing a larger input than necessary? Practically, a few things: If you want to have your cake & eat it too, they…
I’m very sorry about your experience. That’s definitely not what I was aiming for, and I can imagine that was a nasty surprise. Any hang like that is unacceptable, full stop. My understanding is Metal is currently…
Wow, thanks so much for taking the time to test it out and share such great feedback! Thrilled about all those developments! More model options as well as link-based GGUF downloads on the way. On the 7b models: I’m very…
TL;DR: No, nearly all these apps will use GPU (via Metal), or CPU, not Neural Engine (ANE). Why? I suggest a few main reasons: 1) No Neural Engine API 2) CoreML has challenges modeling LLMs efficiently right now. 3) Not…
you can absolutely access and continue all your past chats in cnvrs! would love to hear what you think: https://testflight.apple.com/join/ERFxInZg
would love for you to give cnvrs a shot! - save characters (system prompt + temperature, and a name & cosmetic color) - download & experiment with models from 1b, 3b, & 7b, and quant options q2k, q4km, q6k - save,…