If anyone would like to try the new Sonnet in VSCode. I just updated https://double.bot to the new Sonnet. (disclaimer: I am the cofounder/creator) --- Some thoughts: * Will be interesting to see what we can build in…
Yep you're right, thanks for catching (sorry for the ninja edit!)
Ah you're right I totally misread that!
Interesting observations: * Llama 3.2 multimodal actually still ranks below Molmo from ai2 released this morning. * AI2D: 92.3 (3.2 90B) vs 96.3 (of Molmo 72B) * Llama 3.2 1B and 3B is pruned from 3.1 8B so no…
If you've tried others, would love to understand if there's anything you didn't like specifically (I'm one of the creators for https://double.bot)
Ah interesting! I'm building https://double.bot (ai assistant vscode extension) and someone asked about VSCodium but I didn't realize there's a open marketplace for that specifically.
> Maybe something's timing out with the longer o1 response times? Let me look into this – one issue is that OpenAI doesn't expose a streaming endpoint via the API for o1 models. It's possible there's an HTTP timeout…
Just added o1 to https://double.bot if anyone would like to try it for coding. --- Some thoughts: * The performance is really good. I have a private set of questions I note down whenever gpt-4o/sonnet fails. o1 solved…
If you're open to trying new AI coding assistants, would love if you can give https://double.bot a try! (note: I'm one of the creators) The main philosophical differences is that we are more expensive and are trying to…
Yes, I built the extension. I actually also just went to send another message asking what the first msg was just to double check I didn't have a bug and it does know what the first msg was.
definitely not an articulate request, but the point of using these tools is to speed me up. The less the user has to articulate and the more it can infer correctly, the more helpful it is. Other frontier models don't…
Yes, there's a few things wrong: 1. If it assumes typescript, it should do `as const` in the first msg 2. If it is python, it should be something like https://x.com/WesleyYue/status/1816157147413278811 which is what I…
I'm building a ai coding assistant (https://double.bot) so I've tried pretty much all the frontier models. I added it this morning to play around with it and it's probably the worst model I've ever played with. Less…
Just added Llama 3.1 405B/70B/8B to https://double.bot (VSCode coding assistant) if anyone would like to try it. --- Some observations: * The model is much better at trajectory correcting and putting out a chain of…
I've been using it in https://double.bot (vscode coding copilot I'm hacking on) and it's been pretty great so far. We have support for all the top models (gpt4o, deep seek, opus, etc) so I regularly like to switch…
If anyone would like to try it for coding in VSCode, I just added it to http://double.bot on v93 (AI coding assistant). Feels quite strong so far and got a few prompts that I know failed with gpt4o. fyi for anyone…
Surprised no comments are pointing out that the analysis is pretty far off simply due to the fact that the author runs with batch size of 1. The cost being 100x - 1000x what API providers are charging should be a hint…
You can acknowledge how customers feel while shielding your customer facing staff from verbal abuse. If you've ever worked a customer facing job you'll understand.
If anyone wants to try it for coding, I just added support for GPT4o in Double (https://double.bot) In my tests: * I have a private set of coding/reasoning tests and it's been able to ace all of them so far, beating…
humaneval is generally a very poor benchmark imo and I hate that it's become the default "code" benchmark in any model release. I find it more useful to just look at MMLU as a ballmark of model ability and then just…
Looks interesting! I feel like Qwen has always been one of the most underrated model families that doesn't get as much attention as other peers for whatever reason. (maybe b/c it's from Alibaba?) I've been working on…
Hope they'll release API access soon so I can add it to https://double.bot They've been talking about an API since June and it's now 9 months later with no updates on API access.
for future readers, the setting is now shipped in >v0.49. The default is now back to GPT-4 as it has lower latency but you can manually change it to Claude 3 in settings if you wish to try out Anthropic's new model.
Thank you for the report! We're using Mintlify for the docs (which that URL links to). Let me report it upstream to see if they can fix.
Thanks for the feedback – what search terms did you use? Let me make sure those keywords are on the page :P
If anyone would like to try the new Sonnet in VSCode. I just updated https://double.bot to the new Sonnet. (disclaimer: I am the cofounder/creator) --- Some thoughts: * Will be interesting to see what we can build in…
Yep you're right, thanks for catching (sorry for the ninja edit!)
Ah you're right I totally misread that!
Interesting observations: * Llama 3.2 multimodal actually still ranks below Molmo from ai2 released this morning. * AI2D: 92.3 (3.2 90B) vs 96.3 (of Molmo 72B) * Llama 3.2 1B and 3B is pruned from 3.1 8B so no…
If you've tried others, would love to understand if there's anything you didn't like specifically (I'm one of the creators for https://double.bot)
Ah interesting! I'm building https://double.bot (ai assistant vscode extension) and someone asked about VSCodium but I didn't realize there's a open marketplace for that specifically.
> Maybe something's timing out with the longer o1 response times? Let me look into this – one issue is that OpenAI doesn't expose a streaming endpoint via the API for o1 models. It's possible there's an HTTP timeout…
Just added o1 to https://double.bot if anyone would like to try it for coding. --- Some thoughts: * The performance is really good. I have a private set of questions I note down whenever gpt-4o/sonnet fails. o1 solved…
If you're open to trying new AI coding assistants, would love if you can give https://double.bot a try! (note: I'm one of the creators) The main philosophical differences is that we are more expensive and are trying to…
Yes, I built the extension. I actually also just went to send another message asking what the first msg was just to double check I didn't have a bug and it does know what the first msg was.
definitely not an articulate request, but the point of using these tools is to speed me up. The less the user has to articulate and the more it can infer correctly, the more helpful it is. Other frontier models don't…
Yes, there's a few things wrong: 1. If it assumes typescript, it should do `as const` in the first msg 2. If it is python, it should be something like https://x.com/WesleyYue/status/1816157147413278811 which is what I…
I'm building a ai coding assistant (https://double.bot) so I've tried pretty much all the frontier models. I added it this morning to play around with it and it's probably the worst model I've ever played with. Less…
Just added Llama 3.1 405B/70B/8B to https://double.bot (VSCode coding assistant) if anyone would like to try it. --- Some observations: * The model is much better at trajectory correcting and putting out a chain of…
I've been using it in https://double.bot (vscode coding copilot I'm hacking on) and it's been pretty great so far. We have support for all the top models (gpt4o, deep seek, opus, etc) so I regularly like to switch…
If anyone would like to try it for coding in VSCode, I just added it to http://double.bot on v93 (AI coding assistant). Feels quite strong so far and got a few prompts that I know failed with gpt4o. fyi for anyone…
Surprised no comments are pointing out that the analysis is pretty far off simply due to the fact that the author runs with batch size of 1. The cost being 100x - 1000x what API providers are charging should be a hint…
You can acknowledge how customers feel while shielding your customer facing staff from verbal abuse. If you've ever worked a customer facing job you'll understand.
If anyone wants to try it for coding, I just added support for GPT4o in Double (https://double.bot) In my tests: * I have a private set of coding/reasoning tests and it's been able to ace all of them so far, beating…
humaneval is generally a very poor benchmark imo and I hate that it's become the default "code" benchmark in any model release. I find it more useful to just look at MMLU as a ballmark of model ability and then just…
Looks interesting! I feel like Qwen has always been one of the most underrated model families that doesn't get as much attention as other peers for whatever reason. (maybe b/c it's from Alibaba?) I've been working on…
Hope they'll release API access soon so I can add it to https://double.bot They've been talking about an API since June and it's now 9 months later with no updates on API access.
for future readers, the setting is now shipped in >v0.49. The default is now back to GPT-4 as it has lower latency but you can manually change it to Claude 3 in settings if you wish to try out Anthropic's new model.
Thank you for the report! We're using Mintlify for the docs (which that URL links to). Let me report it upstream to see if they can fix.
Thanks for the feedback – what search terms did you use? Let me make sure those keywords are on the page :P