A bit late, but I followed up on this useful tip and found a gist that breaks down the opencode methodology: https://gist.github.com/rmk40/cde7a98c1c90614a27478216cc0155... The gist led me to the opencode session /…
It seems like there could be a useful strategy of writing a plan with a main agent, and then instead of spawning subagents to implement, fork the main context to write each part. Then use one last fork to verify the…
It seems like they are actually using the subscription providers' respective cli tools and managing context for them. In which case I believe it is not against the ToS any more than invoking codex cli from a custom…
Can anybody share a tested system prompt they use for general coding tasks in pi?
I have one core complex task where there are a number of simple errors like this. The easiest thing for me was to just have a post-processing script that performs: lint > mark known fail-early results > fix common…
I don't see raw token counts, just a list of steps and page counts. For example, what is the rough average token count per page in the ocr and in the translation steps for a Greek book? I have seen Gemini costs change…
Curious as to what your budget was to get where you are today? That's a lot of tokens. I presume you are using gemini flash?
I ran into a website for work that would let you create a long password, but silently truncate it to 12 characters before saving. Mind boggling.
Sounds more like they are implementing mass surveillance and reporting whatever the US Gov wants for 'security reasons' back to them.
Cruise missiles are not general purpose tools, it's obviously not even remotely similar. Virtually everybody reading this could use Mythos immediately to do real work, collectively in virtually every part of the…
What I find impossible to judge is whether me choosing the harness that works best for me and the way I like to work will limit the quality of the LLM output. In this case, given the complexity of LangChain I don't know…
I am very curious about this as well. I'm looking for something that does really well with workflows that require 20 plus steps including a couple while loops and user verifications, but also something simple like a…
I think in most scenarios you don't need to worry so much about kvm ram use, since it looks static but actually it's not and you can over-commit [1]. And of course disk allocation can be dynamic as well. I prefer a lot…
Since models just output the the most probable tokens and you can never accuse them of doing anything other than making it all up, I would like to see these tests run with a prompt that attempts to mitigate…
The actual research paper: https://www.sciencedirect.com/science/article/pii/S135041772...
I *literally* cannot read that yellow text on the white background. I even tried changing the brightness to almost 0, but there is just not enough contrast.
To check whether I understand how this all works: Wouldn't a 4 bit quant run reasonably well (for that hardware) with far less ram, something like 1.5x the 476gb, or 714gb+ ram?
This is the first time in terms of model progress where my personal response is: It does not matter to me because the models 6-12 months ago were already good enough for most everything I need to do. I think 95% of dev…
As far as I can tell this type of model requires 640GB+ of memory using FP8. So likely can be run using 320GB+ memory if using FP4 or similar. So that would be 3 Nvidia DGX Sparks, or 12k of hardware. Is that correct?…
If you wouldn't mind, could you explain a bit what the 248B model is good for, and where it breaks down and you need something better? I hear this take often, but it is always a fleeting remark so I have no idea what…
You can absolutely do that by using subprocess.run, or use the codex sdk https://github.com/openai/codex/tree/main/sdk/python
I thought the most interesting part of the post was that they have an mcp endpoint for bring-your-own agents, and they won't be force feeding ai on anybody. In the security context of the post, they mean that you are…
My first daughter I managed to flip the switch for reading through Tintin and other graphic novels. My younger daughter skipped that entirely. She started reading later than the first, but jumped right in to longer full…
I was looking at their docs and Burr has agent cookbooks to get started with this, and it can handle multi-machine workflows. Is this not what you were looking for? I am not sure how it integrates and uses skills etc,…
Yes, I was not sufficiently thinking about copyright as an arbitrary legal construct that can be manipulated at will. I don't think output should have copyright, but I would presume the copyright should it ever exist…
A bit late, but I followed up on this useful tip and found a gist that breaks down the opencode methodology: https://gist.github.com/rmk40/cde7a98c1c90614a27478216cc0155... The gist led me to the opencode session /…
It seems like there could be a useful strategy of writing a plan with a main agent, and then instead of spawning subagents to implement, fork the main context to write each part. Then use one last fork to verify the…
It seems like they are actually using the subscription providers' respective cli tools and managing context for them. In which case I believe it is not against the ToS any more than invoking codex cli from a custom…
Can anybody share a tested system prompt they use for general coding tasks in pi?
I have one core complex task where there are a number of simple errors like this. The easiest thing for me was to just have a post-processing script that performs: lint > mark known fail-early results > fix common…
I don't see raw token counts, just a list of steps and page counts. For example, what is the rough average token count per page in the ocr and in the translation steps for a Greek book? I have seen Gemini costs change…
Curious as to what your budget was to get where you are today? That's a lot of tokens. I presume you are using gemini flash?
I ran into a website for work that would let you create a long password, but silently truncate it to 12 characters before saving. Mind boggling.
Sounds more like they are implementing mass surveillance and reporting whatever the US Gov wants for 'security reasons' back to them.
Cruise missiles are not general purpose tools, it's obviously not even remotely similar. Virtually everybody reading this could use Mythos immediately to do real work, collectively in virtually every part of the…
What I find impossible to judge is whether me choosing the harness that works best for me and the way I like to work will limit the quality of the LLM output. In this case, given the complexity of LangChain I don't know…
I am very curious about this as well. I'm looking for something that does really well with workflows that require 20 plus steps including a couple while loops and user verifications, but also something simple like a…
I think in most scenarios you don't need to worry so much about kvm ram use, since it looks static but actually it's not and you can over-commit [1]. And of course disk allocation can be dynamic as well. I prefer a lot…
Since models just output the the most probable tokens and you can never accuse them of doing anything other than making it all up, I would like to see these tests run with a prompt that attempts to mitigate…
The actual research paper: https://www.sciencedirect.com/science/article/pii/S135041772...
I *literally* cannot read that yellow text on the white background. I even tried changing the brightness to almost 0, but there is just not enough contrast.
To check whether I understand how this all works: Wouldn't a 4 bit quant run reasonably well (for that hardware) with far less ram, something like 1.5x the 476gb, or 714gb+ ram?
This is the first time in terms of model progress where my personal response is: It does not matter to me because the models 6-12 months ago were already good enough for most everything I need to do. I think 95% of dev…
As far as I can tell this type of model requires 640GB+ of memory using FP8. So likely can be run using 320GB+ memory if using FP4 or similar. So that would be 3 Nvidia DGX Sparks, or 12k of hardware. Is that correct?…
If you wouldn't mind, could you explain a bit what the 248B model is good for, and where it breaks down and you need something better? I hear this take often, but it is always a fleeting remark so I have no idea what…
You can absolutely do that by using subprocess.run, or use the codex sdk https://github.com/openai/codex/tree/main/sdk/python
I thought the most interesting part of the post was that they have an mcp endpoint for bring-your-own agents, and they won't be force feeding ai on anybody. In the security context of the post, they mean that you are…
My first daughter I managed to flip the switch for reading through Tintin and other graphic novels. My younger daughter skipped that entirely. She started reading later than the first, but jumped right in to longer full…
I was looking at their docs and Burr has agent cookbooks to get started with this, and it can handle multi-machine workflows. Is this not what you were looking for? I am not sure how it integrates and uses skills etc,…
Yes, I was not sufficiently thinking about copyright as an arbitrary legal construct that can be manipulated at will. I don't think output should have copyright, but I would presume the copyright should it ever exist…