Yes, if it does archiving too that would be perfect.
Not sure, there was a lot of complaints when it rolled out because it was actually peer to peer syncing to other laptops which was causing bandwidth issues for people working on vpn, from planes etc. I’m not sure if it…
Hister sounds like something I wanted for a while, but never got around to building. Searching stuff I’ve seen before is most of what I do with a search engine, so having it local and fast would be amazing. Eager to…
At meta, there was a project for delivering binaries of internally built libraries / binaries to dev laptops using a private ipfs network. This was live for at least some period of time.
Surely you can express this in C++ just as you could in rust…
Yeah, I’m doing TP with two cards. The topology is configured based on yaml files, and if you are not using a predefined config you can just create a new config with your topology. I’m not even using a 800G cable since…
I think it’s not really worth it compared to just buying tokens or a coding plan. My setup has 4090 handling attention while TT accelerators handles MLP. With just a 4090 you can have CPU handle the MLP layers and use a…
The software stack is pretty immature, definitely very DIY. Their officially supported models are pretty old at this point, though there’s community support for gemma4, and models with GDN like qwen3.6 is supposedly…
Yeah that’s definitely the smarter buy if you want to just have models running quickly. But the cost of 2 p150 and a 4090 was <$5000 for me. The main issue is the immature software, and somewhat baroque way of writing…
80tp/s with 5080 3090 combo is wild. I’ve been working with a 4090 and two Tenstorrent p150 cards, and manage only about 30 tps utilizing all three for qwen3.6 27b q8. Guess I got more optimization to do. Would like to…
I think some people do like the collection mechanics. And some games require specific team comps in order to beat the harder content.
How do you determine that the model was reasoning in Chinese in layer X? I would think the middle layers do not map into any tokens.
The thing I always wondered regarding obsidian plugins is how they are able to offer them on iOS, given that iOS has rules against downloading code that alters functionality of the software.
Not necessarily. Servers serving the model likely has enough traffic that they are batching decodes already. MTP reduces latency and increase efficiency only when the server can’t batch enough concurrent streams to be…
Running the mxfp4 unsloth quant of qwen3.5-397b-a17b, I get 40 tps prefill, 20tps decode. AMD threadripper pro 9965WX, 256gb ddr5 5600, rtx 4090.
Funny, when I got tired of trying to find a nice desktop background I just started using a solid color of muted blue or green. I never read about this specific usage of colors before but I bet I saw something somewhere…
I tried fedora silverblue for a while, but the way it works is that it builds a new root fs image whenever you change the installed packages, this makes system package changes take comparatively long vs a traditional…
I think it’s not so much that the asyncio primitives got wrong about shared state, as much as is what the authors got wrong about the usage of those primitives. They are classic concurrency primitives that’s been around…
I noticed requests that were exploiting the vulnerability were turning into timeouts pretty much immediately after rolling out the patch. I’m surprised it took so long for it to be announced.
Is there a mypy plugin or other tool to check this via static analysis before runtime? To my knowledge jaxtyping can only be checked at runtime.
I’ve also done a noctua fan replacement on my ups. My worry is that they are rated for lower airflow than the original fans they replaced. Have you checked whether it stays cool when running on battery?
I had the same thought, and looked specifically for this in the paper. They do have a section where they talk about fine tuning with “cold” versions of the responses and comparing it with the fine tuned “warm” versions.…
One more: https://conifer.rhizome.org/ This one seems to be directly related to the webrecorder project which seems like a pretty full featured warc recorder.
But the author doesn’t give a single example, and so there’s nothing someone else can do to explain why or continue the conversation. The best we got use that he has a vague sense of unease, which I don’t think is very…
I think the facilities for building larger applications are lacking in APL. It would be great as something embedded into other languages. Consider something like numpy’s einsum, but using apl expressions instead. Use…
Yes, if it does archiving too that would be perfect.
Not sure, there was a lot of complaints when it rolled out because it was actually peer to peer syncing to other laptops which was causing bandwidth issues for people working on vpn, from planes etc. I’m not sure if it…
Hister sounds like something I wanted for a while, but never got around to building. Searching stuff I’ve seen before is most of what I do with a search engine, so having it local and fast would be amazing. Eager to…
At meta, there was a project for delivering binaries of internally built libraries / binaries to dev laptops using a private ipfs network. This was live for at least some period of time.
Surely you can express this in C++ just as you could in rust…
Yeah, I’m doing TP with two cards. The topology is configured based on yaml files, and if you are not using a predefined config you can just create a new config with your topology. I’m not even using a 800G cable since…
I think it’s not really worth it compared to just buying tokens or a coding plan. My setup has 4090 handling attention while TT accelerators handles MLP. With just a 4090 you can have CPU handle the MLP layers and use a…
The software stack is pretty immature, definitely very DIY. Their officially supported models are pretty old at this point, though there’s community support for gemma4, and models with GDN like qwen3.6 is supposedly…
Yeah that’s definitely the smarter buy if you want to just have models running quickly. But the cost of 2 p150 and a 4090 was <$5000 for me. The main issue is the immature software, and somewhat baroque way of writing…
80tp/s with 5080 3090 combo is wild. I’ve been working with a 4090 and two Tenstorrent p150 cards, and manage only about 30 tps utilizing all three for qwen3.6 27b q8. Guess I got more optimization to do. Would like to…
I think some people do like the collection mechanics. And some games require specific team comps in order to beat the harder content.
How do you determine that the model was reasoning in Chinese in layer X? I would think the middle layers do not map into any tokens.
The thing I always wondered regarding obsidian plugins is how they are able to offer them on iOS, given that iOS has rules against downloading code that alters functionality of the software.
Not necessarily. Servers serving the model likely has enough traffic that they are batching decodes already. MTP reduces latency and increase efficiency only when the server can’t batch enough concurrent streams to be…
Running the mxfp4 unsloth quant of qwen3.5-397b-a17b, I get 40 tps prefill, 20tps decode. AMD threadripper pro 9965WX, 256gb ddr5 5600, rtx 4090.
Funny, when I got tired of trying to find a nice desktop background I just started using a solid color of muted blue or green. I never read about this specific usage of colors before but I bet I saw something somewhere…
I tried fedora silverblue for a while, but the way it works is that it builds a new root fs image whenever you change the installed packages, this makes system package changes take comparatively long vs a traditional…
I think it’s not so much that the asyncio primitives got wrong about shared state, as much as is what the authors got wrong about the usage of those primitives. They are classic concurrency primitives that’s been around…
I noticed requests that were exploiting the vulnerability were turning into timeouts pretty much immediately after rolling out the patch. I’m surprised it took so long for it to be announced.
Is there a mypy plugin or other tool to check this via static analysis before runtime? To my knowledge jaxtyping can only be checked at runtime.
I’ve also done a noctua fan replacement on my ups. My worry is that they are rated for lower airflow than the original fans they replaced. Have you checked whether it stays cool when running on battery?
I had the same thought, and looked specifically for this in the paper. They do have a section where they talk about fine tuning with “cold” versions of the responses and comparing it with the fine tuned “warm” versions.…
One more: https://conifer.rhizome.org/ This one seems to be directly related to the webrecorder project which seems like a pretty full featured warc recorder.
But the author doesn’t give a single example, and so there’s nothing someone else can do to explain why or continue the conversation. The best we got use that he has a vague sense of unease, which I don’t think is very…
I think the facilities for building larger applications are lacking in APL. It would be great as something embedded into other languages. Consider something like numpy’s einsum, but using apl expressions instead. Use…