In a sense it's a clean reminder that all these, especially non-local, llm tools should NEVER run outside a container. I'm currently looking at z-jail specifically for these scenarios; VMs are too heavy & expose too…
Yeah, it works though, and the content is genuine enough which I guess trumps the issue with the title for me ;)
OK, I appreciate your excitement and the work you've done here. Also; when presenting a benchmark it -needs- to be done as a comparative measure, i.e. how are those numbers on a vanilla 9b, let alone decent quant of…
Honestly think a lot of this article is ai babble - check how it ends on several classic ai negative triples such as "you’ll pay both bills on it just the same — plus you’ll comprehend it less, because you didn’t write…
Brexit promised a solution just like loads of solutions had been promised within the EU framework prior to it - all these "solutions" were akin in that they were all promised (from left and right within the political…
I do find it fascinating how blatantly people lie about things, the article mentions "Organic farming uses 84% more land for the same yield, but yields are 55% lower by area than conventional." yes, and that is the…
This is a a worthy legal gofundme if I ever saw one!
"... the city for $10, the city sold it, and when the family went to court their suit was dismissed."
By pointing out the exact things that will likely happen you are oddly enough hedging against (at least some of them) happening! A) I reckon it's true that smaller models will continue to improve massively through…
Yes, it worth aiming for common sense as a bare minimum, chaos and entropy only grows when things we don't understand are casually derided/attacked.
Worse in my opinion since the look is simply Tesla (whether one likes that or not), no one would have blinked an eyelid if Tesla released this car whereas Ferrari doing so comes off incoherent.
Excellent practical guide and pictures, if OP is around on this thread: well done! Your future self is going to appreciative too when this needs repeating at some point!
Gotta admit this was the first thing I thought of as well. Hard to focus on the code implementation with that in mind!
These days it's for sure the dev environment that is lacking, hardware is okay (potentially great?!), software abysmal. To run a local llm in a stable manner implies using Vulkan.. any attempt at ROCm is totally…
It's sad that they have gone political whereas their goal should, in my optics, be almost technocratically in favour of their own stated goals of "protecting user privacy from government/corporate surveillance,…
I do find the down votes odd, comment seem to contribute to the discussion, is it a reflex move because of intense dislike of the sitting US president?
Having your stuff stored in another country is ultimately a voucher of confidence, I can't see Trump or anyone else willingly misusing that trust. I do think the Western leaders need to temper their tendencies for…
But then there's this: "When evaluating the complete bun install improvements, it came out speed-wise to about the same as the existing git usage (due to networking being the big bottleneck time-wise despite more cases…
Yep. that's the route I tried before, no good, maybe it's just that the documentation is past it's sell by date, maybe it's lack of community use.. I'm just not seeing it. Even the article itself describes how to make…
With this exact point in mind: I've recently written a pretty straight forward win32 c implementation of a utility with some context dependent window interactions and a tray icon to help monitor and facility reload of…
This point stands to be underlined! Even the least possible friction is more than people at large are willing to deal with, it's only if the system changes are pushed from the top (rumblings in the EU block at the mo)…
How far are we from having ffmpeg make automatic rotoscope versions of our videos?!
It always had worked like that and it has always been a 100% nonintuitive and peculiar way to deal with this operation
But surely the point is that the proxy key is for your local network, it ain't got no value on the interwebz.
I abandoned MacOS back in 2018 since I found it too quirky and poweruser-unfriendly (the main thing that comes to mind is neatly indicated by todays other MacOS related frontpage article on resizing). Now we can add…
In a sense it's a clean reminder that all these, especially non-local, llm tools should NEVER run outside a container. I'm currently looking at z-jail specifically for these scenarios; VMs are too heavy & expose too…
Yeah, it works though, and the content is genuine enough which I guess trumps the issue with the title for me ;)
OK, I appreciate your excitement and the work you've done here. Also; when presenting a benchmark it -needs- to be done as a comparative measure, i.e. how are those numbers on a vanilla 9b, let alone decent quant of…
Honestly think a lot of this article is ai babble - check how it ends on several classic ai negative triples such as "you’ll pay both bills on it just the same — plus you’ll comprehend it less, because you didn’t write…
Brexit promised a solution just like loads of solutions had been promised within the EU framework prior to it - all these "solutions" were akin in that they were all promised (from left and right within the political…
I do find it fascinating how blatantly people lie about things, the article mentions "Organic farming uses 84% more land for the same yield, but yields are 55% lower by area than conventional." yes, and that is the…
This is a a worthy legal gofundme if I ever saw one!
"... the city for $10, the city sold it, and when the family went to court their suit was dismissed."
By pointing out the exact things that will likely happen you are oddly enough hedging against (at least some of them) happening! A) I reckon it's true that smaller models will continue to improve massively through…
Yes, it worth aiming for common sense as a bare minimum, chaos and entropy only grows when things we don't understand are casually derided/attacked.
Worse in my opinion since the look is simply Tesla (whether one likes that or not), no one would have blinked an eyelid if Tesla released this car whereas Ferrari doing so comes off incoherent.
Excellent practical guide and pictures, if OP is around on this thread: well done! Your future self is going to appreciative too when this needs repeating at some point!
Gotta admit this was the first thing I thought of as well. Hard to focus on the code implementation with that in mind!
These days it's for sure the dev environment that is lacking, hardware is okay (potentially great?!), software abysmal. To run a local llm in a stable manner implies using Vulkan.. any attempt at ROCm is totally…
It's sad that they have gone political whereas their goal should, in my optics, be almost technocratically in favour of their own stated goals of "protecting user privacy from government/corporate surveillance,…
I do find the down votes odd, comment seem to contribute to the discussion, is it a reflex move because of intense dislike of the sitting US president?
Having your stuff stored in another country is ultimately a voucher of confidence, I can't see Trump or anyone else willingly misusing that trust. I do think the Western leaders need to temper their tendencies for…
But then there's this: "When evaluating the complete bun install improvements, it came out speed-wise to about the same as the existing git usage (due to networking being the big bottleneck time-wise despite more cases…
Yep. that's the route I tried before, no good, maybe it's just that the documentation is past it's sell by date, maybe it's lack of community use.. I'm just not seeing it. Even the article itself describes how to make…
With this exact point in mind: I've recently written a pretty straight forward win32 c implementation of a utility with some context dependent window interactions and a tray icon to help monitor and facility reload of…
This point stands to be underlined! Even the least possible friction is more than people at large are willing to deal with, it's only if the system changes are pushed from the top (rumblings in the EU block at the mo)…
How far are we from having ffmpeg make automatic rotoscope versions of our videos?!
It always had worked like that and it has always been a 100% nonintuitive and peculiar way to deal with this operation
But surely the point is that the proxy key is for your local network, it ain't got no value on the interwebz.
I abandoned MacOS back in 2018 since I found it too quirky and poweruser-unfriendly (the main thing that comes to mind is neatly indicated by todays other MacOS related frontpage article on resizing). Now we can add…