If you want to take it even further a fully virtualized Opnsense with Proxmox is amazing. Your router can float between cluster nodes and each VLAN becomes a virtual interface in the hypervisor. What still blows my mind…
Since you're releasing this under GPLv3 this is indeed open source. Having multiple license options does not affect this.
It's not a community per se but there's a lot of research and discussion going on directly in the llama.cpp repo (https://github.com/ggerganov/llama.cpp) if you're interested in the more technical side of things.
It certainly looks like it if you check their discussion board.
Likely it's hosted on the same infrastructure. The general recommendation is to host the status page on different provider so it's more likely to stay up.
It's not even source code, it's the fact that this just looks super sketchy in general. The website http://faction504.com/ listed just links directly to the Play Store page. There's no info on what Blackpage does or who…
The issue with AMD and AI is, as always, the software stack. Even if the hardware is great ROCM simply doesn't have industry traction and accessiblity.
If you ask me to make an account before I can see your content (even if it looks interesting) that's a turn off and I'll go somewhere else. Maybe have a button at the top that says "explore as guest" or something like…
I don't like the centralization of Cloudflare, but it's the only way I can host public web pages out of my homelab with a DSL connection. I would rather have a CDN than put my content on a VPS as the servers remain 100%…
If we look at this from a technical perspective, what is the cost of running such a service? Something like Facebook obviously costs a lot more to run, as it stores photos and video and also provides each user with an…
Yeah as a long-time user I was really hoping for that myself, or at least have some sort of compromise. Certainly not that trainwreck of an AMA.
Wouldn't that be Hetzner?
It's not easy to move a group to a new platform, and there's very little people using Lemmy currently. The thing about Reddit despite its flaws is that it allows access to many large communities with a single account.
OpenLLAMA will be released soon and it's 100% compatible with the original LLAMA. https://github.com/openlm-research/open_llama
The fact that this is commodity hardware makes ggml extremely impressive and puts the tech in the hands of everyone. I recently reported my experience running 7B llama.cpp on a 15 year old Core 2 Quad [1] - when that…
Likely you can use a Bluetooth keyboard and mouse with it.
It also doesn't have ECC as well which was a staple of the previous Mac Pro line.
I personally like the Adminforge instance https://teddit.adminforge.de. It's much quicker than the original teddit.net.
Theoretically the ARC should work with llama.cpp using OpenCL, but I haven't seen benchmarks or even a confirmation that it works.
I think the tinybox is meant to be a training/inference server meant for tinygrad and filled with those AMD cards. Very likely it will run Linux.
I learned from the start on lead-free RoHS solder (doing SMT work) and had zero issues with it. Honestly I've never tried leaded solder as I just use lead-free all the time, though I know people who swear by it.
This is the reason why I still stick with OpenVPN on TCP 443 for my selfhosted VPN. Yes performance suffers a bit but it works absolutely everywhere including behind campus/corp firewalls as no one blocks TCP 443. I've…
> “One kid kept opening up game sites” said one high school teacher who asked to stay anonymous, to protect the identities of their students. “I would wait for them to open one, add it to my list of blocked websites,…
What's the difference between Viogpu and the older Virgil3d?
Privacy and security is a big desire for the people running these lower-quality local models. These assistants are becoming more and more powerful and people want to use them for personal tasks. For instance someone…
If you want to take it even further a fully virtualized Opnsense with Proxmox is amazing. Your router can float between cluster nodes and each VLAN becomes a virtual interface in the hypervisor. What still blows my mind…
Since you're releasing this under GPLv3 this is indeed open source. Having multiple license options does not affect this.
It's not a community per se but there's a lot of research and discussion going on directly in the llama.cpp repo (https://github.com/ggerganov/llama.cpp) if you're interested in the more technical side of things.
It certainly looks like it if you check their discussion board.
Likely it's hosted on the same infrastructure. The general recommendation is to host the status page on different provider so it's more likely to stay up.
It's not even source code, it's the fact that this just looks super sketchy in general. The website http://faction504.com/ listed just links directly to the Play Store page. There's no info on what Blackpage does or who…
The issue with AMD and AI is, as always, the software stack. Even if the hardware is great ROCM simply doesn't have industry traction and accessiblity.
If you ask me to make an account before I can see your content (even if it looks interesting) that's a turn off and I'll go somewhere else. Maybe have a button at the top that says "explore as guest" or something like…
I don't like the centralization of Cloudflare, but it's the only way I can host public web pages out of my homelab with a DSL connection. I would rather have a CDN than put my content on a VPS as the servers remain 100%…
If we look at this from a technical perspective, what is the cost of running such a service? Something like Facebook obviously costs a lot more to run, as it stores photos and video and also provides each user with an…
Yeah as a long-time user I was really hoping for that myself, or at least have some sort of compromise. Certainly not that trainwreck of an AMA.
Wouldn't that be Hetzner?
It's not easy to move a group to a new platform, and there's very little people using Lemmy currently. The thing about Reddit despite its flaws is that it allows access to many large communities with a single account.
OpenLLAMA will be released soon and it's 100% compatible with the original LLAMA. https://github.com/openlm-research/open_llama
The fact that this is commodity hardware makes ggml extremely impressive and puts the tech in the hands of everyone. I recently reported my experience running 7B llama.cpp on a 15 year old Core 2 Quad [1] - when that…
Likely you can use a Bluetooth keyboard and mouse with it.
It also doesn't have ECC as well which was a staple of the previous Mac Pro line.
I personally like the Adminforge instance https://teddit.adminforge.de. It's much quicker than the original teddit.net.
Theoretically the ARC should work with llama.cpp using OpenCL, but I haven't seen benchmarks or even a confirmation that it works.
I think the tinybox is meant to be a training/inference server meant for tinygrad and filled with those AMD cards. Very likely it will run Linux.
I learned from the start on lead-free RoHS solder (doing SMT work) and had zero issues with it. Honestly I've never tried leaded solder as I just use lead-free all the time, though I know people who swear by it.
This is the reason why I still stick with OpenVPN on TCP 443 for my selfhosted VPN. Yes performance suffers a bit but it works absolutely everywhere including behind campus/corp firewalls as no one blocks TCP 443. I've…
> “One kid kept opening up game sites” said one high school teacher who asked to stay anonymous, to protect the identities of their students. “I would wait for them to open one, add it to my list of blocked websites,…
What's the difference between Viogpu and the older Virgil3d?
Privacy and security is a big desire for the people running these lower-quality local models. These assistants are becoming more and more powerful and people want to use them for personal tasks. For instance someone…