I stopped using Facebook back in 2021 when the majority of my feed was reshared political content with 20+ comments from my friends fighting about divisive social/political issues. It wasn't fun, and it wasn't fostering…
Is the RTL for the FPGA available to be tinkered with?
> Every corporate network to which I've connected worked just fine without it. Just because it appears to be working fine doesn't mean you are in control of it. Without hardware attestation, how do you know the machines…
If regular people can repurpose old hardware, so can shared providers, who can extract more value from the hardware and thus afford to pay more. In a constrained market, supply and demand favors folks who can most…
My point is that dram demand is mostly orthogonal to whether everyone is using open weight models or secret weight models. Heavy demand for local models (whether secret or open weight) will require even more aggregate…
If local models are good enough, doesn't that increase demand for DRAM as everyone buys DRAM for their poorly utilized local machines? Surely it is a more efficient use of DRAM to run inference on shared hardware with…
I wonder how good LLM agents are at reverse engineering FPGA bitstreams... I want a robust open-source ecosystem where anyone can take my hardware projects and modify them without needing to deal with licensing friction.
There isn't enough hardware in the world for everyone to run their own SoTA model. The only hope we have is if we work together to host these on shared infrastructure, benefiting from >50x economies scale due to…
That DRAM would get even more use if it was removed from these machines and placed into a shared pool :) I joke, but thanks to the brutal DRAM market there has been some movement in this direction lately...
My point is that it is WAY more efficient if we put the world's DRAM supply into a shared inference pool instead of stranding it in local machines where it won't have as high of batch size or utilization. The cost of…
I think folks in this thread are underestimating how expensive it is to serve a SoTA model at 100 tokens a second. In addition to the $500k in capital costs, you also have significant electricity costs. This stuff is…
Many small crates published by large, trustworthy projects are fine and preferable to one large crate that "does everything".
Good luck finding reasonably priced switches and low power PD ICs that support type 3 or type 4 PoE. Also, supporting those tiny pulses requires large capacitors to hold a charge in between pulses. That plus the…
PoE is lousy for sensors. The switch will cut the power if you draw less than 10mA (480 mW), so regardless of PHY efficiency (which is terrible compared to most RS-485, CAN, or even radio ICs), you are REQUIRED by the…
Even more interesting, the developer manual: https://discreetfx.com/documents/NewTekVideoToasterDeveloper... I remember using this thing when I was a kid, trying to figure out how all the switching effects worked, so…
I had the misfortune of writing a complicated WPF app from scratch circa 2010-2011. Performance using the WPF widgets was terrible compared to HTML/Javascript/Blink; we ended throwing away most of the WPF code other…
Most software uses 10x more memory than is necessary to solve the problem. In an ideal world, developers would stop building bloatware if their customers can't afford the DRAM.
You've got them mixed up with Blackstone.
Just donated $250; I'm trying to get in the habit of supporting the open source projects I use similarly to the cost of their proprietary competitors.
At the end of the day, I'm being paid to ensure that the code deployed to production meets a particular bar of quality. Regardless of whether I'm reviewing code or writing it, If I let a commit be merged, I have to be…
I upgraded to this exact CPU from a 200MHz pentium in the fall of 2000. Easily the largest jump in performance of any upgrade I've ever done.
Another impressive early HDTV example: https://youtu.be/eMefy5VK9TI - Toto, Montreaux, 1991
There are some reasonably affordable models like https://www.lcsc.com/product-detail/C5272996.html that are powerful enough for many tasks.
> Can’t offload everything into the compiler. It is already too slow. Speak for yourself. On embedded platforms I'd happily make my compiles twice as slow for 10% code size improvements.
When looking at the rv32imc emitted by the Rust compiler, it's clear that there would be a lot less code if the compiler could choose different registers than those defined in the ABI for the arguments of leaf…
I stopped using Facebook back in 2021 when the majority of my feed was reshared political content with 20+ comments from my friends fighting about divisive social/political issues. It wasn't fun, and it wasn't fostering…
Is the RTL for the FPGA available to be tinkered with?
> Every corporate network to which I've connected worked just fine without it. Just because it appears to be working fine doesn't mean you are in control of it. Without hardware attestation, how do you know the machines…
If regular people can repurpose old hardware, so can shared providers, who can extract more value from the hardware and thus afford to pay more. In a constrained market, supply and demand favors folks who can most…
My point is that dram demand is mostly orthogonal to whether everyone is using open weight models or secret weight models. Heavy demand for local models (whether secret or open weight) will require even more aggregate…
If local models are good enough, doesn't that increase demand for DRAM as everyone buys DRAM for their poorly utilized local machines? Surely it is a more efficient use of DRAM to run inference on shared hardware with…
I wonder how good LLM agents are at reverse engineering FPGA bitstreams... I want a robust open-source ecosystem where anyone can take my hardware projects and modify them without needing to deal with licensing friction.
There isn't enough hardware in the world for everyone to run their own SoTA model. The only hope we have is if we work together to host these on shared infrastructure, benefiting from >50x economies scale due to…
That DRAM would get even more use if it was removed from these machines and placed into a shared pool :) I joke, but thanks to the brutal DRAM market there has been some movement in this direction lately...
My point is that it is WAY more efficient if we put the world's DRAM supply into a shared inference pool instead of stranding it in local machines where it won't have as high of batch size or utilization. The cost of…
I think folks in this thread are underestimating how expensive it is to serve a SoTA model at 100 tokens a second. In addition to the $500k in capital costs, you also have significant electricity costs. This stuff is…
Many small crates published by large, trustworthy projects are fine and preferable to one large crate that "does everything".
Good luck finding reasonably priced switches and low power PD ICs that support type 3 or type 4 PoE. Also, supporting those tiny pulses requires large capacitors to hold a charge in between pulses. That plus the…
PoE is lousy for sensors. The switch will cut the power if you draw less than 10mA (480 mW), so regardless of PHY efficiency (which is terrible compared to most RS-485, CAN, or even radio ICs), you are REQUIRED by the…
Even more interesting, the developer manual: https://discreetfx.com/documents/NewTekVideoToasterDeveloper... I remember using this thing when I was a kid, trying to figure out how all the switching effects worked, so…
I had the misfortune of writing a complicated WPF app from scratch circa 2010-2011. Performance using the WPF widgets was terrible compared to HTML/Javascript/Blink; we ended throwing away most of the WPF code other…
Most software uses 10x more memory than is necessary to solve the problem. In an ideal world, developers would stop building bloatware if their customers can't afford the DRAM.
You've got them mixed up with Blackstone.
Just donated $250; I'm trying to get in the habit of supporting the open source projects I use similarly to the cost of their proprietary competitors.
At the end of the day, I'm being paid to ensure that the code deployed to production meets a particular bar of quality. Regardless of whether I'm reviewing code or writing it, If I let a commit be merged, I have to be…
I upgraded to this exact CPU from a 200MHz pentium in the fall of 2000. Easily the largest jump in performance of any upgrade I've ever done.
Another impressive early HDTV example: https://youtu.be/eMefy5VK9TI - Toto, Montreaux, 1991
There are some reasonably affordable models like https://www.lcsc.com/product-detail/C5272996.html that are powerful enough for many tasks.
> Can’t offload everything into the compiler. It is already too slow. Speak for yourself. On embedded platforms I'd happily make my compiles twice as slow for 10% code size improvements.
When looking at the rv32imc emitted by the Rust compiler, it's clear that there would be a lot less code if the compiler could choose different registers than those defined in the ABI for the arguments of leaf…