But there will be and his point is they cut off supply to make room for the new M5 ultra which I hope has 768GB or more of memory.
So reckless but needed.
It's easy to see why people fear AI when our leaders talk of a future where many are jobless and replaced with no solutions to fill in the gaps. AI adoption is a leadership failure more than a tech one right now. If you…
The irony here is the red Republican states are the ones voting for this who will be most impacted by it.
[dead]
Thoughts on a M5 Ultra 768GB if it drops? What's the price to make it worth it for you over a spark cluster? I'm wanting to run Kimi 2.6/2.7 GGUF on it and just slap it in the server rack, but trying to decide if a…
This is correct, they are subsidized but it's the training cost that costs the most with a majority of people hitting cache for most queries for inference.
Devs are hard to market and sell too I've heard. It's likely because they can build a lot of the stuff out there themselves when pressed. They have the most app exposure so are opinionated. It's why most devs take the…
Yeah the cost doesn't justify the value. Spending x3 on tokens is meaningless if they aren't seeing the profit side scale with it. Going faster on product features doesn't mean it translates to more money. In fact I'm…
That's exactly what I'm doing. Push for model flexibility, cost control, and reliability. The moat is to be anti lock in. The open source model needs to be amped up on steroids to avoid this permiating every facet of…
Exactly, it's far bigger than Meta when the government's are pushing a larger agenda here. The assumption is you have to control people to enforce laws. They keep pushing this notion that is a requirement to keep people…
I find it strange for these people to accept such a defeatist attitude because I'm the opposite. I mean I will just not use the service and I'll seek out alternatives that are open source or create my own. I'll do…
Illegal tariffs, executive usurping congress power of the purse, Noem funding herself and friends with a commercial from an unknown entity with tax payer money, people in ICE/FBI handing over undisclosed unaccounted…
This article would do better to show good use cases to draw strengths to their premise but I agree with your take that frames matter less than the total feel of the transition. Some of them definitely could be improved…
I've been wondering why they attack science outside of they think it is woke and liberal. It makes no sense to cut off the hand that saves you even as a rich billionaire who wants to control people in a fascist society.
I agree, leave the training to open source federations that roll out like operating systems. Minimal training over time. Then have inference go down to the next layer to use those models as a P2P decentralized network.…
It is definitely the fun part to me and scaling a factory is the challenge we all decide every day we write code. I think of AI agents as a factory unlock too. Anything of quality needs inspection, review, and so on…
We blocked YouTube recently in the household for all devices but one approved tv device that our kids are only able to watch with us. I let my oldest daughter at 10 watch stuff there a couple times a week which she…
Micron is building a factory near me but it's years out. The only hope here is China floods the market which would be a good or bad thing however you look at it.
I have found this to be the case as well. As developers we are just really good stewards of the code because we obviously have knowledge to make sure that the code is engineered in a way that it can scale and grow…
Eventually infrastructure will be more simple to orchestrate too without faults I suspect from well developed devops harnesses. The risk and scale companies are willing to accept will still fall on humans for some time…
Yes, exactly. Any engineer deep on this stuff right now understands that grounded predictive engine sprinkled with RL training and are discovering what that means in terms of its strengths and weaknesses for company use.
China is about to flood the market and prove this notion wrong. If there is demand they want to meet it with supply. But to your point, that is exactly how American companies like to play now. No one is stopping them…
Right more simply put it's great at being a copy cat, exploring similar data points that match your token needs. It is not great at decision making or judgment calls that don't have a well defined spec or plan in place…
Cleaning up tech debt is a must with AI for a lot of these orphaned utilities and anti patterns. My hope is eventually open source models get far enough along we just train the models on company specific code needs.…
But there will be and his point is they cut off supply to make room for the new M5 ultra which I hope has 768GB or more of memory.
So reckless but needed.
It's easy to see why people fear AI when our leaders talk of a future where many are jobless and replaced with no solutions to fill in the gaps. AI adoption is a leadership failure more than a tech one right now. If you…
The irony here is the red Republican states are the ones voting for this who will be most impacted by it.
[dead]
Thoughts on a M5 Ultra 768GB if it drops? What's the price to make it worth it for you over a spark cluster? I'm wanting to run Kimi 2.6/2.7 GGUF on it and just slap it in the server rack, but trying to decide if a…
This is correct, they are subsidized but it's the training cost that costs the most with a majority of people hitting cache for most queries for inference.
Devs are hard to market and sell too I've heard. It's likely because they can build a lot of the stuff out there themselves when pressed. They have the most app exposure so are opinionated. It's why most devs take the…
Yeah the cost doesn't justify the value. Spending x3 on tokens is meaningless if they aren't seeing the profit side scale with it. Going faster on product features doesn't mean it translates to more money. In fact I'm…
That's exactly what I'm doing. Push for model flexibility, cost control, and reliability. The moat is to be anti lock in. The open source model needs to be amped up on steroids to avoid this permiating every facet of…
Exactly, it's far bigger than Meta when the government's are pushing a larger agenda here. The assumption is you have to control people to enforce laws. They keep pushing this notion that is a requirement to keep people…
I find it strange for these people to accept such a defeatist attitude because I'm the opposite. I mean I will just not use the service and I'll seek out alternatives that are open source or create my own. I'll do…
Illegal tariffs, executive usurping congress power of the purse, Noem funding herself and friends with a commercial from an unknown entity with tax payer money, people in ICE/FBI handing over undisclosed unaccounted…
This article would do better to show good use cases to draw strengths to their premise but I agree with your take that frames matter less than the total feel of the transition. Some of them definitely could be improved…
I've been wondering why they attack science outside of they think it is woke and liberal. It makes no sense to cut off the hand that saves you even as a rich billionaire who wants to control people in a fascist society.
I agree, leave the training to open source federations that roll out like operating systems. Minimal training over time. Then have inference go down to the next layer to use those models as a P2P decentralized network.…
It is definitely the fun part to me and scaling a factory is the challenge we all decide every day we write code. I think of AI agents as a factory unlock too. Anything of quality needs inspection, review, and so on…
We blocked YouTube recently in the household for all devices but one approved tv device that our kids are only able to watch with us. I let my oldest daughter at 10 watch stuff there a couple times a week which she…
Micron is building a factory near me but it's years out. The only hope here is China floods the market which would be a good or bad thing however you look at it.
I have found this to be the case as well. As developers we are just really good stewards of the code because we obviously have knowledge to make sure that the code is engineered in a way that it can scale and grow…
Eventually infrastructure will be more simple to orchestrate too without faults I suspect from well developed devops harnesses. The risk and scale companies are willing to accept will still fall on humans for some time…
Yes, exactly. Any engineer deep on this stuff right now understands that grounded predictive engine sprinkled with RL training and are discovering what that means in terms of its strengths and weaknesses for company use.
China is about to flood the market and prove this notion wrong. If there is demand they want to meet it with supply. But to your point, that is exactly how American companies like to play now. No one is stopping them…
Right more simply put it's great at being a copy cat, exploring similar data points that match your token needs. It is not great at decision making or judgment calls that don't have a well defined spec or plan in place…
Cleaning up tech debt is a must with AI for a lot of these orphaned utilities and anti patterns. My hope is eventually open source models get far enough along we just train the models on company specific code needs.…