Are you saying it's hard to edit a docker compose file? Being one service or 5 doesn't really make things more complex. I often point servers at my own postgres container instead of spinning up an extra one (so just…
In my experience I can heavily influence this based on the prompt.
But why? On reason is that implementation was a bottleneck. That made it expensive to change a system once it was entirely implemented. It was better to get the feedback sooner so you didn't waste time implementing the…
Why do those working at frontier labs deserve charity?
Yeah I have no problems letting family and friends use cloud services. I keep the self hosted stuff for myself.
This isn't about cost. If these projects, like bitwarden were run at cost the price would be negligible. Instead you see software companies with like 80% margins (or even higher). Not to mention that if the price was…
I'm confused, so you are self hosting it for other people?
What natural forces in the cloud services market do you see pulling it in that direction?
AI needs to be open weights at a minimum, but ideally open source. I'm not terribly worried as it is strictly inevitable. But having these companies steal work from humanity and use it to train their models while…
It took me 10 minutes to figure that out, and I have been in tech for 30 years :) I'm probably just dense but it's not a good sign.
This sounds like that bitter old engineer that is unable to learn and adapt as things change, the kind that gives all of us more senior folks a bad stigma. Times are changing, adapt and grow.
I understand that. But I am specifically questioning if it was used to actually commit a war crime which is what the school attack was identified as by the U.N.
Since it's in quotes is that what was actually reported in the article? Or are you stating a hypothetical? Because if the school strike was actually AI led that is a big deal.
For me personally the snark isn't because their SRE team is incompotent. It's because software that tries to be everything to everyone is inherently terrible. It's not fun to use for the users, and so many compromises…
I've played quite a few hours of Blizzard games throughout the years and as much as I loved the starcraft universe RTS is just not approachable for me. So I can vouch as one person who is really excited to get a taste…
Maybe Enron eh?
Seeing as it adds a second PSU, I'm guessing the workstation one.
No, I'd have to guess that new model releases have either new from scratch or continued pre-training. This is not the same as continual learning. Starting a new pre-training session is a dramatically different affair…
I disagree about your last statement. That only covers the initial creation/generation phase. It ignores the engineering aspect of maintaining that design through the entire lifecycle of the product. How do you evolve…
Alright let's assume your premise is true, that transformers can learn from interaction with the world by updating their weights - then why isn't this done? Because backprop fundamentally wants the entire data set in…
So you enjoy reviewing your entire code base and relying on an extremely detailed regression suite just to make simple changes? I don't think AI changes good engineering at all, it just changes who or what is doing it.
I was not saying that they are deterministic, rather that the distributions (aka weights) are fixed. A model as deployed today at anthropic/open ai/etc is not learning beyond the context as far as I know. What prevents…
It's a little different than that. Your bundle of nerves and meat is not static. It changes over time. To me the heart of the "next token predictor" is that the distributions are static. You can manipulate what you feed…
Do you use an operating system? What about databases? Or the myriad of other software used which we build upon. I can't imagine a professional coding context where we don't outsource intelligence to some degree, if not…
Are you a member of a team? Then you are the outsourced intelligence. Your manager is not writing everything by hand, they are outsourcing it to you. Just understand that may change (I mean I am already mentally…
Are you saying it's hard to edit a docker compose file? Being one service or 5 doesn't really make things more complex. I often point servers at my own postgres container instead of spinning up an extra one (so just…
In my experience I can heavily influence this based on the prompt.
But why? On reason is that implementation was a bottleneck. That made it expensive to change a system once it was entirely implemented. It was better to get the feedback sooner so you didn't waste time implementing the…
Why do those working at frontier labs deserve charity?
Yeah I have no problems letting family and friends use cloud services. I keep the self hosted stuff for myself.
This isn't about cost. If these projects, like bitwarden were run at cost the price would be negligible. Instead you see software companies with like 80% margins (or even higher). Not to mention that if the price was…
I'm confused, so you are self hosting it for other people?
What natural forces in the cloud services market do you see pulling it in that direction?
AI needs to be open weights at a minimum, but ideally open source. I'm not terribly worried as it is strictly inevitable. But having these companies steal work from humanity and use it to train their models while…
It took me 10 minutes to figure that out, and I have been in tech for 30 years :) I'm probably just dense but it's not a good sign.
This sounds like that bitter old engineer that is unable to learn and adapt as things change, the kind that gives all of us more senior folks a bad stigma. Times are changing, adapt and grow.
I understand that. But I am specifically questioning if it was used to actually commit a war crime which is what the school attack was identified as by the U.N.
Since it's in quotes is that what was actually reported in the article? Or are you stating a hypothetical? Because if the school strike was actually AI led that is a big deal.
For me personally the snark isn't because their SRE team is incompotent. It's because software that tries to be everything to everyone is inherently terrible. It's not fun to use for the users, and so many compromises…
I've played quite a few hours of Blizzard games throughout the years and as much as I loved the starcraft universe RTS is just not approachable for me. So I can vouch as one person who is really excited to get a taste…
Maybe Enron eh?
Seeing as it adds a second PSU, I'm guessing the workstation one.
No, I'd have to guess that new model releases have either new from scratch or continued pre-training. This is not the same as continual learning. Starting a new pre-training session is a dramatically different affair…
I disagree about your last statement. That only covers the initial creation/generation phase. It ignores the engineering aspect of maintaining that design through the entire lifecycle of the product. How do you evolve…
Alright let's assume your premise is true, that transformers can learn from interaction with the world by updating their weights - then why isn't this done? Because backprop fundamentally wants the entire data set in…
So you enjoy reviewing your entire code base and relying on an extremely detailed regression suite just to make simple changes? I don't think AI changes good engineering at all, it just changes who or what is doing it.
I was not saying that they are deterministic, rather that the distributions (aka weights) are fixed. A model as deployed today at anthropic/open ai/etc is not learning beyond the context as far as I know. What prevents…
It's a little different than that. Your bundle of nerves and meat is not static. It changes over time. To me the heart of the "next token predictor" is that the distributions are static. You can manipulate what you feed…
Do you use an operating system? What about databases? Or the myriad of other software used which we build upon. I can't imagine a professional coding context where we don't outsource intelligence to some degree, if not…
Are you a member of a team? Then you are the outsourced intelligence. Your manager is not writing everything by hand, they are outsourcing it to you. Just understand that may change (I mean I am already mentally…