Maybe Enron eh?
Seeing as it adds a second PSU, I'm guessing the workstation one.
No, I'd have to guess that new model releases have either new from scratch or continued pre-training. This is not the same as continual learning. Starting a new pre-training session is a dramatically different affair…
I disagree about your last statement. That only covers the initial creation/generation phase. It ignores the engineering aspect of maintaining that design through the entire lifecycle of the product. How do you evolve…
Alright let's assume your premise is true, that transformers can learn from interaction with the world by updating their weights - then why isn't this done? Because backprop fundamentally wants the entire data set in…
So you enjoy reviewing your entire code base and relying on an extremely detailed regression suite just to make simple changes? I don't think AI changes good engineering at all, it just changes who or what is doing it.
I was not saying that they are deterministic, rather that the distributions (aka weights) are fixed. A model as deployed today at anthropic/open ai/etc is not learning beyond the context as far as I know. What prevents…
It's a little different than that. Your bundle of nerves and meat is not static. It changes over time. To me the heart of the "next token predictor" is that the distributions are static. You can manipulate what you feed…
Do you use an operating system? What about databases? Or the myriad of other software used which we build upon. I can't imagine a professional coding context where we don't outsource intelligence to some degree, if not…
Are you a member of a team? Then you are the outsourced intelligence. Your manager is not writing everything by hand, they are outsourcing it to you. Just understand that may change (I mean I am already mentally…
So you spent the cost of my entire cluster in one day on Sol tokens lol. I have no need for that many tokens, a few million a day is perfectly acceptable. But if you do, then yeah Sol is probably your bet. Have fun :)
My DGX spark cluster is humming along.
I mean it's entirely a personal decision. I didn't mean to come across judgemental, if anyone uses the frontier models I don't hold it against them. But for me personally I am very against the frontier labs in general.…
Not everything is about pure cost. Maybe I don't want to sell my soul supporting the frontier labs because they are straight up pure evil?
Remember when big co used to just donate to open source projects to help them out instead of acquiring/dominating them?
That is amusing because to me one of the largest abominations about mac is the keyboard layout and mappings. It's terrible for anyone with decent sized hands to accomplish anything of even medium complexity.
I am not the parent but I took it as them saying the premise was wrong to begin with, which I very much agree with. Learning should not be primarily directed by job availability.
Isn't that basically Jax? Numpy on the GPU?
All of my code repos are on gitea (personal and professional). The instance is not exposed to the internet (wireguard access). It's fantastic honestly, simple and just works.
Not the parent, but here is one location that has rates in that range in the U.S. https://casscountyelectric.com/rates
These posts seem more like emotional therapy for the founder, helping them cope. It's not about the people being let go at all.
No you don't. I use the same passkeys for all my devices sync'd with bitwarden.
It's simple, the 395+ Max Strix Halo you bought for $1800 is now a ~$4000 build (at least the AMD AI dev unit). If only we had time travel right? Either way, the Nvidia unit comes with Connect-X 7. That may or may not…
The baseline is the market average, not 0.
I mean I pay for a domain for my homelab. No one else uses it.
Maybe Enron eh?
Seeing as it adds a second PSU, I'm guessing the workstation one.
No, I'd have to guess that new model releases have either new from scratch or continued pre-training. This is not the same as continual learning. Starting a new pre-training session is a dramatically different affair…
I disagree about your last statement. That only covers the initial creation/generation phase. It ignores the engineering aspect of maintaining that design through the entire lifecycle of the product. How do you evolve…
Alright let's assume your premise is true, that transformers can learn from interaction with the world by updating their weights - then why isn't this done? Because backprop fundamentally wants the entire data set in…
So you enjoy reviewing your entire code base and relying on an extremely detailed regression suite just to make simple changes? I don't think AI changes good engineering at all, it just changes who or what is doing it.
I was not saying that they are deterministic, rather that the distributions (aka weights) are fixed. A model as deployed today at anthropic/open ai/etc is not learning beyond the context as far as I know. What prevents…
It's a little different than that. Your bundle of nerves and meat is not static. It changes over time. To me the heart of the "next token predictor" is that the distributions are static. You can manipulate what you feed…
Do you use an operating system? What about databases? Or the myriad of other software used which we build upon. I can't imagine a professional coding context where we don't outsource intelligence to some degree, if not…
Are you a member of a team? Then you are the outsourced intelligence. Your manager is not writing everything by hand, they are outsourcing it to you. Just understand that may change (I mean I am already mentally…
So you spent the cost of my entire cluster in one day on Sol tokens lol. I have no need for that many tokens, a few million a day is perfectly acceptable. But if you do, then yeah Sol is probably your bet. Have fun :)
My DGX spark cluster is humming along.
I mean it's entirely a personal decision. I didn't mean to come across judgemental, if anyone uses the frontier models I don't hold it against them. But for me personally I am very against the frontier labs in general.…
Not everything is about pure cost. Maybe I don't want to sell my soul supporting the frontier labs because they are straight up pure evil?
Remember when big co used to just donate to open source projects to help them out instead of acquiring/dominating them?
That is amusing because to me one of the largest abominations about mac is the keyboard layout and mappings. It's terrible for anyone with decent sized hands to accomplish anything of even medium complexity.
I am not the parent but I took it as them saying the premise was wrong to begin with, which I very much agree with. Learning should not be primarily directed by job availability.
Isn't that basically Jax? Numpy on the GPU?
All of my code repos are on gitea (personal and professional). The instance is not exposed to the internet (wireguard access). It's fantastic honestly, simple and just works.
Not the parent, but here is one location that has rates in that range in the U.S. https://casscountyelectric.com/rates
These posts seem more like emotional therapy for the founder, helping them cope. It's not about the people being let go at all.
No you don't. I use the same passkeys for all my devices sync'd with bitwarden.
It's simple, the 395+ Max Strix Halo you bought for $1800 is now a ~$4000 build (at least the AMD AI dev unit). If only we had time travel right? Either way, the Nvidia unit comes with Connect-X 7. That may or may not…
The baseline is the market average, not 0.
I mean I pay for a domain for my homelab. No one else uses it.