thats fair but I've heard these weight changes are slow and expensive. I might have missed it but how long does this take to run and how many tokens can I expect to burn?
My biggest fear I have software wise right now is that these agents we all run freely on our computers and servers can effectively become part of a bot net because of a bad prompt (yes it technically takes more than…
yes, any amount turns me away. I only trust the slop I generate because I know it's been reviewed.
Obvious note to other readers, don't put you API key into strange input boxes.
That's exactly why I switched to exclusively using local models 6 months ago and haven't looked back. It's a very different beast but it works.
Every time I see an LLM company release tools to compete with existing tool suites it feels like they're just proving we can all now build these quickly ourselves. At least a software engineer could. Build vs buy keeps…
I think there are many of us working on projects with LLMs that'll take months more to reach full production. These will feel very out of left field and we'll have another paradigm shift. I think the real momentum will…
You're right, but I find as a solo engineer it's still important to check the frontends I create on mobile
thats fair but I've heard these weight changes are slow and expensive. I might have missed it but how long does this take to run and how many tokens can I expect to burn?
My biggest fear I have software wise right now is that these agents we all run freely on our computers and servers can effectively become part of a bot net because of a bad prompt (yes it technically takes more than…
yes, any amount turns me away. I only trust the slop I generate because I know it's been reviewed.
Obvious note to other readers, don't put you API key into strange input boxes.
That's exactly why I switched to exclusively using local models 6 months ago and haven't looked back. It's a very different beast but it works.
Every time I see an LLM company release tools to compete with existing tool suites it feels like they're just proving we can all now build these quickly ourselves. At least a software engineer could. Build vs buy keeps…
I think there are many of us working on projects with LLMs that'll take months more to reach full production. These will feel very out of left field and we'll have another paradigm shift. I think the real momentum will…
You're right, but I find as a solo engineer it's still important to check the frontends I create on mobile