I read another post oddly similar earlier today that has more explicit data on that authors codebase: https://codepointer.substack.com/p/cutting-llm-token-costs-w... TLDR; ~3-4% savings to actual API costs with rtk,…
Not the person you asked, but I have a 9700 which has the same VRAM, and running Q6 on it with unquantized kv gives me 50k context. Putting -ctv q8_0 ups that to 70k. I normally run Q4 with unquantized kv @ 130k at 50…
I run qwen 27B:Q4 @ 130k context at 50 t/s on a single R9700, and have a 7900XT that runs mellum 12B:Q8 as its subagent. R9700s do really well at low wattage and underclocking as well. It's designed to run at 300W, mine…
I thought the same thing when I started using locals, but the reality is that - for a given context depth - the token generation speed doesn't change whether it's 128 or 8000, it just lengthens the benchmark run time.
I suspect this is it. I'm 40, and the only tech person in my social circle. Many of my friends were all excited about using it for things like basic webdev and home networking. One shotting that type of stuff is very…
Or write your own custom one with the library that backs it: https://github.com/FluidInference/FluidAudio I did that so that I could record my own inputs and finetune parakeet to make it accurate enough to skip…
When I worked remote, I found I worked more hours than the days I went into the office and spent 40 minutes each day commuting. It's a lot harder to walk away from work when it is embedded in your home life. I actually…
For me, I still have no idea what the visual of a venn diagram is trying to tell me within the context of SQL. Just having a visual that I can't even understand does nothing to benefit the situation either.
Employee Resource Group, I assume.
A few scattered thoughts: Much of this article seems to only apply under the assumption that people didn't have hobbies prior to being a working adult. Most people I know have hobbies, but those hobbies were developed…
Congrats, that's 3 years in jail†. Enjoy your time! †I am not a lawyer. This is not legal advice.
I'm not sure of any precedent, but the disclaimer isn't just a "don't hold me to it" liability insurance. There are certain certifications required related to various types of products and recommendations (primarily…
> How many right-of-center professors did you have? Nearly all of them, having majored in Economics.
It's part of the Trump Effect: https://i.imgur.com/17PHH1d.png
> so as you can imagine, a birth certificate isn't enough. it wasn't even enough for me to get a job in a sanctuary city. I had to show a passport. I can't imagine this at all. I've never needed a birth certificate for…
Except if the significant other is part of the business. Family businesses tend to not care much for (or are oblivious to) employees' outside lives, since their work/life is already one and the same.
> seems pretty common to me. > From my experience > the general population. I've already qualified my comment, and both of us were discussing personal experiences. If you'd prefer to discuss the general population…
From my experience, this is incredibly uncommon in the northeast. I only know one couple like that in NY, and she has a large enough trust fund that neither one of them really needs to work at all. Every other couple…
Not OP, but I worked in finance as an trader for more than half a decade. I make more per hour once I switched to software development in NYC. I think people have a strange view of finance. Most people aren't paid…
It's not a distinct page for me, but instead an accordion section. I had to go to: https://www.facebook.com/ads/preferences And then open Your Information > Your Categories. I assume this is what they are talking about.
I'm curious what you'd be looking for in time spent. It seems to me that it's just a true or false. I personally did it intermittently while I was gaming on my other monitor. If anything, I'd say adding a confidence…
That's the beauty of having a completely unique Firstname Lastname. The downside is that my entire life is easily accessible on the interwebs. My high school baseball scores from 15 years ago are on the third page of…
This is already a law. Polyp removal is included in the cost of a screening colonoscopy as per the ACA. It's only not included if the patient decides they want to do it at a different time.
> but it also costs a fair amount It doesn't cost anything more than the colonoscopy. It's required by the ACA to be included in a colonoscopy.
Not everything is a conspiracy. Colon and rectal cancers have increased 51% among adults under age 50 since 1994, the cancer society said. That isn't a white paper. > If you make most of your money off removing polyps…
I read another post oddly similar earlier today that has more explicit data on that authors codebase: https://codepointer.substack.com/p/cutting-llm-token-costs-w... TLDR; ~3-4% savings to actual API costs with rtk,…
Not the person you asked, but I have a 9700 which has the same VRAM, and running Q6 on it with unquantized kv gives me 50k context. Putting -ctv q8_0 ups that to 70k. I normally run Q4 with unquantized kv @ 130k at 50…
I run qwen 27B:Q4 @ 130k context at 50 t/s on a single R9700, and have a 7900XT that runs mellum 12B:Q8 as its subagent. R9700s do really well at low wattage and underclocking as well. It's designed to run at 300W, mine…
I thought the same thing when I started using locals, but the reality is that - for a given context depth - the token generation speed doesn't change whether it's 128 or 8000, it just lengthens the benchmark run time.
I suspect this is it. I'm 40, and the only tech person in my social circle. Many of my friends were all excited about using it for things like basic webdev and home networking. One shotting that type of stuff is very…
Or write your own custom one with the library that backs it: https://github.com/FluidInference/FluidAudio I did that so that I could record my own inputs and finetune parakeet to make it accurate enough to skip…
When I worked remote, I found I worked more hours than the days I went into the office and spent 40 minutes each day commuting. It's a lot harder to walk away from work when it is embedded in your home life. I actually…
For me, I still have no idea what the visual of a venn diagram is trying to tell me within the context of SQL. Just having a visual that I can't even understand does nothing to benefit the situation either.
Employee Resource Group, I assume.
A few scattered thoughts: Much of this article seems to only apply under the assumption that people didn't have hobbies prior to being a working adult. Most people I know have hobbies, but those hobbies were developed…
Congrats, that's 3 years in jail†. Enjoy your time! †I am not a lawyer. This is not legal advice.
I'm not sure of any precedent, but the disclaimer isn't just a "don't hold me to it" liability insurance. There are certain certifications required related to various types of products and recommendations (primarily…
> How many right-of-center professors did you have? Nearly all of them, having majored in Economics.
It's part of the Trump Effect: https://i.imgur.com/17PHH1d.png
> so as you can imagine, a birth certificate isn't enough. it wasn't even enough for me to get a job in a sanctuary city. I had to show a passport. I can't imagine this at all. I've never needed a birth certificate for…
Except if the significant other is part of the business. Family businesses tend to not care much for (or are oblivious to) employees' outside lives, since their work/life is already one and the same.
> seems pretty common to me. > From my experience > the general population. I've already qualified my comment, and both of us were discussing personal experiences. If you'd prefer to discuss the general population…
From my experience, this is incredibly uncommon in the northeast. I only know one couple like that in NY, and she has a large enough trust fund that neither one of them really needs to work at all. Every other couple…
Not OP, but I worked in finance as an trader for more than half a decade. I make more per hour once I switched to software development in NYC. I think people have a strange view of finance. Most people aren't paid…
It's not a distinct page for me, but instead an accordion section. I had to go to: https://www.facebook.com/ads/preferences And then open Your Information > Your Categories. I assume this is what they are talking about.
I'm curious what you'd be looking for in time spent. It seems to me that it's just a true or false. I personally did it intermittently while I was gaming on my other monitor. If anything, I'd say adding a confidence…
That's the beauty of having a completely unique Firstname Lastname. The downside is that my entire life is easily accessible on the interwebs. My high school baseball scores from 15 years ago are on the third page of…
This is already a law. Polyp removal is included in the cost of a screening colonoscopy as per the ACA. It's only not included if the patient decides they want to do it at a different time.
> but it also costs a fair amount It doesn't cost anything more than the colonoscopy. It's required by the ACA to be included in a colonoscopy.
Not everything is a conspiracy. Colon and rectal cancers have increased 51% among adults under age 50 since 1994, the cancer society said. That isn't a white paper. > If you make most of your money off removing polyps…