Well yes, there are only so many attention heads (well whatever magical variant frontier models are using these days) that can attend to the context and so as the context grows attention becomes spread thin. But with…
Interesting. I agree that it seems that LLMs are wont to fall into recognisable patterns much more readily than humans however I asked a model to evaluate your comment history and it found loads of patterns such as:…
For sure. If you write with a casual conversational tone people don't get triggered. But if you are eloquent and use an extended vocabulary thanks to large amounts of reading then that seems to make people think you're…
Ah right, thank you for clarifying. But I think my point still stands, isn't the geometry information THE information I referred to in the first place? Obviously the vector size gives you the granularity but it's kind…
Eh people don't care if something is true or false they care about the dopamine hit they get from engaging in tribal behaviours that reinforce their freaky belief systems that often aren't rooted in any kind of reality.…
I'm not as heavy on the maths stuff involved in this as other people commenting appear to be. But the idea makes sense, of course there is still recoverable data in embeddings, that's the point. Though as I constantly…
IANAL, especially not an American one. But if you're worried just pop it on anon GH. Besides the fact that this sort of protection through obfuscation is dead now anyway. If you can ask an LLM to do it so can I, or…
Tbf "is it a crime" is hard for even a single lawyer to answer because it depends on: who you are, your skin colour, how rich you are, your sex, whether it's a white collar crime or not, did you commit the crime on…
Talking to members of the opposite sex only? How narrow-minded. Cyberpunk/sci-fi often explores futures where sex/gender is less of an issue (especially Ian. Banks' works). Clearly we're not there yet.
So America thinks its above the ICC then? Explains a lot, lmao.
The Internet has magnified the "my church leader said that gay people are actually demons" effect. Or "if you throw salt over your shoulder you're protected" or "wolves have alphas of the pack". People don't fact check…
I don't think that that issue is inherent to women. I think it's inherent to everyone and we get affected on different levels in different contexts. Any man who's been told to "man up" (most) has experienced the same.
Given what I have seen in recent Hollywood "writing" I would not be surprised if when correctly prompted an LLM can outdo a lot of the disposable, predictable writing in modern shows. Every story boils down to the same…
I mean a lot of it comes down to: "Give me a poster for my band playing a gig" Versus "Give me a poster for my band playing a gig, it should have x y and z. Use a x' artistic style and include elements of y'. The layout…
Oh for sure, but I think generally multiple experts are selected in an MoE pass for a token, so presumably it'd select programming related ones as well as general knowledge/language. Only problem would be the routing…
I still personally think that a heavy lean into MoE will be better for that sort of thing. Our brains are subdivided into large parts but I'm sure (and I'm not a brain scientist) that those parts can be subdivided even…
Fast models is why I was hoping Taalas would get their butts into gear and eventually release a consumer priced card. I'd love to have a pcie card that screams along at 15k t/s even if on a heavily quantized 2026 level…
I have found this to some degree (even though I work with amazing people day to day). It's much easier for people to pump out absolute garbage, you know the kind of "just get it done fast" slop that management types cry…
It's fine. Even re-reading what I'd said it does seem a little extreme, but I still believe the core idea of it. I'm just watching violent criminals in UK get early release while the hapless government and public cannot…
Yeah, I always thought the future of this stuff would be hot-pluggable MoE modules or LORAs that are able to be downloaded and applied/used at will like how skills have become a thing. Like, atm most architectures seem…
When I lived in Auckland (now in the UK) I used to go to gigs at Whammy bar in St. Kevins arcade, the dive bar part is awesome and I think they stop people doing it now but when I was in uni the walls used to be covered…
Yes, also because I imagine people generally followed the dog damned rules there.
Yep, as a Kiwi living in UK I actually went back to NZ to redo my visa about December 2019, then that was all sorted and I returned about late Jan-early Feb 2020. I had a stopover in Bangkok and _everyone_ was wearing…
No, I'm saying it's only human to retroactively want to do extreme fantastical violence against people who have physically harmed you when you live in a society that a: does not care that you were hurt because you're a…
I would also like someone to clarify this for me. I (think) I understand what people mean by a neurosymbolic model however common definitions are a bit funky. If it's neuro (llm/transformer similar) symbolic (symbolic…
Well yes, there are only so many attention heads (well whatever magical variant frontier models are using these days) that can attend to the context and so as the context grows attention becomes spread thin. But with…
Interesting. I agree that it seems that LLMs are wont to fall into recognisable patterns much more readily than humans however I asked a model to evaluate your comment history and it found loads of patterns such as:…
For sure. If you write with a casual conversational tone people don't get triggered. But if you are eloquent and use an extended vocabulary thanks to large amounts of reading then that seems to make people think you're…
Ah right, thank you for clarifying. But I think my point still stands, isn't the geometry information THE information I referred to in the first place? Obviously the vector size gives you the granularity but it's kind…
Eh people don't care if something is true or false they care about the dopamine hit they get from engaging in tribal behaviours that reinforce their freaky belief systems that often aren't rooted in any kind of reality.…
I'm not as heavy on the maths stuff involved in this as other people commenting appear to be. But the idea makes sense, of course there is still recoverable data in embeddings, that's the point. Though as I constantly…
IANAL, especially not an American one. But if you're worried just pop it on anon GH. Besides the fact that this sort of protection through obfuscation is dead now anyway. If you can ask an LLM to do it so can I, or…
Tbf "is it a crime" is hard for even a single lawyer to answer because it depends on: who you are, your skin colour, how rich you are, your sex, whether it's a white collar crime or not, did you commit the crime on…
Talking to members of the opposite sex only? How narrow-minded. Cyberpunk/sci-fi often explores futures where sex/gender is less of an issue (especially Ian. Banks' works). Clearly we're not there yet.
So America thinks its above the ICC then? Explains a lot, lmao.
The Internet has magnified the "my church leader said that gay people are actually demons" effect. Or "if you throw salt over your shoulder you're protected" or "wolves have alphas of the pack". People don't fact check…
I don't think that that issue is inherent to women. I think it's inherent to everyone and we get affected on different levels in different contexts. Any man who's been told to "man up" (most) has experienced the same.
Given what I have seen in recent Hollywood "writing" I would not be surprised if when correctly prompted an LLM can outdo a lot of the disposable, predictable writing in modern shows. Every story boils down to the same…
I mean a lot of it comes down to: "Give me a poster for my band playing a gig" Versus "Give me a poster for my band playing a gig, it should have x y and z. Use a x' artistic style and include elements of y'. The layout…
Oh for sure, but I think generally multiple experts are selected in an MoE pass for a token, so presumably it'd select programming related ones as well as general knowledge/language. Only problem would be the routing…
I still personally think that a heavy lean into MoE will be better for that sort of thing. Our brains are subdivided into large parts but I'm sure (and I'm not a brain scientist) that those parts can be subdivided even…
Fast models is why I was hoping Taalas would get their butts into gear and eventually release a consumer priced card. I'd love to have a pcie card that screams along at 15k t/s even if on a heavily quantized 2026 level…
I have found this to some degree (even though I work with amazing people day to day). It's much easier for people to pump out absolute garbage, you know the kind of "just get it done fast" slop that management types cry…
It's fine. Even re-reading what I'd said it does seem a little extreme, but I still believe the core idea of it. I'm just watching violent criminals in UK get early release while the hapless government and public cannot…
Yeah, I always thought the future of this stuff would be hot-pluggable MoE modules or LORAs that are able to be downloaded and applied/used at will like how skills have become a thing. Like, atm most architectures seem…
When I lived in Auckland (now in the UK) I used to go to gigs at Whammy bar in St. Kevins arcade, the dive bar part is awesome and I think they stop people doing it now but when I was in uni the walls used to be covered…
Yes, also because I imagine people generally followed the dog damned rules there.
Yep, as a Kiwi living in UK I actually went back to NZ to redo my visa about December 2019, then that was all sorted and I returned about late Jan-early Feb 2020. I had a stopover in Bangkok and _everyone_ was wearing…
No, I'm saying it's only human to retroactively want to do extreme fantastical violence against people who have physically harmed you when you live in a society that a: does not care that you were hurt because you're a…
I would also like someone to clarify this for me. I (think) I understand what people mean by a neurosymbolic model however common definitions are a bit funky. If it's neuro (llm/transformer similar) symbolic (symbolic…