Yeh it’s strange it includes cockney so prominently. It isn’t really very present unless you spend time around the various gentlemen frequenting sports pubs and pie and mash shops in east London, or if you take a black…
It’s remarkable we’ve hit a threshold where so much can be done with synthetic data. The reasoning race seems an utterly solvable problem now (thanks mostly to the verifiability of results). I guess the challenge then…
IMO first-or-not is moot. It’s estimated that around one billion people speak English to a reasonably fluent level. Included in that is many of the commonwealth countries in which English often holds second spot as a…
Perplexity is listed, but do they actually abide by llms.txt? And how can we prove they do? Is it all good faith? I wish there were a better way.
The general message here seems to be that inference-time brute-forcing works as long as you have a good search and evaluation strategy. We’ve seemingly hit a ceiling on the base LLM forward-pass capability so any…
Curious: what kind of problem domain to you work on? I use LLMs every day on pretty hard problems and they are always net positive. But I imagine they’re not well trained on material related to your work if you don’t…
It is probably the most reliable yeh, tho spending time here I’ve grown increasingly aware that the great firewall is more than aware of this vpn traffic, even if it’s wrapped up to look like normal traffic. They…
Don’t know what OP might suggest but my first take is: never allow unstructured output from one LLM (or random human) of N privilege as input to another of >N privilege. Eg, use typed tool/function calling abstractions…
Ah apologies I misread the architecture. But it does fit the spirit of finding disproportionately higher performance in smaller networks. Still promises of finding smaller sub networks. Running on mediocre mobile…
Cool! Seems we’re moving closer and closer to realizing the Lottery Ticket Hypothesis https://arxiv.org/abs/1803.03635
Ie. A form of perverse incentive or the cobra effect. Endemic to capitalism, especially in infrastructure.
You can use HuggingFace, PerplexityAI, Anyscale, TogetherAI. There are a bunch of options. Many offer OpenAI compatible APIs too.
What I’d love to see is a rundown of new efficiencies in generative AI. With things like quantization and specialized transformer hardware, the costs will hopefully be less shocking in the future. And fwiw, I don’t find…
I would say actually in the vast majority of cases of accessibility interventions, it benefits everyone. Everyone is, at various points in their lives, a varying degree of disabled (defined in terms of functional…
Indeed. I’ve heard first hand accounts that would make it impossible for me to trust him. He’s very good at the game. But I’d not want to touch him with a barge pole.
Yeh it’s strange it includes cockney so prominently. It isn’t really very present unless you spend time around the various gentlemen frequenting sports pubs and pie and mash shops in east London, or if you take a black…
It’s remarkable we’ve hit a threshold where so much can be done with synthetic data. The reasoning race seems an utterly solvable problem now (thanks mostly to the verifiability of results). I guess the challenge then…
IMO first-or-not is moot. It’s estimated that around one billion people speak English to a reasonably fluent level. Included in that is many of the commonwealth countries in which English often holds second spot as a…
Perplexity is listed, but do they actually abide by llms.txt? And how can we prove they do? Is it all good faith? I wish there were a better way.
The general message here seems to be that inference-time brute-forcing works as long as you have a good search and evaluation strategy. We’ve seemingly hit a ceiling on the base LLM forward-pass capability so any…
Curious: what kind of problem domain to you work on? I use LLMs every day on pretty hard problems and they are always net positive. But I imagine they’re not well trained on material related to your work if you don’t…
It is probably the most reliable yeh, tho spending time here I’ve grown increasingly aware that the great firewall is more than aware of this vpn traffic, even if it’s wrapped up to look like normal traffic. They…
Don’t know what OP might suggest but my first take is: never allow unstructured output from one LLM (or random human) of N privilege as input to another of >N privilege. Eg, use typed tool/function calling abstractions…
Ah apologies I misread the architecture. But it does fit the spirit of finding disproportionately higher performance in smaller networks. Still promises of finding smaller sub networks. Running on mediocre mobile…
Cool! Seems we’re moving closer and closer to realizing the Lottery Ticket Hypothesis https://arxiv.org/abs/1803.03635
Ie. A form of perverse incentive or the cobra effect. Endemic to capitalism, especially in infrastructure.
You can use HuggingFace, PerplexityAI, Anyscale, TogetherAI. There are a bunch of options. Many offer OpenAI compatible APIs too.
What I’d love to see is a rundown of new efficiencies in generative AI. With things like quantization and specialized transformer hardware, the costs will hopefully be less shocking in the future. And fwiw, I don’t find…
I would say actually in the vast majority of cases of accessibility interventions, it benefits everyone. Everyone is, at various points in their lives, a varying degree of disabled (defined in terms of functional…
Indeed. I’ve heard first hand accounts that would make it impossible for me to trust him. He’s very good at the game. But I’d not want to touch him with a barge pole.