zingelshuher
No user record in our sample, but zingelshuher has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
No user record in our sample, but zingelshuher has activity below (stories or comments). Likely we have partial data — the full bulk-load will fill profiles in.
[flagged]
> Google knowingly made their search results shittier and shittier for years unfortunately this extends to youtube too. now they have a new shitty trick. you click on the link and they randomly give you a completely…
> It is unlikely people are going to switch en mass to open source models It depends on the task at hands. For complex tasks no way personal computer can compete with giants data centers. But, as soon as software…
> poorly designed government intervention due to misunderstanding of the dynamics behind the process (homelessness) Major drive is easy to understand, just cross the border and you are homeless on full support. Millions…
had to upvote this
Only if it does nothing. In fact Google is one of the major players in LLM field. The winner is hard to predict, chip makers likely ;) Everybody jumped on bandwagon, Amazon is jumping...
I often use ChatGPT4 for technical info. It's easier then scrolling through pages whet it works. But.. the accuracy is inconsistent, to put it mildly. Sometimes it gets stuck on wrong idea. Interesting how far LLMs can…
It's impossible. Meta itself cannot reproduce the model. Because training is randomized and that info is lost. First samples a coming at random. Second there are often drop-out layers, they generate random pattern which…
If we can keep unlimited memory, but use only a selected relevant subset in each chat session. This should help. Of course the key is 'selected', it's another big problem. Like short memory. Probably we can make…
It's a different animal. In general you cannot reproduce the model even having all the training data. There are too many random factors and nobody keeps track of them. Just pushing the training data is done at random…
It's a matter of opinion how much open model should be to be called 'open source'. Looks like some believe they have the right to define it for everybody else to use. Like for software. Have to disagree. Why don't we…
> I'll bet Adobe or similiar will buy this 0,5 mil May be that was the business plan, or 'plan B'
Yes. And there are many forgotten accounts on youtube, their owners now have another way to monetarize. Not sure why Adobe didn't talk to Youtube directly.
As you mentioned models need _random_ videos. Just 'walk outside' will produce more or less the same. My guess Adobe is more interested in 'family' sort of videos, with humans. This is what most users will be asking…
It doesn't affect creators life as they guarantee (likely) it will not be made public. So it's just side income. Likely creators make a lot of fragments which don't get into the final version. The problem for Adobe is…
It reflects the fact that Amazon in serious about AI. If fact they are well positioned with their datacenters and a lot of ways to apply, starting with smarter Alexa.
Expect sh*t load of AI hallucinations. As if Wiki isn't bad enough with BS some intentionally posting.
"the bigger you make epsilon "... " thus slower the training progress will be" Sounds like variable epsilon is optimal, that's instead of learning rate, or both together. Would be nice if this can somehow be…
Intuitively looks like models should be close enough, or sparse enough for merge to work. I wonder if MoE experts can be merged(?)
Good luck with that ;) Actually you _can_ learn juggling this way, just couple of minutes at a time.
There are unstable cases when static learning rate doesn't work. Solution starts wobbling too much after some time and explodes. Using too small LR from the beginning leads to local minima. Making it stable _is_…
Have to disagree with this. The major limiting factor is the software and lack of applications. If there was a killer application it would be much easier to sell. Then the numbers would drive the prices down.
Why isn't he identified personally? Very likely he is 'contributing' to other projects under different accounts.
Question, have you seen the improvement after adding the noise? I mean in practice. Asking because intuition sometimes doesn't work.
I run some tests. Single model of the same size is better than MoE. Single expert out of N is better than model of the same size (i.e. same as expert). 2 experts are better than one. That was on small LLM, not sure if…