We found evidence of specific layer-localized "reasoning" circuits in a few models last year too! A very much work-in-progress paper is here: https://openreview.net/forum?id=mTjGBrkdtz
Huh there is so much limonene in Coca Cola?! Limonene works as a very good…pesticide and herbicide! I did a research project on limonene like 10 years ago with my mentor and it outperformed most commercial pesticides in…
These metaphorical database analogies bug me, and from what it seems like, a lot of other people in comments! So far some of the most reasonable explanations I have found that take training dynamics into account are…
Hi! Did you ever end up running this reproduction? If yes, could you also check if the Putnam/IMO problems are in the training data perhaps by trying to have it complete the problems n times? I would totally do this…
O
If anyone else is curious about which ARC-AGI public eval puzzles o3 got right vs wrong (and its attempts at the ones it did get right), here's a quick visualization: https://arcagi-o3-viz.netlify.app
Sorry never mind! I wasn't thinking at all when I wrote that thought, but that obviously doesn't make sense :)
That's fair but what if you could estimate the direction of incoming light with other sensors? Using inverse diffraction etc. Just a thought
Hi! I've been working on theorem proving systems for some time now. I would love to help out with an AlphaProof reproduction, but I can't reach you on discord for some reason!
Thank you, those insights are invaluable! This is a specific and potentially dumb question and I completely understand if you can't answer it! The practical motivation for MoEs is very clear but I do worry about loss of…
I'm not sure how to quantify how quickly or well humans learn in-context (if you know of any work on this I'd love to read it!) In general, there is too much fluff and confusion floating around about what these models…
There has been some interesting work when it comes to distributed training. For example DiLoCo (https://arxiv.org/abs/2311.08105). I also know that Bittensor and nousresearch collaborated on some kind of competitive…
I tried to do this ages ago in 2018 by adapting OpenAI's flow architecture and it sort of seemed to work (was at least promising). With today's models with a significantly more disentangled latent space it should be…
Wow I had hoped for a more productive discussion than these 1-1 comparisons of Bard vs ChatGPT that I'm seeing everywhere. The model deployed with this version of Bard is clearly a smaller model than the biggest…
I've been using Metaphor for a few weeks now and have almost entirely switched from Google and other search engines. Keyword based search simply doesn't come close when it comes to getting the _right_ results. While I…
Right, but doesn't that mean that it could potentially be used for designing algorithms that have componentwise numerical stability over some kind of floating point standard, but this, by definition being a result over…
While your point about numerical stability is correct in general, there are no numerical stability issues here and I think this conception, which I've seen in more than one place now, stems from a fundamental…
UPI's penetration in (urban and semi-urban anyway) India is honestly incredible. I worked with/on the tech when it was very nascent in 2016 and in 2022, on visiting India after a long time I was stunned to see…
That is actually pretty freaking cool. Not hard to do by any means, just cool.
x2go works quite well actually. Its definitely not like local but it does the job.
A similar thing happened to me and my partner in the US, in a fairly liberal part, so I'm not entirely surprised that it's happening in SEA. People wouldn't rent to us because we told them we cook at home and these…
Honestly! This is such a good initiative that it bothers me that this is flagged. Housing issues for queer people is one the biggest issues across the world. I mean the first things we consider before even booking a…
Ooh good recommendation, lobste.rs is cool. I've been looking for someone with a potential invite for a while too if anyone here is offering :).
About the bit regarding you possibly commuting from Paris to London for work, I'm curious - how would that even work? Would you go through customs every morning/evening? Has anyone here done this?
*her mentor :) Source: https://ewintang.com/
We found evidence of specific layer-localized "reasoning" circuits in a few models last year too! A very much work-in-progress paper is here: https://openreview.net/forum?id=mTjGBrkdtz
Huh there is so much limonene in Coca Cola?! Limonene works as a very good…pesticide and herbicide! I did a research project on limonene like 10 years ago with my mentor and it outperformed most commercial pesticides in…
These metaphorical database analogies bug me, and from what it seems like, a lot of other people in comments! So far some of the most reasonable explanations I have found that take training dynamics into account are…
Hi! Did you ever end up running this reproduction? If yes, could you also check if the Putnam/IMO problems are in the training data perhaps by trying to have it complete the problems n times? I would totally do this…
O
If anyone else is curious about which ARC-AGI public eval puzzles o3 got right vs wrong (and its attempts at the ones it did get right), here's a quick visualization: https://arcagi-o3-viz.netlify.app
Sorry never mind! I wasn't thinking at all when I wrote that thought, but that obviously doesn't make sense :)
That's fair but what if you could estimate the direction of incoming light with other sensors? Using inverse diffraction etc. Just a thought
Hi! I've been working on theorem proving systems for some time now. I would love to help out with an AlphaProof reproduction, but I can't reach you on discord for some reason!
Thank you, those insights are invaluable! This is a specific and potentially dumb question and I completely understand if you can't answer it! The practical motivation for MoEs is very clear but I do worry about loss of…
I'm not sure how to quantify how quickly or well humans learn in-context (if you know of any work on this I'd love to read it!) In general, there is too much fluff and confusion floating around about what these models…
There has been some interesting work when it comes to distributed training. For example DiLoCo (https://arxiv.org/abs/2311.08105). I also know that Bittensor and nousresearch collaborated on some kind of competitive…
I tried to do this ages ago in 2018 by adapting OpenAI's flow architecture and it sort of seemed to work (was at least promising). With today's models with a significantly more disentangled latent space it should be…
Wow I had hoped for a more productive discussion than these 1-1 comparisons of Bard vs ChatGPT that I'm seeing everywhere. The model deployed with this version of Bard is clearly a smaller model than the biggest…
I've been using Metaphor for a few weeks now and have almost entirely switched from Google and other search engines. Keyword based search simply doesn't come close when it comes to getting the _right_ results. While I…
Right, but doesn't that mean that it could potentially be used for designing algorithms that have componentwise numerical stability over some kind of floating point standard, but this, by definition being a result over…
While your point about numerical stability is correct in general, there are no numerical stability issues here and I think this conception, which I've seen in more than one place now, stems from a fundamental…
UPI's penetration in (urban and semi-urban anyway) India is honestly incredible. I worked with/on the tech when it was very nascent in 2016 and in 2022, on visiting India after a long time I was stunned to see…
That is actually pretty freaking cool. Not hard to do by any means, just cool.
x2go works quite well actually. Its definitely not like local but it does the job.
A similar thing happened to me and my partner in the US, in a fairly liberal part, so I'm not entirely surprised that it's happening in SEA. People wouldn't rent to us because we told them we cook at home and these…
Honestly! This is such a good initiative that it bothers me that this is flagged. Housing issues for queer people is one the biggest issues across the world. I mean the first things we consider before even booking a…
Ooh good recommendation, lobste.rs is cool. I've been looking for someone with a potential invite for a while too if anyone here is offering :).
About the bit regarding you possibly commuting from Paris to London for work, I'm curious - how would that even work? Would you go through customs every morning/evening? Has anyone here done this?
*her mentor :) Source: https://ewintang.com/