And so animals wouldn’t be conscious because they don’t use language? If so, I vote that the stupidest hypothesis of the year. Or would one count any communication between animals as language? In that case almost any…
Joplin is open source, syncing setup between devices is one login to Dropbox, works for free, with native apps on Windows/OSX/Linux/iOS/Android. It has a bunch of plugins too. If you just need markdown files with…
True, good point, maybe not a straightforward consequence to extend to weights.
Many discriminative models converge to same representation space up to a linear transformation. Makes sense that a linear transformation (like PCA) would be able to undo that transformation.…
Edit: actually this paper is the canonical reference (?): https://arxiv.org/abs/2007.00810 models converge to same space up to a linear transformation. Makes sense that a linear transformation (like PCA) would be able…
You can show for example that siamese encoders for time-series, with MSE loss on similarity, without a decoder, will converge to the the same latent space up to orthogonal transformations (as MSE is kinda like gaussian…
But are we close to doing that in real-time on any reasonably large model? I don’t think so.
I agree with everything up until the AI part, and for that part too, the general idea is good and worth worrying about. I’m scared af about what happens to kids who do all their homework with LLMs. Thankfully at least…
Thankfully in the EU you are not even allowed to sell sunglasses without proper UV protection, and can just pick up sunglasses from any market and trust they are fine, if a little flimsy. EDIT: ok apparently anywhere…
And how long have you been doing this? Because that sounds naive. After doing programming for a decade or two, the actual act of programming is not enough to be ”creative problem solving”, it’s the domain and set of…
Gambling is where I end up if I’m tired and try to get an LLM to build my hobby project for me from scratch in one go, not really bothering to read the code properly. It’s stupid and a waste of time. Sometimes it’s…
Is it a puzzle if there is no algorithm? But testing via coding algos to known puzzles is problematic as the code may be in the training set. Hence you need new puzzles, which is kinda what ARC was meant to do, right?…
I would argue the other way around. I have ADHD, but the thing that really helped me with work procrastination, which I think would help even without ADHD, was to find a job that is actually interesting. In approx 7…
1.5-2 years ago I did some training for a ML paper on 4 AMD MI250x (each is essentially 2 gpus so 8 in total really, each with 64GB VRAM) on LUMI. My Jax models and the baseline PyTorch models were quite easy to set up…
Yet somehow chatting with Gemini in the web interface, it forgets everything after 3 messages, while GPT (almost) always feels natural in long back-and-forths. It’s been like this for at least a year.
I do machine learning research and it is very useful for working out equations and checking for ”does this concept already have an established name” etc. It is also excellent for writing one-off code experiments and…
OSS alternatives with free syncing to your chosen cloud already exist, and have plugin systems. Why not just contribute to those? Because this is either advertising or procrastination.
Or use Joplin which is open source and also creates markdown files, and setting up sync to a cloud provider that you probably already have is free.
Just use Joplin, it’s open source and syncing to many cloud providers you already probably have is free.
And going to a grocery store instead of 37 individual farmers…?
Nice that someone realized then already it sounds sus https://news.ycombinator.com/item?id=42128532
Probably why they tried to address it in the abstract already
I guess SO was quite useful for providing a lot of training material for technical question answering for LLMs? I don’t think they got compensated for it so that is a bit sad. In terms of my use, most questions and…
The best thing to feed the podcast is a dump of all one-liner macros we’ve added to an IRC bot over 15 years (for fetching weather, stocks, and 99% stupid jokes) without any context. Cannot stop laughing listening to it…
Good art is not going out of fashion. Tools may change but part of an artists job is to adapt. For example, when you learn instruments you also train your ear and taste. These are things one cannot take shortcuts in. I…
And so animals wouldn’t be conscious because they don’t use language? If so, I vote that the stupidest hypothesis of the year. Or would one count any communication between animals as language? In that case almost any…
Joplin is open source, syncing setup between devices is one login to Dropbox, works for free, with native apps on Windows/OSX/Linux/iOS/Android. It has a bunch of plugins too. If you just need markdown files with…
True, good point, maybe not a straightforward consequence to extend to weights.
Many discriminative models converge to same representation space up to a linear transformation. Makes sense that a linear transformation (like PCA) would be able to undo that transformation.…
Edit: actually this paper is the canonical reference (?): https://arxiv.org/abs/2007.00810 models converge to same space up to a linear transformation. Makes sense that a linear transformation (like PCA) would be able…
You can show for example that siamese encoders for time-series, with MSE loss on similarity, without a decoder, will converge to the the same latent space up to orthogonal transformations (as MSE is kinda like gaussian…
But are we close to doing that in real-time on any reasonably large model? I don’t think so.
I agree with everything up until the AI part, and for that part too, the general idea is good and worth worrying about. I’m scared af about what happens to kids who do all their homework with LLMs. Thankfully at least…
Thankfully in the EU you are not even allowed to sell sunglasses without proper UV protection, and can just pick up sunglasses from any market and trust they are fine, if a little flimsy. EDIT: ok apparently anywhere…
And how long have you been doing this? Because that sounds naive. After doing programming for a decade or two, the actual act of programming is not enough to be ”creative problem solving”, it’s the domain and set of…
Gambling is where I end up if I’m tired and try to get an LLM to build my hobby project for me from scratch in one go, not really bothering to read the code properly. It’s stupid and a waste of time. Sometimes it’s…
Is it a puzzle if there is no algorithm? But testing via coding algos to known puzzles is problematic as the code may be in the training set. Hence you need new puzzles, which is kinda what ARC was meant to do, right?…
I would argue the other way around. I have ADHD, but the thing that really helped me with work procrastination, which I think would help even without ADHD, was to find a job that is actually interesting. In approx 7…
1.5-2 years ago I did some training for a ML paper on 4 AMD MI250x (each is essentially 2 gpus so 8 in total really, each with 64GB VRAM) on LUMI. My Jax models and the baseline PyTorch models were quite easy to set up…
Yet somehow chatting with Gemini in the web interface, it forgets everything after 3 messages, while GPT (almost) always feels natural in long back-and-forths. It’s been like this for at least a year.
I do machine learning research and it is very useful for working out equations and checking for ”does this concept already have an established name” etc. It is also excellent for writing one-off code experiments and…
OSS alternatives with free syncing to your chosen cloud already exist, and have plugin systems. Why not just contribute to those? Because this is either advertising or procrastination.
Or use Joplin which is open source and also creates markdown files, and setting up sync to a cloud provider that you probably already have is free.
Just use Joplin, it’s open source and syncing to many cloud providers you already probably have is free.
And going to a grocery store instead of 37 individual farmers…?
Nice that someone realized then already it sounds sus https://news.ycombinator.com/item?id=42128532
Probably why they tried to address it in the abstract already
I guess SO was quite useful for providing a lot of training material for technical question answering for LLMs? I don’t think they got compensated for it so that is a bit sad. In terms of my use, most questions and…
The best thing to feed the podcast is a dump of all one-liner macros we’ve added to an IRC bot over 15 years (for fetching weather, stocks, and 99% stupid jokes) without any context. Cannot stop laughing listening to it…
Good art is not going out of fashion. Tools may change but part of an artists job is to adapt. For example, when you learn instruments you also train your ear and taste. These are things one cannot take shortcuts in. I…