interesting, thanks!
IIRC training starts with the initial state and the end state, and the end state is always oriented the same way. It would be interesting to see what would happen if the end state was rotated randomly though I suspect…
I have yes.. You need to erase a larger amount of the center, but it almost always results in a collapse wheras erasing around the center typically regrows.
There's hidden state in the model which presumably it uses to communicate position, ie there's the 3 colors but then a bunch of other channels that the model can use how it wants.
With the old model (and I suspect this one too) it's trained to generate from a single 'seed' pixel in the center of the image. If you erase the center of the image, that's when it completely collapses.
Iirc, the model is still pre-trained on modern text before being fine tuned on 1930's material, so it's possible it still has some knowledge of words that didn't exist back then. Edit: looks like they make some attempt…
AI (as it currently exists) will never be "creative" in the sense that it can only imitate or interpolate between past works. At some point we'll recognize that AI generated works are boring and predictable. AI will…
I'm struggling to understand why an LLM even needs to be involved in this at all. Can't you write a script that takes the last 10 slack messages and checks the github status for any URLs and adds an emoji? It could be a…
The models it creates are gaussian splats, so if you are looking for traditional meshes you'd need a tool that can create meshes from splats.
> Valve actually tried with the first Half-Life game in a decade, and even that didn't work. Half Life Alyx is still considered to be one of the best VR games ever made and one that is still consistently recommended to…
Another way to look at it is parallel processing vs sequential processing.. our brains can make a judgement call about a thousand subtle variables and data points that we can't exactly put our fingers on unless we…
I haven't see any details on how OpenAI's model works, but the tokens it generates aren't directly translated into pixels - those tokens are probably fed into a diffusion process which generates the actual image.. The…
A better way to phrase it might be don't use it for something that you aren't able to verify or validate.
Thanks, this is useful
He's not arguing that no jobs will be displaced, he's arguing that jobs will change, engineering may become more reliable, new types of software jobs may be created.
Agreed, and that is my concern as well that if people get too comfortable with it then companies will keep pushing the bounds of what is acceptable. We will need companies to be transparent about ALL the things they are…
From the wording, it sounds like they are conscious of the potential for data leakage and have taken steps to avoid it. It really depends on how they are applying AI/ML. It can be done in a private way if you are…
To add some nuance to this conversation, what they are using this for is Channel recommendations, Search results, Autocomplete, and Emoji suggestion and the model(s) they train are specific to your workspace (not shared…
A lot of the dialogue that OpenAI's models write is incredibly bland.. I really think we'll need less censored models trained on how to act different roles other than just 'super safe and friendly assistant'.
I wouldn't count yourself out just because you are a junior. Companies love hiring junior devs because their salaries are the lowest. It's senior devs that should be worried. I've yet to see any programming jobs…
OP was arguing that it was decreasing. Steam is a bad source of info for a lot of reasons. Meta is the largest platform and they don't release numbers. My personal feeling (Apple Vision Pro hype not withstanding) as a…
Your link is from 2023.. Current numbers: Steam users with VR Headsets: 2.24% (vs 2.07% last feb) See https://store.steampowered.com/hwsurvey (VR section)
> Except these aren't databases, so that's generally not possible Not directly and not in every case, but it IS possible to use embeddings to link to similar material. People are doing it pretty commonly using the RAG…
IMO, this is probably the goal of the NYTimes lawsuits as well
As I understood it, the legal precedent for generative AI is the same one that allows google to scrape websites in order to index them for search for the common good. Google also can display cached versions of websites…
interesting, thanks!
IIRC training starts with the initial state and the end state, and the end state is always oriented the same way. It would be interesting to see what would happen if the end state was rotated randomly though I suspect…
I have yes.. You need to erase a larger amount of the center, but it almost always results in a collapse wheras erasing around the center typically regrows.
There's hidden state in the model which presumably it uses to communicate position, ie there's the 3 colors but then a bunch of other channels that the model can use how it wants.
With the old model (and I suspect this one too) it's trained to generate from a single 'seed' pixel in the center of the image. If you erase the center of the image, that's when it completely collapses.
Iirc, the model is still pre-trained on modern text before being fine tuned on 1930's material, so it's possible it still has some knowledge of words that didn't exist back then. Edit: looks like they make some attempt…
AI (as it currently exists) will never be "creative" in the sense that it can only imitate or interpolate between past works. At some point we'll recognize that AI generated works are boring and predictable. AI will…
I'm struggling to understand why an LLM even needs to be involved in this at all. Can't you write a script that takes the last 10 slack messages and checks the github status for any URLs and adds an emoji? It could be a…
The models it creates are gaussian splats, so if you are looking for traditional meshes you'd need a tool that can create meshes from splats.
> Valve actually tried with the first Half-Life game in a decade, and even that didn't work. Half Life Alyx is still considered to be one of the best VR games ever made and one that is still consistently recommended to…
Another way to look at it is parallel processing vs sequential processing.. our brains can make a judgement call about a thousand subtle variables and data points that we can't exactly put our fingers on unless we…
I haven't see any details on how OpenAI's model works, but the tokens it generates aren't directly translated into pixels - those tokens are probably fed into a diffusion process which generates the actual image.. The…
A better way to phrase it might be don't use it for something that you aren't able to verify or validate.
Thanks, this is useful
He's not arguing that no jobs will be displaced, he's arguing that jobs will change, engineering may become more reliable, new types of software jobs may be created.
Agreed, and that is my concern as well that if people get too comfortable with it then companies will keep pushing the bounds of what is acceptable. We will need companies to be transparent about ALL the things they are…
From the wording, it sounds like they are conscious of the potential for data leakage and have taken steps to avoid it. It really depends on how they are applying AI/ML. It can be done in a private way if you are…
To add some nuance to this conversation, what they are using this for is Channel recommendations, Search results, Autocomplete, and Emoji suggestion and the model(s) they train are specific to your workspace (not shared…
A lot of the dialogue that OpenAI's models write is incredibly bland.. I really think we'll need less censored models trained on how to act different roles other than just 'super safe and friendly assistant'.
I wouldn't count yourself out just because you are a junior. Companies love hiring junior devs because their salaries are the lowest. It's senior devs that should be worried. I've yet to see any programming jobs…
OP was arguing that it was decreasing. Steam is a bad source of info for a lot of reasons. Meta is the largest platform and they don't release numbers. My personal feeling (Apple Vision Pro hype not withstanding) as a…
Your link is from 2023.. Current numbers: Steam users with VR Headsets: 2.24% (vs 2.07% last feb) See https://store.steampowered.com/hwsurvey (VR section)
> Except these aren't databases, so that's generally not possible Not directly and not in every case, but it IS possible to use embeddings to link to similar material. People are doing it pretty commonly using the RAG…
IMO, this is probably the goal of the NYTimes lawsuits as well
As I understood it, the legal precedent for generative AI is the same one that allows google to scrape websites in order to index them for search for the common good. Google also can display cached versions of websites…