Maybe not a good idea to link a page that runs source code created by random people. Well CSS is very safe, but still.
Not if you ask first.
Neural nets often fail with (repetitive) gibberish output when the input is too different from the training data. This model appears to take in the entire text input at once or look ahead at the next input letters, so…
Can DRIZZLE help to achieve higher resolution? Though with hundreds of photos this will imply a lot of work: https://en.wikipedia.org/wiki/Drizzle_(image_processing)
Geoffrey Hinton has recently been talking about how analog and "imperfect" computing with specialized hardware/circuitry may yield much cheaper neural nets, that could easily be as large as human brains, but would only…
But they have highly likely internal prototypes with higher bandwidth and latency. Also, with distilled latent diffusion one can probably generate text(-images) much faster anyhow as it could produce long chunks of text…
Yes, but the losses in Figure 3 increase because the larger models see fewer data to keep the FLOP budget constant, not because of overfitting. Large models do not overfit very much, so the loss of a larger model will…
Though isn't it highly likely that core devs working at the big tech giants have access to 10x-100x faster compute, e.g. some secret TPU successor at Google?
> if you want improved performance, you still need more data Not true. See figure 2: https://arxiv.org/pdf/2203.15556.pdf#page=5 The loss decreases with greater model size at the same compute budget (i.e. stopping…
Not necessarily: https://arxiv.org/abs/2206.14486 Also, even with "Chinchilla laws", you still gain performance in a larger model, you just need a lot more data (if just as noisy) to reach the same level of convergence,…
The model with the most similar name in this list is code-cushman-001 which is described as "Codex model that is a stronger, multilingual version of the Codex (12B) model in the paper".…
Amazing if this is only a 12B model. If this already increases coding productivity by up to 50% (depending on kind of work), imagine what a 1T model will be capable of! I do wonder if some programmers at FAANG are…
Can you use a different Wi-Fi network at the same time for internet access or does Wi-Fi Direct block any other Wi-Fi access?
> Plus you don't need to be on the same network You mean in case of the Wireless Display Adapter? For Miracast you do need to be on the same LAN, right?
Google will not disappear. They already have much larger neural nets almost ready for deployment, plus they will be able to afford even larger ones in future. And size is all that matters while the techniques are mostly…
How will we justify our existence unable to contribute meaningfully to the economy?
It is measurable, but not harmful to a meaningful extent. There are lots of sources of low-dose radiation in the natural human/primate/.../mammalian environment.
Speaking of which, is anyone aware of example code using the LSTM? I've been trying to get this to work, but there seems to be information missing e.g how to setup the input/output descriptors and how to manage input…
How long does the battery last for you browsing like that?
So 0.005% at 560 TWh total consumption.
> About third of what was used before. How much is that as a fraction of the total electricity consumption?
How much electricity can plausibly be saved this way? And how does that compare to the energy required to reprogram and possibly renew all these signs?
While automatic data collection might become harder, one can still curate high quality datasets. An example is Tesla's FSD autopilot which is nearly entirely trained on curated data (AFAIK), as well as highly realistic…
One piece of evidence is that authorities pushing hard for surveillance do not actually care about removing images they find, even though removal requests are easy to file and are obeyed by hosters.[0] More evidence is…
Perhaps they induce immunity to novel viruses by transferring them in small doses between very different animals. Just guessing though.
Maybe not a good idea to link a page that runs source code created by random people. Well CSS is very safe, but still.
Not if you ask first.
Neural nets often fail with (repetitive) gibberish output when the input is too different from the training data. This model appears to take in the entire text input at once or look ahead at the next input letters, so…
Can DRIZZLE help to achieve higher resolution? Though with hundreds of photos this will imply a lot of work: https://en.wikipedia.org/wiki/Drizzle_(image_processing)
Geoffrey Hinton has recently been talking about how analog and "imperfect" computing with specialized hardware/circuitry may yield much cheaper neural nets, that could easily be as large as human brains, but would only…
But they have highly likely internal prototypes with higher bandwidth and latency. Also, with distilled latent diffusion one can probably generate text(-images) much faster anyhow as it could produce long chunks of text…
Yes, but the losses in Figure 3 increase because the larger models see fewer data to keep the FLOP budget constant, not because of overfitting. Large models do not overfit very much, so the loss of a larger model will…
Though isn't it highly likely that core devs working at the big tech giants have access to 10x-100x faster compute, e.g. some secret TPU successor at Google?
> if you want improved performance, you still need more data Not true. See figure 2: https://arxiv.org/pdf/2203.15556.pdf#page=5 The loss decreases with greater model size at the same compute budget (i.e. stopping…
Not necessarily: https://arxiv.org/abs/2206.14486 Also, even with "Chinchilla laws", you still gain performance in a larger model, you just need a lot more data (if just as noisy) to reach the same level of convergence,…
The model with the most similar name in this list is code-cushman-001 which is described as "Codex model that is a stronger, multilingual version of the Codex (12B) model in the paper".…
Amazing if this is only a 12B model. If this already increases coding productivity by up to 50% (depending on kind of work), imagine what a 1T model will be capable of! I do wonder if some programmers at FAANG are…
Can you use a different Wi-Fi network at the same time for internet access or does Wi-Fi Direct block any other Wi-Fi access?
> Plus you don't need to be on the same network You mean in case of the Wireless Display Adapter? For Miracast you do need to be on the same LAN, right?
Google will not disappear. They already have much larger neural nets almost ready for deployment, plus they will be able to afford even larger ones in future. And size is all that matters while the techniques are mostly…
How will we justify our existence unable to contribute meaningfully to the economy?
It is measurable, but not harmful to a meaningful extent. There are lots of sources of low-dose radiation in the natural human/primate/.../mammalian environment.
Speaking of which, is anyone aware of example code using the LSTM? I've been trying to get this to work, but there seems to be information missing e.g how to setup the input/output descriptors and how to manage input…
How long does the battery last for you browsing like that?
So 0.005% at 560 TWh total consumption.
> About third of what was used before. How much is that as a fraction of the total electricity consumption?
How much electricity can plausibly be saved this way? And how does that compare to the energy required to reprogram and possibly renew all these signs?
While automatic data collection might become harder, one can still curate high quality datasets. An example is Tesla's FSD autopilot which is nearly entirely trained on curated data (AFAIK), as well as highly realistic…
One piece of evidence is that authorities pushing hard for surveillance do not actually care about removing images they find, even though removal requests are easy to file and are obeyed by hosters.[0] More evidence is…
Perhaps they induce immunity to novel viruses by transferring them in small doses between very different animals. Just guessing though.