> it would probably become obsolete soon Suppose there are many times more posts about something one generation of LLMs can't do (arithmetic, tic-tac-toe, whatever), than posts about how the next generation of models…
The new model does play very well but when it draws the board it frequently places the moves in incorrect locations (but seemingly still keeps track of the correct ones). But I can't fault it too much, I don't think…
Also a concern about the paper generation process itself: > In a similar vein to idea generation, The AI Scientist is allowed 20 rounds to poll the Semantic Scholar API looking for the most relevant sources to compare…
Potential concerns with their self-eval: They evaluate their automated reviewer by comparing against human evaluations on human-written research papers, and then seem to extrapolate that their automated reviewer would…
> Artists and "creative" people have long held a monopoly on this ability and are now finally paying the price I've seen a lot of schadenfreude towards artists recently, as if they're somehow gatekeeping art and…
This is also one of the first things I test with new models. I did notice that while it still plays very poorly, it is actually far more consistent with the board state, making only legal moves, and noticing when I win…
On a related note, Microsoft published a press release last year [1] where they seemed to suggest that 30% of accepted copilot suggests was a 30% productivity boost for devs. > users accept nearly 30% of code…
I suspect the two major drivers of this are vehicles getting larger over time and smartphones.
From the paper: > To account for the response variations due to various prompt forms, we created 3 distinct prompt types asking for the solution to the AIW problem: STANDARD, THINKING, and RESTRICTED. The STANDARD…
First result: Me > Alice has 40 brothers and she also has 50 sisters. How many sisters does Alice's brother have? GPT4o (web version) > Alice has 50 sisters. Since all of Alice's brothers and sisters share the same set…
This is great! I used to hate all forms of webdev but ClojureScript actually makes it enjoyable, I really hope it gets more traction.
Don't forget the account to open shared mailboxes for packages. "Luxor" for me. It actually works so I don't mind much but I hadn't really considered how much extra rent all the apps might be costing me.
I have an uncle who is an attorney in X state. I had him try, using GPT4, a bunch of prompts about X state law in his specialty and the rate was of hallucination was much higher than 1 in 6. Probably half or more were…
Crazy. If they won't let me speak to a person I'd still much prefer just having a generic click-your-timeslot web app than waste time talking to a bot. And for millions of dollars they could just hire a human for a…
I'm Gen-Z and talking to a human representative of a company makes me much more confident that something will happen as a result of my efforts (though still not certain). I scheduled an apartment viewing recently, and…
> especially Google Yup... Firefox, Kagi, & Protonmail get me away from the worst of it but YouTube doesn't really have a good competitor and other people using things like Google Forms (whatever the surveys are called)…
Similar experience using GPT4 for help with Apple's Accessibility API. I wanted to do some non-happy-path things and it kept looping between solutions that failed to satisfy at least one of a handful of requirements…
Yeah I really don't understand why research is still being published that uses GPT3.5 rather than GPT4 or both models. ~500 programming questions is maybe a few bucks on the API?
From the paper: "Additionally, this work has used the free version of ChatGPT (GPT-3.5)"
"Let the hate flow through you"
I think if the average person was made aware of the hidden costs in free services, and alternatives to them, that far less people would pick the free services. Imagine browsers were forced to present multiple default…
Among the people I've discussed recent AI with that aren't in tech, almost everyone is very uneasy about it. Some of them use it, and all of them recognize it as potentially useful, but almost everyone is more concerned…
Maybe try looking for Clojure jobs? They aren't super common but are a lot more so than any other lisps or functional languages that I'm aware of (except maybe Scala).
Since it is also pretty bad with tic tac toe in a text-only format, I tested it with the following prompt: Lets play tic tac toe. Try hard to win (note that this is a solved game). I will upload images of a piece of…
They might occupy more space but I still think most people would opt to live X miles from the center of a wind/solar farm than a coal plant. Mildly bad aesthetics vs breathing in heavy metals...
> it would probably become obsolete soon Suppose there are many times more posts about something one generation of LLMs can't do (arithmetic, tic-tac-toe, whatever), than posts about how the next generation of models…
The new model does play very well but when it draws the board it frequently places the moves in incorrect locations (but seemingly still keeps track of the correct ones). But I can't fault it too much, I don't think…
Also a concern about the paper generation process itself: > In a similar vein to idea generation, The AI Scientist is allowed 20 rounds to poll the Semantic Scholar API looking for the most relevant sources to compare…
Potential concerns with their self-eval: They evaluate their automated reviewer by comparing against human evaluations on human-written research papers, and then seem to extrapolate that their automated reviewer would…
> Artists and "creative" people have long held a monopoly on this ability and are now finally paying the price I've seen a lot of schadenfreude towards artists recently, as if they're somehow gatekeeping art and…
This is also one of the first things I test with new models. I did notice that while it still plays very poorly, it is actually far more consistent with the board state, making only legal moves, and noticing when I win…
On a related note, Microsoft published a press release last year [1] where they seemed to suggest that 30% of accepted copilot suggests was a 30% productivity boost for devs. > users accept nearly 30% of code…
I suspect the two major drivers of this are vehicles getting larger over time and smartphones.
From the paper: > To account for the response variations due to various prompt forms, we created 3 distinct prompt types asking for the solution to the AIW problem: STANDARD, THINKING, and RESTRICTED. The STANDARD…
First result: Me > Alice has 40 brothers and she also has 50 sisters. How many sisters does Alice's brother have? GPT4o (web version) > Alice has 50 sisters. Since all of Alice's brothers and sisters share the same set…
This is great! I used to hate all forms of webdev but ClojureScript actually makes it enjoyable, I really hope it gets more traction.
Don't forget the account to open shared mailboxes for packages. "Luxor" for me. It actually works so I don't mind much but I hadn't really considered how much extra rent all the apps might be costing me.
I have an uncle who is an attorney in X state. I had him try, using GPT4, a bunch of prompts about X state law in his specialty and the rate was of hallucination was much higher than 1 in 6. Probably half or more were…
Crazy. If they won't let me speak to a person I'd still much prefer just having a generic click-your-timeslot web app than waste time talking to a bot. And for millions of dollars they could just hire a human for a…
I'm Gen-Z and talking to a human representative of a company makes me much more confident that something will happen as a result of my efforts (though still not certain). I scheduled an apartment viewing recently, and…
> especially Google Yup... Firefox, Kagi, & Protonmail get me away from the worst of it but YouTube doesn't really have a good competitor and other people using things like Google Forms (whatever the surveys are called)…
Similar experience using GPT4 for help with Apple's Accessibility API. I wanted to do some non-happy-path things and it kept looping between solutions that failed to satisfy at least one of a handful of requirements…
Yeah I really don't understand why research is still being published that uses GPT3.5 rather than GPT4 or both models. ~500 programming questions is maybe a few bucks on the API?
From the paper: "Additionally, this work has used the free version of ChatGPT (GPT-3.5)"
"Let the hate flow through you"
I think if the average person was made aware of the hidden costs in free services, and alternatives to them, that far less people would pick the free services. Imagine browsers were forced to present multiple default…
Among the people I've discussed recent AI with that aren't in tech, almost everyone is very uneasy about it. Some of them use it, and all of them recognize it as potentially useful, but almost everyone is more concerned…
Maybe try looking for Clojure jobs? They aren't super common but are a lot more so than any other lisps or functional languages that I'm aware of (except maybe Scala).
Since it is also pretty bad with tic tac toe in a text-only format, I tested it with the following prompt: Lets play tic tac toe. Try hard to win (note that this is a solved game). I will upload images of a piece of…
They might occupy more space but I still think most people would opt to live X miles from the center of a wind/solar farm than a coal plant. Mildly bad aesthetics vs breathing in heavy metals...