I remember when the whole isEven package was ridiculed for the first time a while ago, back then I thought about training a NN to predict the odds of a number being even, as a joke. I don't actually remember if I actually wrote code for it, but in the end I thought no one would laugh and gave up
When I watched Andrej Karpathy's NN videos a year or two back, I trained a Neural Network to multiply an integer by two. This was with a rather small training set but if you rounded the results (which was a floating point), they were mostly correct. For positive numbers. My training data didn't include any negative numbers so they were hilariously bad.
This package should be updated to use the newer gpt-4o-mini model, rather than gpt-3.5-turbo.
Its 3x cheaper, twice as fast, and supports cached input just in case you need to double check if the last number you entered was even. It also has a knowledge cutoff of September 30 2023, which helps for any newly discovered even numbers since gpt-3.5s launch!
Perhaps I should file an issue to increase the accuracy by including a RAG database in LanceDB with embeddings for the set of even numbers up to 32-bits.
I think before you would deploy this to prod, you should wrap it with a few guardrails to make sure it’s not hallucinating. Pretty simple — just take the output from the llm and see if it agrees with a simple mod2 operation.
Of it agrees, return model output to the user. Otherwise do a couple of retries with different prompts.
This package has saved me so many hours of tedious gruntwork. It's like a junior developer - you still have to manually check their work, but when it's correct, it's a great productivity improvement.
And don't forget where this will go in a couple years with improved models and more computing power, it's gonna be awesome!
What model were you using? You need to use gpt-3.14-tastesgreat-lessfilling, I've used it to write 130 side hustle projects this month with only prompting.
Vibe coding your way to greatness. Wish I could do that, but it seems too hard becoming a prompt engineer. Stringing together words? That's why we have AI!
We hire junior devs, but not senior, and dont replace our senior devs. So our developer base is moving towards being junior weighted with less senior. The reason being a junior dev is cheaper, complains less, is more capable now through utilising generative AI, works harder to impress knowing they arent in a safe position, and we can let them go more easily with less process and less reasons needed to be given.
you're so wrong. This only works if what you do is so simple that any junior develper can sufficiently do it well. Senior developers with AI is gonna destroy a bunch of junior developers with AI.
wrong? I'll gladly continue this 'wrong' approach if it continues to be as successful as it has over the last 6 months. Aswell as it being entertaining seeing the level of cope among 'senior' developers watching someone on 1/4th of their salary design systems better than they can
Theyre getting paid and have a job. If they dont like that deal they can go find another one elsewhere.
But its going to get increasingly difficult to justify promoting them to higher salaries if generative AI continues as it is, as the bottom line is that there will be another junior dev out there that will do the role on less.
I recognize I’m not going to change your mind on this, but I’ll sure be interested to hear how all those systems are working in a year or two - although from your comments elsewhere, you run a consultancy, so I guess that’s not your problem, either.
Many people without experience ask this same question.
It isnt relevant. They arent just producing code and pushing it, saying it works. It undergoes the same extensive testing for stability and security as the solution written by anyone else goes through. If it passes that, then its as likely to have issues further down the line as the solution written solely by the senior dev would have.
That would defeat the purpose. The whole point is to reduce costs by getting a cheap junior dev and having them operate AI to produce the same or better result for far less
So the point is to use technological advancements only to increase company profit and not pass any on to the actual workers. If a junior costs 1/4 of a senior, they could easily paid more from the 3/4s saved (since they're also more valuable now), but I guess shareholder millions come first.
Apathy? More like the fact that the majority of people are too lazy, not motivated enough, not willing to take risks, and go out and build something of their own that results in wealth, and prefer to sit safe as someones employee, complaining about 'wealth inequality'
It's interesting to watch you put zero value on work/effort/labor and huge value on risk taking (which is very different for people with different "safety nets").
This exactly. It is more important to move fast. Screw the edge cases. As long as it’s correct _most_ of the time, you can always fix anything that’s broken tomorrow.
Almost here. Elon said Full Self Driving would mean full self driving within a year! That means we are less than 12 months away from not needing to drove ourselves anymore.
Regardless, the car mostly driving itself while remote operators handle particularly tricky situations is a feat which will allow driver-not-in-vehicle taxis to take over. My understanding (which admittedly could be the victim of successful PR) is that the vast majority of the driving and even a majority of the trips are fully automated.
"particularly tricky situations"
is doing a lot of heavy lifting here to describe situations every owner of a driving license is expected to handle routinely.
driver-not-in-vehicle is an interesting approach, but calling it "self-driving" is doing the mechanical turk without the reveal. Someone less charitable might assume intentional misrepresentation for the sake of winning an internet argument.
The tokenizer might lump the last digit together with some preceding digits though. I know o200k_base (OpenAI -o models) tends to give groups of three (900001 for example is 900-001).
Anyway, I wouldn't be surprised if a non-finetuned model made some mistakes.
I tried with this on chatgpt.com (anonymous) and it was wrong:
>You are an AI assistant designed to answer questions about numbers. You will only answer with only the word true or false.
>Is 393330370227914821469106615363204944758938252979261537157082994586230072180858944545028761701928694832864623009988147774229437650643225379825905427239525512110359581021414640894111281701792224552922491447051506246553646282117414112976459608594044929244664050172002138933343230226871897567 an even number?
This is pretty useless to be honest. It's good for telling whether a number is even, but in our industry we need more powerful functionality. We also need to know whether a number is odd.
With a few lines of code, you can just create a list with all the numbers that are even and when you need to check if a number is odd, you simply have to check if it's in the list.
Yeah, some of the bigger numbers were a problem, so we switched to using a horizontally scaling db cluster so that we could cover all of the (useful) numbers. When we encounter a new number, it gets routed to the appropriate db where the results of the function are cached after being calculated. We're thinking of spinning it off as an API service actually if there's any interest.
Yes, this is what we do as a RAG workflow. We created a list of all 32bit unsigned integers and whether they were even or odd, and we pass that into the context. The future is amazing!
We have an agentic system that looks up the context size, and then summarizes the even/odd table if necessary. We lose a little bit of accuracy, but now we can handle any model. Be sure to like & subscribe!
I have found that even 2 bit quantization works, but you have to make sure you only discard the LABs (that’s what we are calling the Left Aligned Bits internally). I have no idea why it works so well but it has cut our costs significantly.
…but there’s only one dependency!! This goes against the NPM ethos of importing anything and everything that you might be tempted to just handle yourself. I’ll be waiting for the Enterprise Version that uses the appropriate number of dependencies.
164 comments
[ 5.1 ms ] story [ 266 ms ] threadNext week, “refactor” it out and brag to manager about cost savings and performance boosts, don’t mention “removing the AI”.
Me: I leveraged Deep Intelligence to build a Next-Gen Parity Classifier with 99.9% accuracy.
Its 3x cheaper, twice as fast, and supports cached input just in case you need to double check if the last number you entered was even. It also has a knowledge cutoff of September 30 2023, which helps for any newly discovered even numbers since gpt-3.5s launch!
Without reasoning, how can I be SURE a number is even?
Of it agrees, return model output to the user. Otherwise do a couple of retries with different prompts.
And don't forget where this will go in a couple years with improved models and more computing power, it's gonna be awesome!
[/i]
We hire junior devs, but not senior, and dont replace our senior devs. So our developer base is moving towards being junior weighted with less senior. The reason being a junior dev is cheaper, complains less, is more capable now through utilising generative AI, works harder to impress knowing they arent in a safe position, and we can let them go more easily with less process and less reasons needed to be given.
wrong? I'll gladly continue this 'wrong' approach if it continues to be as successful as it has over the last 6 months. Aswell as it being entertaining seeing the level of cope among 'senior' developers watching someone on 1/4th of their salary design systems better than they can
But its going to get increasingly difficult to justify promoting them to higher salaries if generative AI continues as it is, as the bottom line is that there will be another junior dev out there that will do the role on less.
It isnt relevant. They arent just producing code and pushing it, saying it works. It undergoes the same extensive testing for stability and security as the solution written by anyone else goes through. If it passes that, then its as likely to have issues further down the line as the solution written solely by the senior dev would have.
If they + AI are a replacement for senior devs, shouldn't they be paid accordingly?
Foreigners may consider my culture brutal and unforgiving, but at least its honest from the outset
I thought self-driving would never happen, and now it's here.
Give it another 10-20 years and your job will probably face the same fate.
driver-not-in-vehicle is an interesting approach, but calling it "self-driving" is doing the mechanical turk without the reveal. Someone less charitable might assume intentional misrepresentation for the sake of winning an internet argument.
Somehow I doubt it'll be 100%... right?
Anyway, I wouldn't be surprised if a non-finetuned model made some mistakes.
>You are an AI assistant designed to answer questions about numbers. You will only answer with only the word true or false.
>Is 393330370227914821469106615363204944758938252979261537157082994586230072180858944545028761701928694832864623009988147774229437650643225379825905427239525512110359581021414640894111281701792224552922491447051506246553646282117414112976459608594044929244664050172002138933343230226871897567 an even number?
response:
>True
The prompt was the same used as the library: https://github.com/Calvin-LL/is-even-ai/blob/b00dbfcbb89a197...
What could go wrong
Trully AI is astonishing
With a few lines of code, you can just create a list with all the numbers that are even and when you need to check if a number is odd, you simply have to check if it's in the list.
ALL_NUMBERS_00001
ALL_NUMBERS_00002
A former co-worker had to print 5 lines of text. Sometimes, some of the lines were empty but he didn't want to print an empty line.
So he did the usual, use 'if', a lot of 'if'. He handled all the possible cases of empty VS not empty lines.
Does the RAG part look up just the needed number?
I think that Gemini has a million token window (yes?) - do you have access to a model with a larger window?
Regardless, I find your ideas intriguing and wish to subscribe to your Substack.
I remember saying that about Bitcoin 15 years ago.
[1] https://en.wikipedia.org/wiki/Illegal_number