AI seems really good at writing code without errors, but that can actually be more dangerous. There is a coding principle (YAGNI, not building things in advance assuming you'll use them later), but even so, when it adds…
Until a few months ago I did it this way, but OpenAI and Anthropic built their own harnesses, and since those end up conflicting with the harness I built myself, having no setup at all actually ended up performing…
I'm studying coding these days, and I thought I should still be able to read code, but I'm starting to wonder if I really need to read it, and then what I should do.
The number of papers submitted to AI conferences is growing 2-3x every year. Of course there are AI slop papers, but looking at the whole, research speed has probably improved. I think the same thing might happen in…
These days I use AI for development and it feels like my coding skills are getting worse, so I sometimes need rehab, and I'm a bit worried that mathematicians will go through the same thing. Later, since the proof…
Like it's a top tier model, so does that mean it is at the level of Opus 5.5 (claude) or 6.1 Sol (chatgpt)? I don't think I can trust the benchmarks Google released themselves, but from what users say, it seems like…
As models get better, I think a time will come when it's hard for people to even verify the results. In the end, I think the bottleneck will be people.
If someone hurts another person with a knife, we can't punish the person who sold the knife, but I think someone who sells nuclear weapons needs some level of regulation. I think OpenAI needs some level of prevention…
There may be great researchers who work on several papers in a month, but even with this rule they can just split them and submit to arxiv, so I think it is very reasonable. AI slop is everywhere now (and also…
I'm not sure Google can cut in when Claude and ChatGPT already got. I'm using both, but I'll keep track of whether Google can make it good enough for me to use also this Gemini, or cancel one of the two (Claude and…
Are these the type of papers that can be uploaded to arxiv? The citations can be manipulated then, through self-reference between papers.
[dead]
Even if the chance of these phenomena is estimated at one in billions, since the number of trials is much higher, and as long as the agent knows these paths, blocking it within the model itself would be impossible I…
It sholud definitely not be more capble than Fable. It seems tight comparision but cannot find out its details. I'll use this and check the perceived performance.
I also have set custom harness environment for me in the company (and also for at home), I expect that big companies (OpenAI, or Linear and Snowflake) may release the internal harness setting or functions that would be…
The structured output that Google provides (the function that blocks the disallowed words) may calculate softmax output with assigning -inf value to the other words, then the probability is not the same as the weight…
But, I think that the agent may also generate like this approach, not directly generate text, instead first writing the generation code then execute if they are the smart agent.
Since the baseline LLM architecture is similar with each other, maybe already there are relations between their each opinion. Of course, this is an assumption and the explicit training seems effective in this case. But,…
Six months into customizing my own Claude Code harness, I've settled on assuming Anthropic and OpenAI will just handle all of it, except turning my own flows into skills.
Is the attention explanation of why the model tells like this? I've seen that there are many discussions about this. (Image attention visualizations were not that good I think)
AI seems really good at writing code without errors, but that can actually be more dangerous. There is a coding principle (YAGNI, not building things in advance assuming you'll use them later), but even so, when it adds…
Until a few months ago I did it this way, but OpenAI and Anthropic built their own harnesses, and since those end up conflicting with the harness I built myself, having no setup at all actually ended up performing…
I'm studying coding these days, and I thought I should still be able to read code, but I'm starting to wonder if I really need to read it, and then what I should do.
The number of papers submitted to AI conferences is growing 2-3x every year. Of course there are AI slop papers, but looking at the whole, research speed has probably improved. I think the same thing might happen in…
These days I use AI for development and it feels like my coding skills are getting worse, so I sometimes need rehab, and I'm a bit worried that mathematicians will go through the same thing. Later, since the proof…
Like it's a top tier model, so does that mean it is at the level of Opus 5.5 (claude) or 6.1 Sol (chatgpt)? I don't think I can trust the benchmarks Google released themselves, but from what users say, it seems like…
As models get better, I think a time will come when it's hard for people to even verify the results. In the end, I think the bottleneck will be people.
If someone hurts another person with a knife, we can't punish the person who sold the knife, but I think someone who sells nuclear weapons needs some level of regulation. I think OpenAI needs some level of prevention…
There may be great researchers who work on several papers in a month, but even with this rule they can just split them and submit to arxiv, so I think it is very reasonable. AI slop is everywhere now (and also…
I'm not sure Google can cut in when Claude and ChatGPT already got. I'm using both, but I'll keep track of whether Google can make it good enough for me to use also this Gemini, or cancel one of the two (Claude and…
Are these the type of papers that can be uploaded to arxiv? The citations can be manipulated then, through self-reference between papers.
[dead]
Even if the chance of these phenomena is estimated at one in billions, since the number of trials is much higher, and as long as the agent knows these paths, blocking it within the model itself would be impossible I…
It sholud definitely not be more capble than Fable. It seems tight comparision but cannot find out its details. I'll use this and check the perceived performance.
[dead]
I also have set custom harness environment for me in the company (and also for at home), I expect that big companies (OpenAI, or Linear and Snowflake) may release the internal harness setting or functions that would be…
The structured output that Google provides (the function that blocks the disallowed words) may calculate softmax output with assigning -inf value to the other words, then the probability is not the same as the weight…
[dead]
But, I think that the agent may also generate like this approach, not directly generate text, instead first writing the generation code then execute if they are the smart agent.
Since the baseline LLM architecture is similar with each other, maybe already there are relations between their each opinion. Of course, this is an assumption and the explicit training seems effective in this case. But,…
[dead]
Six months into customizing my own Claude Code harness, I've settled on assuming Anthropic and OpenAI will just handle all of it, except turning my own flows into skills.
[dead]
Is the attention explanation of why the model tells like this? I've seen that there are many discussions about this. (Image attention visualizations were not that good I think)
[dead]