Interesting work but this strikes me as a somewhat quixotic fight against inevitable tendencies of statistical models. Reinforcement learning has a single goal, an agreeable mean. Reinforcement learning stops when the…
I think there's a critical flaw with Anthropic's approach to memory which is that they seem to hide it behind a tool call. This creates a circularity issue: the agent needs to "remember to remember." Think how screwed…
I wish more comp sci curricula would sprinkle in more general courses in logic and especially 20th century analytic philosophy. Analytic philosophy is insanely relevant to many computer science topics especially AI.
I've been thinking lately about how AGI runs up against the No Free Lunch Theorem. This is what irritates me: science is not determining the narrative. Money is. I highly recommend mathematician David Wolpert's work on…
Diffusion is just the logically most optimally behavior for searching massively parallel spaces without informed priors. We need to think beyond language modeling however and start to view this in terms of drug…
Years ago, in my writings I talked about the dangers of "oracularizing AI". From the perspective of those who don't know better, the breadth of what these models have memorized begins to approximate omniscience. They…
I think the answer to the professor's dismay is quite simple. Many people are in university to survive a brutal social darwinist economic system, not to learn and cultivate their minds. Only a very small handful of them…
The author makes good general points but seems to be overloading MCP's responsibilities imo. My understanding of MCP is that it just provides a ready-made "doorway" for LLMs to enter and interact with externally managed…
I can see why some fields would have an overwhelmingly negative reaction to AI but I simply can't grasp why some software devs are. The entire point of the field is to get computers to do stuff for you. I've been doing…
Research = revenue if you figure out the right idea.
I think the author has a point. LLMs struggle with what you might call epistemically constructive novelty. It's the ability not just to synthesize existing knowledge, but to identify what's missing and conjecture…
You've got to do piecemeal validation steps yourself, especially for models like Sonnet 3.7 that tend to over-generate code and bury themselves in complexity. Windsurf seems to be onto something. Running Sonnet 3.7 in…
>There is no real thinking involved. It’s just math >Implying I'll never understand this "They're just learning from past experience and making predictions!" argument, as if that doesn't constitute thinking in some…
This post sounds like it wants to be a manifesto but really doesn't add up to much and lacks punch. Getting away from the algos is untenable if you use the mainstream internet in any capacity. The trick is to be more…
The role of LLMs in research is an ongoing, well, research topic of interest of mine. I think it's fine so long as a 1. a pair of human eyes has validated any of the generated outputs and 2. The "ownership rule": the…
It seems like an engineering problem to me. If you don't want ASI wreaking havoc, maybe don't hook it up to dangerous things. Silo and sandbox it, implement means to lock its access to tools/interface with the external…
Interesting. I've been slowly coming to the conclusion that the way forward with machine learning is actually less "machine learning" as we've grown accustomed with it, less pretraining, less data, less search, more…
This is very cool and definitely a step in the right direction, however, the question remains where exactly this formalizing module should be placed in the stack. As an external api, it's clear that the model is not…
I see what you mean. Sometimes I intentionally divulge certain information in the hopes that I will influence the dominant LLM's outputs and thereby surreptitiously influence humanity. It's obviously a stretch but if…
My take: over success breeds complacency. Apple knows where its money is coming from. It has carved out an extremely hard to establish hardware production chain via iphone and macbooks, and is able to provide a certain…
I have enormous respect for Penrose and that is a very dramatic intro but I think he's venturing a little to far into philosophy for not having a specialist background. Godel himself had his quirky beliefs about the…
Interesting work but this strikes me as a somewhat quixotic fight against inevitable tendencies of statistical models. Reinforcement learning has a single goal, an agreeable mean. Reinforcement learning stops when the…
I think there's a critical flaw with Anthropic's approach to memory which is that they seem to hide it behind a tool call. This creates a circularity issue: the agent needs to "remember to remember." Think how screwed…
I wish more comp sci curricula would sprinkle in more general courses in logic and especially 20th century analytic philosophy. Analytic philosophy is insanely relevant to many computer science topics especially AI.
I've been thinking lately about how AGI runs up against the No Free Lunch Theorem. This is what irritates me: science is not determining the narrative. Money is. I highly recommend mathematician David Wolpert's work on…
Diffusion is just the logically most optimally behavior for searching massively parallel spaces without informed priors. We need to think beyond language modeling however and start to view this in terms of drug…
Years ago, in my writings I talked about the dangers of "oracularizing AI". From the perspective of those who don't know better, the breadth of what these models have memorized begins to approximate omniscience. They…
I think the answer to the professor's dismay is quite simple. Many people are in university to survive a brutal social darwinist economic system, not to learn and cultivate their minds. Only a very small handful of them…
The author makes good general points but seems to be overloading MCP's responsibilities imo. My understanding of MCP is that it just provides a ready-made "doorway" for LLMs to enter and interact with externally managed…
I can see why some fields would have an overwhelmingly negative reaction to AI but I simply can't grasp why some software devs are. The entire point of the field is to get computers to do stuff for you. I've been doing…
Research = revenue if you figure out the right idea.
I think the author has a point. LLMs struggle with what you might call epistemically constructive novelty. It's the ability not just to synthesize existing knowledge, but to identify what's missing and conjecture…
You've got to do piecemeal validation steps yourself, especially for models like Sonnet 3.7 that tend to over-generate code and bury themselves in complexity. Windsurf seems to be onto something. Running Sonnet 3.7 in…
>There is no real thinking involved. It’s just math >Implying I'll never understand this "They're just learning from past experience and making predictions!" argument, as if that doesn't constitute thinking in some…
This post sounds like it wants to be a manifesto but really doesn't add up to much and lacks punch. Getting away from the algos is untenable if you use the mainstream internet in any capacity. The trick is to be more…
The role of LLMs in research is an ongoing, well, research topic of interest of mine. I think it's fine so long as a 1. a pair of human eyes has validated any of the generated outputs and 2. The "ownership rule": the…
It seems like an engineering problem to me. If you don't want ASI wreaking havoc, maybe don't hook it up to dangerous things. Silo and sandbox it, implement means to lock its access to tools/interface with the external…
Interesting. I've been slowly coming to the conclusion that the way forward with machine learning is actually less "machine learning" as we've grown accustomed with it, less pretraining, less data, less search, more…
This is very cool and definitely a step in the right direction, however, the question remains where exactly this formalizing module should be placed in the stack. As an external api, it's clear that the model is not…
I see what you mean. Sometimes I intentionally divulge certain information in the hopes that I will influence the dominant LLM's outputs and thereby surreptitiously influence humanity. It's obviously a stretch but if…
My take: over success breeds complacency. Apple knows where its money is coming from. It has carved out an extremely hard to establish hardware production chain via iphone and macbooks, and is able to provide a certain…
I have enormous respect for Penrose and that is a very dramatic intro but I think he's venturing a little to far into philosophy for not having a specialist background. Godel himself had his quirky beliefs about the…