oh that actually helps a lot. I was tying myself in knots trying to think it through.
Knuth originally defining them https://dl.acm.org/doi/10.1145/1008328.1008329
that's not the convention I know... (from CLRS algorithms book). Big O is sort of like <=. little o is sort of like <. https://dl.acm.org/doi/10.1145/1008328.1008329
dang, that's exactly what it is. I was not expecting someone to recognize it! This also made me smile :-)
Agreed. I generally feel pretty comfortable with letting LLMs implement stuff like individual functions or algorithms. But I feel like it takes some effort to make sure separate things stay separated... (I do think it…
at least IME, chrome was unusable on Mac because it would regularly use an absurd amount of memory and freeze everything up.
but we only download the giant binary blobs from trusted actors, such as sam Altman and Elon musk!!
I think nature sort of has a reputation for sensationalism / probably overhyped (or outright wrong) stuff in the sciences now anyway... would not surprise me at all that they're desperate for ml stuff :-I
I feel like ultimately the journal / conference system of "submit pdf and never be able to update it" doesn't make sense in 2026. - In a lot of fields, the "deliverable" could just be a git repo. - Results could /…
I think part of the issue is that there is basically no downside to having bad papers. In ML conferences, I think the only paper I have ever seen retracted was because some of the authors had an affiliation with a…
IMO, yes a lot of the "nvidia pays lots of people to make non-portable, tightly coupled backends to open source projects" is potentially going to be less of a moat? (Though it could turn into "nvidia pay lots of people…
A recent review of mine had a LLM-ism at the very end, "would you like me to format this into a formal peer review report?" So they very likely copy-pasted their whole review :). I'm pretty down on academia atm ;-;
I can't help but feel like all the tech glasses are basically a way to get more ai training data where they can get like a constant stream of human POV stuff.
I know in electrical engineering / chip design, it's actually quite hard to do "real" research that's useful for industry simply because of how expensive it is to make chips... I think most research for improving LLMs…
yeah, it would be almost shocking if an open source benchmark was NOT used ~somewhere in training. Perhaps just pre-training, but still. Neural networks can be fairly robust to some mistakes in their training data, so…
I agree the combined masters + phd is weird tbh. I think almost everyone treats it like "just focus on research and spend as little time on course work as possible." I would prefer it if courses were more flexible. I'm…
1. US a lot of international PhD applicants, so traveling before even being accepted is difficult, and 2. lots of people don't do a masters. when I applied to PhD programs (not in math) it was basically CV + personal…
I think people probably assume that openai / anthropics use of their data is probably like google's """limited""" use, in the sense that historically google wouldn't trivially be able to just take something from google…
numpy is pretty much all C and python. They may dispatch to some Fortran libraries, but I think basically all the internal implementations they have are C. IIRC, scipy does (did?) actually use a lot of fortran fwiw.
I sort of wish they used c++ for some of the template stuff, especially since the code base already seems to have some C++ iirc. I also contributed a tiny bit in the past, and their C template system was a surprise.…
does this sort of fall into the bucket of counter-examples we've been seeing recently? I understand it's a construction causing blowup and that implies that the navier-stokes isn't regular / smooth, so sort of a counter…
if there's anything that would convince that LLMS are one of the biggest innovations ever, it would be this :-D
[dead]
guaranteed, up to lean itself having bugs that are exploited by the LLM :shrug:
":-o omg our autonomous agents are more powerful than we could have imagined"
oh that actually helps a lot. I was tying myself in knots trying to think it through.
Knuth originally defining them https://dl.acm.org/doi/10.1145/1008328.1008329
that's not the convention I know... (from CLRS algorithms book). Big O is sort of like <=. little o is sort of like <. https://dl.acm.org/doi/10.1145/1008328.1008329
dang, that's exactly what it is. I was not expecting someone to recognize it! This also made me smile :-)
Agreed. I generally feel pretty comfortable with letting LLMs implement stuff like individual functions or algorithms. But I feel like it takes some effort to make sure separate things stay separated... (I do think it…
at least IME, chrome was unusable on Mac because it would regularly use an absurd amount of memory and freeze everything up.
but we only download the giant binary blobs from trusted actors, such as sam Altman and Elon musk!!
I think nature sort of has a reputation for sensationalism / probably overhyped (or outright wrong) stuff in the sciences now anyway... would not surprise me at all that they're desperate for ml stuff :-I
I feel like ultimately the journal / conference system of "submit pdf and never be able to update it" doesn't make sense in 2026. - In a lot of fields, the "deliverable" could just be a git repo. - Results could /…
I think part of the issue is that there is basically no downside to having bad papers. In ML conferences, I think the only paper I have ever seen retracted was because some of the authors had an affiliation with a…
IMO, yes a lot of the "nvidia pays lots of people to make non-portable, tightly coupled backends to open source projects" is potentially going to be less of a moat? (Though it could turn into "nvidia pay lots of people…
A recent review of mine had a LLM-ism at the very end, "would you like me to format this into a formal peer review report?" So they very likely copy-pasted their whole review :). I'm pretty down on academia atm ;-;
I can't help but feel like all the tech glasses are basically a way to get more ai training data where they can get like a constant stream of human POV stuff.
I know in electrical engineering / chip design, it's actually quite hard to do "real" research that's useful for industry simply because of how expensive it is to make chips... I think most research for improving LLMs…
yeah, it would be almost shocking if an open source benchmark was NOT used ~somewhere in training. Perhaps just pre-training, but still. Neural networks can be fairly robust to some mistakes in their training data, so…
I agree the combined masters + phd is weird tbh. I think almost everyone treats it like "just focus on research and spend as little time on course work as possible." I would prefer it if courses were more flexible. I'm…
1. US a lot of international PhD applicants, so traveling before even being accepted is difficult, and 2. lots of people don't do a masters. when I applied to PhD programs (not in math) it was basically CV + personal…
I think people probably assume that openai / anthropics use of their data is probably like google's """limited""" use, in the sense that historically google wouldn't trivially be able to just take something from google…
numpy is pretty much all C and python. They may dispatch to some Fortran libraries, but I think basically all the internal implementations they have are C. IIRC, scipy does (did?) actually use a lot of fortran fwiw.
I sort of wish they used c++ for some of the template stuff, especially since the code base already seems to have some C++ iirc. I also contributed a tiny bit in the past, and their C template system was a surprise.…
does this sort of fall into the bucket of counter-examples we've been seeing recently? I understand it's a construction causing blowup and that implies that the navier-stokes isn't regular / smooth, so sort of a counter…
if there's anything that would convince that LLMS are one of the biggest innovations ever, it would be this :-D
[dead]
guaranteed, up to lean itself having bugs that are exploited by the LLM :shrug:
":-o omg our autonomous agents are more powerful than we could have imagined"