yeah, it would be almost shocking if an open source benchmark was NOT used ~somewhere in training. Perhaps just pre-training, but still. Neural networks can be fairly robust to some mistakes in their training data, so…
I agree the combined masters + phd is weird tbh. I think almost everyone treats it like "just focus on research and spend as little time on course work as possible." I would prefer it if courses were more flexible. I'm…
1. US a lot of international PhD applicants, so traveling before even being accepted is difficult, and 2. lots of people don't do a masters. when I applied to PhD programs (not in math) it was basically CV + personal…
I think people probably assume that openai / anthropics use of their data is probably like google's """limited""" use, in the sense that historically google wouldn't trivially be able to just take something from google…
numpy is pretty much all C and python. They may dispatch to some Fortran libraries, but I think basically all the internal implementations they have are C. IIRC, scipy does (did?) actually use a lot of fortran fwiw.
I sort of wish they used c++ for some of the template stuff, especially since the code base already seems to have some C++ iirc. I also contributed a tiny bit in the past, and their C template system was a surprise.…
does this sort of fall into the bucket of counter-examples we've been seeing recently? I understand it's a construction causing blowup and that implies that the navier-stokes isn't regular / smooth, so sort of a counter…
if there's anything that would convince that LLMS are one of the biggest innovations ever, it would be this :-D
[dead]
guaranteed, up to lean itself having bugs that are exploited by the LLM :shrug:
":-o omg our autonomous agents are more powerful than we could have imagined"
I think it's not unreasonable or uncommon for big O to track separate variables without reducing them, just to highlight the (lack of) sensitivity of different parameters.
people should read turboquant's open review comments: https://openreview.net/forum?id=tO3ASKZlok
Yeah, I don't disagree with a registry. Especially for problems that are important to humans or are expensive for AI to prove/disprove. I partly just want to avoid a situation where the volume of hard-to-search-for…
I feel like at a certain point, there's is not necessarily a reason to go through the peer review publication process for some AI proofs. Not because "ai bad," but because at some point AI outputs should probably just…
Panic just makes it sound more real, I think. They were saying stuff like "Eek, our technology is TOO dangerous and advanced and we need to be regulated :-O" when they definitely didn't actually want to be regulated.…
this is part of why I think most researchers get less productive over time... Someone gets some big result during grad school or early career, get some big job from it, and then struggle to get new results of similar…
yeah this is what drives me crazy about LLM writing. Most of the time the prompt has all the info you need and is like maybe a few sentences. Then the LLM expands it into a few paragraphs... I guess if someone is…
I've been using claude while trying to setup a new personal site. It's very nice to be able to say "I want a nice looking menu with links to other pages" and it spits out something good enough. I would feel very weird…
is the kobo store not good/convenient compared to kindle? I thought the kobo store was pretty good, but it is my first and only e-reader.
yeah I was being very hyperbolic (and am on the younger side, so tbh wasn't very aware of a lot the x projects... I think those are even riskier than I meant.) google was probably the worst example for me to use tbh,…
can very much agree about not writing stuff like reductions yourself, unless you have good reason to. but this sort of feels like another "implement everything with <nvidia stuff> and you'll have a great time!! (but…
I really wish there were better options to PMPP... It's by far the most up-to-date book, but I totally agree the writing is sort of bad and some of the code examples are straight up incorrect. So tl;dr, you have at…
I think Jensen Huang said this recently, and I've had a similar opinion for a while, but a lot of companies seem uncreative with how they use their employees. like google probably has >10k people working on stuff like…
it's so great to see people boosting "security" in a way that also just happens to require locking in to big-tech approved apps that send all your data to big-tech so that they can deliver ads to you via your big-tech…
yeah, it would be almost shocking if an open source benchmark was NOT used ~somewhere in training. Perhaps just pre-training, but still. Neural networks can be fairly robust to some mistakes in their training data, so…
I agree the combined masters + phd is weird tbh. I think almost everyone treats it like "just focus on research and spend as little time on course work as possible." I would prefer it if courses were more flexible. I'm…
1. US a lot of international PhD applicants, so traveling before even being accepted is difficult, and 2. lots of people don't do a masters. when I applied to PhD programs (not in math) it was basically CV + personal…
I think people probably assume that openai / anthropics use of their data is probably like google's """limited""" use, in the sense that historically google wouldn't trivially be able to just take something from google…
numpy is pretty much all C and python. They may dispatch to some Fortran libraries, but I think basically all the internal implementations they have are C. IIRC, scipy does (did?) actually use a lot of fortran fwiw.
I sort of wish they used c++ for some of the template stuff, especially since the code base already seems to have some C++ iirc. I also contributed a tiny bit in the past, and their C template system was a surprise.…
does this sort of fall into the bucket of counter-examples we've been seeing recently? I understand it's a construction causing blowup and that implies that the navier-stokes isn't regular / smooth, so sort of a counter…
if there's anything that would convince that LLMS are one of the biggest innovations ever, it would be this :-D
[dead]
guaranteed, up to lean itself having bugs that are exploited by the LLM :shrug:
":-o omg our autonomous agents are more powerful than we could have imagined"
I think it's not unreasonable or uncommon for big O to track separate variables without reducing them, just to highlight the (lack of) sensitivity of different parameters.
people should read turboquant's open review comments: https://openreview.net/forum?id=tO3ASKZlok
Yeah, I don't disagree with a registry. Especially for problems that are important to humans or are expensive for AI to prove/disprove. I partly just want to avoid a situation where the volume of hard-to-search-for…
I feel like at a certain point, there's is not necessarily a reason to go through the peer review publication process for some AI proofs. Not because "ai bad," but because at some point AI outputs should probably just…
Panic just makes it sound more real, I think. They were saying stuff like "Eek, our technology is TOO dangerous and advanced and we need to be regulated :-O" when they definitely didn't actually want to be regulated.…
this is part of why I think most researchers get less productive over time... Someone gets some big result during grad school or early career, get some big job from it, and then struggle to get new results of similar…
yeah this is what drives me crazy about LLM writing. Most of the time the prompt has all the info you need and is like maybe a few sentences. Then the LLM expands it into a few paragraphs... I guess if someone is…
I've been using claude while trying to setup a new personal site. It's very nice to be able to say "I want a nice looking menu with links to other pages" and it spits out something good enough. I would feel very weird…
is the kobo store not good/convenient compared to kindle? I thought the kobo store was pretty good, but it is my first and only e-reader.
yeah I was being very hyperbolic (and am on the younger side, so tbh wasn't very aware of a lot the x projects... I think those are even riskier than I meant.) google was probably the worst example for me to use tbh,…
can very much agree about not writing stuff like reductions yourself, unless you have good reason to. but this sort of feels like another "implement everything with <nvidia stuff> and you'll have a great time!! (but…
I really wish there were better options to PMPP... It's by far the most up-to-date book, but I totally agree the writing is sort of bad and some of the code examples are straight up incorrect. So tl;dr, you have at…
I think Jensen Huang said this recently, and I've had a similar opinion for a while, but a lot of companies seem uncreative with how they use their employees. like google probably has >10k people working on stuff like…
it's so great to see people boosting "security" in a way that also just happens to require locking in to big-tech approved apps that send all your data to big-tech so that they can deliver ads to you via your big-tech…