We used to use this, but it was a broader conversation around tradeoffs to meet different constraints. If the expected array is small, then sort + index is probably fine. If it’s big (bigger than main memory?) and…
My read has been that a lot of leaders were trying to drive “being early” as the catalyst for future success. At the complexity scale of big orgs you’re mostly fiddling with the incentives that the system self-aligns…
Yes, that’s what I think at this point. There is no effect of the study group except as a support group. (That’s all it was for me when I was a student and joined the self-organized study group.)
I used to TA a graduate level CS math class at Georgia Tech. We regularly saw that the students who self-organized study groups did dramatically better in the course than average. One semester they told us to put…
I’m starting to realize that LLMs are really good at building low-stakes projects. Your questions mostly presume that the stakes are higher. The software will last a long time; the requirements will evolve; we can’t…
I just tested this myself. I wrote “flip the reduce white point toggle accessibility option in the settings app” and it worked perfectly. Run once to set it and run again to disable it.
Spreading out the refusal encoding shouldn’t be effective as a countermeasure. Even if it were smeared across the vector space, as long as it’s in a subspace that doesn’t span the entire domain then you should be able…
A much earlier major win for deep learning was AlexNet for image recognition in 2012. It dominated the competition and within a couple years it was effectively the only way to do image tasks. I think it was Jeremy…
I agree, it would be nice if we could prioritize basic human needs rather than treating them like burdens caused by bad luck or poor choices.
Slightly unrelated to this story, but I’m curious if anyone has good resources for learning FreeCAD. I have quite a lot of experience with SolidWorks, AutoCAD, OnShape, and similar software, but FreeCAD has always been…
Eh. I think my point is that the OP is presented as a “how to” (literally: “how to do important research”) and then it immediately dodges the question by saying “have good taste”. That does not help anyone do important…
That seems even less actionable, and somewhat misaligned with the OP article. “Taste” implies an ability to distinguish between a good example and a bad one. If it’s only recognizable in retrospect then it’s just…
I often find this kind of advice too vague to really be useful. “Have taste” in the problems you work on isn’t very actionable. (Unless perhaps you list examples of good and bad taste.) I’ll admit that I may just be…
Any notes on the problems with MLX caching? I’ve experimented with local models on my MacBook and there’s usually a good speedup from MLX, but I wasn’t aware there’s an issue with prompt caching. Is it from MLX itself…
I think this is the actual “bitter lesson”—the scalable solution (letting LLMs bang against the problem nonstop) will eventually far outperform human effort. There will come a point—whether sooner or later—where this’ll…
So…great for prototyping (where velocity rules) but somewhere between mixed to negative for critical projects. Seems like this just puts some mildly quantitative numbers behind the consensus & trends I see emerging.
“Better than me” != “good” I know approximately nothing about approximately everything. Claude seems pretty good at those things. But in every case I’ve used Claude Code for something I do know about it’s been…
I love the way you phrased this.
Best of luck! I hope it’s as amazing for you as it was for me.
I had been working in civil service for the US Navy for about 10 years in operations research & systems engineering. It was very hard to break out of that role to any private industry—especially for the ML roles I…
Nah. There was some of that as the tools available to unis improved alongside Udacity, but it was a very intentional choice. The business with GT made $X/year while the consumer & enterprise businesses brought in…
In 2013-2016 Udacity was very actively collaborating with GT and had in-house content production. The projects were designed by highly experienced instructors in direct partnerships with real companies to make them…
I was also in the first cohort. Graduated in 2016. Transformed my career. 100% would recommend.
I was the head of enterprise curriculum in 2018 and an OMSCS grad in 2016. This was a weird time to work for Udacity and the company went thru a major shakeup in 2019. The “breakup” with GT happened before the focus on…
When I say something like this it usually means “I don’t want to dictate your job to you. You’re here because you’re smart, ambitious, and capable. We’ve talked at length in team settings and 1:1 about our goals. What…
We used to use this, but it was a broader conversation around tradeoffs to meet different constraints. If the expected array is small, then sort + index is probably fine. If it’s big (bigger than main memory?) and…
My read has been that a lot of leaders were trying to drive “being early” as the catalyst for future success. At the complexity scale of big orgs you’re mostly fiddling with the incentives that the system self-aligns…
Yes, that’s what I think at this point. There is no effect of the study group except as a support group. (That’s all it was for me when I was a student and joined the self-organized study group.)
I used to TA a graduate level CS math class at Georgia Tech. We regularly saw that the students who self-organized study groups did dramatically better in the course than average. One semester they told us to put…
I’m starting to realize that LLMs are really good at building low-stakes projects. Your questions mostly presume that the stakes are higher. The software will last a long time; the requirements will evolve; we can’t…
I just tested this myself. I wrote “flip the reduce white point toggle accessibility option in the settings app” and it worked perfectly. Run once to set it and run again to disable it.
Spreading out the refusal encoding shouldn’t be effective as a countermeasure. Even if it were smeared across the vector space, as long as it’s in a subspace that doesn’t span the entire domain then you should be able…
A much earlier major win for deep learning was AlexNet for image recognition in 2012. It dominated the competition and within a couple years it was effectively the only way to do image tasks. I think it was Jeremy…
I agree, it would be nice if we could prioritize basic human needs rather than treating them like burdens caused by bad luck or poor choices.
Slightly unrelated to this story, but I’m curious if anyone has good resources for learning FreeCAD. I have quite a lot of experience with SolidWorks, AutoCAD, OnShape, and similar software, but FreeCAD has always been…
Eh. I think my point is that the OP is presented as a “how to” (literally: “how to do important research”) and then it immediately dodges the question by saying “have good taste”. That does not help anyone do important…
That seems even less actionable, and somewhat misaligned with the OP article. “Taste” implies an ability to distinguish between a good example and a bad one. If it’s only recognizable in retrospect then it’s just…
I often find this kind of advice too vague to really be useful. “Have taste” in the problems you work on isn’t very actionable. (Unless perhaps you list examples of good and bad taste.) I’ll admit that I may just be…
Any notes on the problems with MLX caching? I’ve experimented with local models on my MacBook and there’s usually a good speedup from MLX, but I wasn’t aware there’s an issue with prompt caching. Is it from MLX itself…
I think this is the actual “bitter lesson”—the scalable solution (letting LLMs bang against the problem nonstop) will eventually far outperform human effort. There will come a point—whether sooner or later—where this’ll…
So…great for prototyping (where velocity rules) but somewhere between mixed to negative for critical projects. Seems like this just puts some mildly quantitative numbers behind the consensus & trends I see emerging.
“Better than me” != “good” I know approximately nothing about approximately everything. Claude seems pretty good at those things. But in every case I’ve used Claude Code for something I do know about it’s been…
I love the way you phrased this.
Best of luck! I hope it’s as amazing for you as it was for me.
I had been working in civil service for the US Navy for about 10 years in operations research & systems engineering. It was very hard to break out of that role to any private industry—especially for the ML roles I…
Nah. There was some of that as the tools available to unis improved alongside Udacity, but it was a very intentional choice. The business with GT made $X/year while the consumer & enterprise businesses brought in…
In 2013-2016 Udacity was very actively collaborating with GT and had in-house content production. The projects were designed by highly experienced instructors in direct partnerships with real companies to make them…
I was also in the first cohort. Graduated in 2016. Transformed my career. 100% would recommend.
I was the head of enterprise curriculum in 2018 and an OMSCS grad in 2016. This was a weird time to work for Udacity and the company went thru a major shakeup in 2019. The “breakup” with GT happened before the focus on…
When I say something like this it usually means “I don’t want to dictate your job to you. You’re here because you’re smart, ambitious, and capable. We’ve talked at length in team settings and 1:1 about our goals. What…