That's helpful context, thanks. Unfortunately I cannot edit my original comment, but good to know.
Never forget https://news.ycombinator.com/item?id=8863 > 1. For a Linux user, you can already build such a system yourself quite trivially by getting an FTP account, mounting it locally with curlftpfs, and then using…
It's a problem with a long tail, and it very much depends on what objective you're optimizing for. In search at least, you aim for "good" and "better", but will never achieve "perfect". It's a pretty interesting space…
if you have a task that is easy to split, make a python script that runs on a subset of the task, split into N subsets, and write one output per process? Once they all complete, join together the outputs. Maybe…
The software support just isn't there. The drivers need work, the whole ecosystem is built on CUDA not OpenCL, etc. Not to say someone that tries super hard can't do it, e.g. https://github.com/DTolm/VkFFT .
What's even better is that net zero isn't doing anything for _already emitted carbon_, or the already accumulated heat energy. We can get to net zero and average temperature is still going to keep rising.
These vectors are lower-dimensional than traditional vectors though, aren't they? Vector embeddings are in the hundreds to low thousands range of dimensions (roughly between 128-1024), whereas TF-IDF has the same…
IMO there are many Americans who would work in IT/Tech if you paid them to do it, but the risk calculation doesn't currently make sense. If you're an adult making $25-35/hour in your current job, just meeting…
Perhaps more precisely: the defacto Apache-as-runtime + PHP model simplifies a ton of things. Namely your request state is created and destroyed all within the context of a single process, and you don't have to reason…
PHP has some excellent ideas that other languages can't replicate, while at the same time having terrible ideas that other languages don't have to think about. Overall a huge fan of modern PHP, thanks for this writeup.
Get a few RPis and get https://k3s.io/ running on them. Get familiar with kubectl. Deploy a few apps to your cluster, tail some logs, restart containers, scale them, etc. Install Prometheus, get monitoring working, make…
if you apply to roles within finance you'll have a better shot of landing something. Also, do a quick project using k3s and / or docker to get the basics, so it sounds like you know what you're doing. You can be…
You'll need to send much more than 12, try 2-3 a day for a month. Of those, maybe 5% will reply, but it's not bad that bad once you get into the swing of it.
Yeah I've noticed we've done an about-face on degrees in industry. It used to be super legit to drop out. As things get more specialized MS and PhD are seen more favorably now.
Referrals are also not a golden ticket right now. Got a few tossed in the bin, we've got a lot of FAANG engineers on the market right now, companies are scooping them up at bargain rates.
I was in this boat a few months ago, doing a lot of exercises on leetcode legitimately helps, because you can quickly type an ~80-90% solution immediately from memory, and you have a lot of time left over to finish the…
RE point 1: in the actual job these days, we're coding through so many layers of distributed madness that you end up doing YAML/JSON engineering and gluing systems together more than anything, for years on end. A lot of…
That was on GPU, and there are various CPU implementations (e.g. based on Tencent/ncnn) on github that have similar runtime (1-3s / iteration).
Yeah for comparison, `tinygrad` takes a little over a second per iteration on my machine. https://github.com/tinygrad/tinygrad/blob/master/examples/st...
The above project somewhat supports GPUs if you pass the correct GGML compile flags to it. `GGML_CUBLAS` for example is supported when compiling. You get a decent speedup relative to pure C/C++.
Rust's binary search used to be branchless but due to some issues down in LLVM land, the codegen doesn't issue a `cmov` where it should. https://github.com/rust-lang/rust/issues/53823 old branchless version:…
Other fast binary searches https://github.com/sslotin/amh-code/tree/main/binsearch
For extremely low latency, Clojure can be an awkward fit. By default there's a lot of sugar in the syntax, so if you need to be precise about the underlying types of your data and the exact datastructure, you need to…
Sorry to revive an old thread, but I just wanted to add that I did not interview with any FAANGs. All were either startups or at most mid-tier companies. I think the well-funded startups do copy FAANG style interviewing.
Thank you for this anecdote. This is where I am currently at, but I don't feel discouraged at all, I feel up to the challenge! I am finding the process of learning fun and I am in fact improving a ton at the…
That's helpful context, thanks. Unfortunately I cannot edit my original comment, but good to know.
Never forget https://news.ycombinator.com/item?id=8863 > 1. For a Linux user, you can already build such a system yourself quite trivially by getting an FTP account, mounting it locally with curlftpfs, and then using…
It's a problem with a long tail, and it very much depends on what objective you're optimizing for. In search at least, you aim for "good" and "better", but will never achieve "perfect". It's a pretty interesting space…
if you have a task that is easy to split, make a python script that runs on a subset of the task, split into N subsets, and write one output per process? Once they all complete, join together the outputs. Maybe…
The software support just isn't there. The drivers need work, the whole ecosystem is built on CUDA not OpenCL, etc. Not to say someone that tries super hard can't do it, e.g. https://github.com/DTolm/VkFFT .
What's even better is that net zero isn't doing anything for _already emitted carbon_, or the already accumulated heat energy. We can get to net zero and average temperature is still going to keep rising.
These vectors are lower-dimensional than traditional vectors though, aren't they? Vector embeddings are in the hundreds to low thousands range of dimensions (roughly between 128-1024), whereas TF-IDF has the same…
IMO there are many Americans who would work in IT/Tech if you paid them to do it, but the risk calculation doesn't currently make sense. If you're an adult making $25-35/hour in your current job, just meeting…
Perhaps more precisely: the defacto Apache-as-runtime + PHP model simplifies a ton of things. Namely your request state is created and destroyed all within the context of a single process, and you don't have to reason…
PHP has some excellent ideas that other languages can't replicate, while at the same time having terrible ideas that other languages don't have to think about. Overall a huge fan of modern PHP, thanks for this writeup.
Get a few RPis and get https://k3s.io/ running on them. Get familiar with kubectl. Deploy a few apps to your cluster, tail some logs, restart containers, scale them, etc. Install Prometheus, get monitoring working, make…
if you apply to roles within finance you'll have a better shot of landing something. Also, do a quick project using k3s and / or docker to get the basics, so it sounds like you know what you're doing. You can be…
You'll need to send much more than 12, try 2-3 a day for a month. Of those, maybe 5% will reply, but it's not bad that bad once you get into the swing of it.
Yeah I've noticed we've done an about-face on degrees in industry. It used to be super legit to drop out. As things get more specialized MS and PhD are seen more favorably now.
Referrals are also not a golden ticket right now. Got a few tossed in the bin, we've got a lot of FAANG engineers on the market right now, companies are scooping them up at bargain rates.
I was in this boat a few months ago, doing a lot of exercises on leetcode legitimately helps, because you can quickly type an ~80-90% solution immediately from memory, and you have a lot of time left over to finish the…
RE point 1: in the actual job these days, we're coding through so many layers of distributed madness that you end up doing YAML/JSON engineering and gluing systems together more than anything, for years on end. A lot of…
That was on GPU, and there are various CPU implementations (e.g. based on Tencent/ncnn) on github that have similar runtime (1-3s / iteration).
Yeah for comparison, `tinygrad` takes a little over a second per iteration on my machine. https://github.com/tinygrad/tinygrad/blob/master/examples/st...
The above project somewhat supports GPUs if you pass the correct GGML compile flags to it. `GGML_CUBLAS` for example is supported when compiling. You get a decent speedup relative to pure C/C++.
Rust's binary search used to be branchless but due to some issues down in LLVM land, the codegen doesn't issue a `cmov` where it should. https://github.com/rust-lang/rust/issues/53823 old branchless version:…
Other fast binary searches https://github.com/sslotin/amh-code/tree/main/binsearch
For extremely low latency, Clojure can be an awkward fit. By default there's a lot of sugar in the syntax, so if you need to be precise about the underlying types of your data and the exact datastructure, you need to…
Sorry to revive an old thread, but I just wanted to add that I did not interview with any FAANGs. All were either startups or at most mid-tier companies. I think the well-funded startups do copy FAANG style interviewing.
Thank you for this anecdote. This is where I am currently at, but I don't feel discouraged at all, I feel up to the challenge! I am finding the process of learning fun and I am in fact improving a ton at the…