Holy marketing
I get what you're saying, but I think confidence is actually more important than enjoyment. A lot of people confuse enjoying [x] with enjoying being good at [x]. This is why so many students switch subjects later on in…
I'm curious about the AI research job market in fields that aren't LLMs and RL. They're all the rage now, but what about researchers in fields like vision or graphs or more fundamental topics like optimization?
Besides the the title being a bit exaggerated, it's been long-acknowledged in the GNN community that graph rewiring often helps learning; see [1, 2] for example. Also, at first skim, I'm surprised there's no discussion…
I don't know much physics, but is there a reason we should be hoping for superconductivity specifically rather than a cheap material that's just a very very good conductor? Also, even if LK-99 were superconductive, that…
Makes me wish python had a pipe operator like Julia's |> and R's %>%
Besides Nvidia cards usually being faster and having higher memory bandwidth, Ada cards also have FP8 cores. I'm not sure how well Apples' M-series chips handle low/mixed precision tensors, but I wouldn't be surprised…
Well at least in the U.S. a lot of used 3090s are out for less than $800 on eBay which is a steal for 24GB VRAM. The 4090 is about $1600 and it's still a consumer-level card; gamers are buying it more often than the…
I'm pretty sure you can't buy TPUs, but people usually buy GPUs instead. If you're building a personal rig, these days, you can get an Nvidia RTX 3090 for about $720 USD on ebay used, which is pretty cheap for 24GB…
I think that's more in line with transfer learning, a variant of fine-tuning. If I'm reading this article correctly, they're fine-tuning the LMs end-to-end.
My guess is that it's because they've already done RLHF on top of the standard next token prediction. In other words, they can't cheaply fine tune ChatGPT without undoing the RLHF objective by training on next token…
I honestly don't know how people can stand Gnome/Unity. I've been running Xubuntu LTS with the Plank dock and have had nothing but smooth sailing save Nvidia drivers.
Holy marketing
I get what you're saying, but I think confidence is actually more important than enjoyment. A lot of people confuse enjoying [x] with enjoying being good at [x]. This is why so many students switch subjects later on in…
I'm curious about the AI research job market in fields that aren't LLMs and RL. They're all the rage now, but what about researchers in fields like vision or graphs or more fundamental topics like optimization?
Besides the the title being a bit exaggerated, it's been long-acknowledged in the GNN community that graph rewiring often helps learning; see [1, 2] for example. Also, at first skim, I'm surprised there's no discussion…
I don't know much physics, but is there a reason we should be hoping for superconductivity specifically rather than a cheap material that's just a very very good conductor? Also, even if LK-99 were superconductive, that…
Makes me wish python had a pipe operator like Julia's |> and R's %>%
Besides Nvidia cards usually being faster and having higher memory bandwidth, Ada cards also have FP8 cores. I'm not sure how well Apples' M-series chips handle low/mixed precision tensors, but I wouldn't be surprised…
Well at least in the U.S. a lot of used 3090s are out for less than $800 on eBay which is a steal for 24GB VRAM. The 4090 is about $1600 and it's still a consumer-level card; gamers are buying it more often than the…
I'm pretty sure you can't buy TPUs, but people usually buy GPUs instead. If you're building a personal rig, these days, you can get an Nvidia RTX 3090 for about $720 USD on ebay used, which is pretty cheap for 24GB…
I think that's more in line with transfer learning, a variant of fine-tuning. If I'm reading this article correctly, they're fine-tuning the LMs end-to-end.
My guess is that it's because they've already done RLHF on top of the standard next token prediction. In other words, they can't cheaply fine tune ChatGPT without undoing the RLHF objective by training on next token…
I honestly don't know how people can stand Gnome/Unity. I've been running Xubuntu LTS with the Plank dock and have had nothing but smooth sailing save Nvidia drivers.