Related to 2, my company is strongly pushing for developer to have product mentality and be less of just a cog in a machine. I am biased because I have more of a product mentality than other developers, but I think…
This was true circa GPT2, less true after RLHF and not true at all after RLVR. It's trying to model the distribution of outputs most likely to solve the problem, not the average distribution.
Neoliberalism as always screwing up things. But the change is not just cultural, after Friedman et al. came a wave of deregulation and changes in the tax system. Deregulation that allows businesses to get away with bad…
Related to 2, my company is strongly pushing for developer to have product mentality and be less of just a cog in a machine. I am biased because I have more of a product mentality than other developers, but I think…
This was true circa GPT2, less true after RLHF and not true at all after RLVR. It's trying to model the distribution of outputs most likely to solve the problem, not the average distribution.
Neoliberalism as always screwing up things. But the change is not just cultural, after Friedman et al. came a wave of deregulation and changes in the tax system. Deregulation that allows businesses to get away with bad…