The same way we feed the variable size sequence of characters or sound samples into this RNN. Instead of raw samples at the 16 kHz rate, we'll have one sequence of 1 sample per second, another sequence of 1 sample per…
This proof is largely irrelevant in the real world. An interesting question would be how much can be approximated with a model that has 1 MB worth of weights and can use only relu/tanh/softmax activations.
I don't think every continuous function can be approximated this way because we can make an infinitely complex, but continuous function that would have any n-th derivative also continuous. I'm thinking about those weird…
Of course they can, because an NN can be any function. If we can pick tanh as the "activation" then we can as easily pick arctan as the activation ans say our NN computes arctan. What an achievement! A better question…
It's not so much about the density. It's about ludicrous mortgage that they signed up in past and want their house to at least maintain its price.
It's not the corporations, but the current mortgage system. Corp workers with 100-200k pay pair up and put their entire life earnings (30 years) towards a house. Banks back this deal and the couple gets a house they…
More like a 2M house and a 120K car. 500K/year isn't enough to live in a 10M house because it's 20 years of work (30, accounting for other expenses) and that assumes no cut in income. To get into a 10M house one needs…
The advice that I would give to myself in my early 20s is (1) nobody cares about your career except you: people come and go, change companies and have their own careers; (2) the only way to move up the ranks is by…
It's also far easier for an L4 to get competing offers for amount far exceeding what L5s make. That's also how many (most?) people get the L5 level: they negotiate with HRs when they have the leverage (competing…
650 is L6 which is maybe 5% of the Google's population. The median pay would be around 300.
I don't get this statement. Google doesn't force anyone to work overnight. It doesn't force you to work at all, to be honest. Some people can spend a workday skiing and then arrive at 6 pm for dinner. TC is 400K. And…
The other option is to realize that in the world of people, your people skills can be even more valuable than your technical skills. I think that L5 is the tipping point where people skills start to dominate.
That's because a decent programmer (especially one working at Google) has many companies fighting for him trying to offer more than others. It's usually easy to leave and that often comes with a hefty raise and it will…
I actually think capitalism is the problem. It's the best form we know to organize a society, but it has the serious problem when money tend to stick or gravitate towards bigger chunks of money. I'm making well over…
The same way we feed the variable size sequence of characters or sound samples into this RNN. Instead of raw samples at the 16 kHz rate, we'll have one sequence of 1 sample per second, another sequence of 1 sample per…
This proof is largely irrelevant in the real world. An interesting question would be how much can be approximated with a model that has 1 MB worth of weights and can use only relu/tanh/softmax activations.
I don't think every continuous function can be approximated this way because we can make an infinitely complex, but continuous function that would have any n-th derivative also continuous. I'm thinking about those weird…
Of course they can, because an NN can be any function. If we can pick tanh as the "activation" then we can as easily pick arctan as the activation ans say our NN computes arctan. What an achievement! A better question…
It's not so much about the density. It's about ludicrous mortgage that they signed up in past and want their house to at least maintain its price.
It's not the corporations, but the current mortgage system. Corp workers with 100-200k pay pair up and put their entire life earnings (30 years) towards a house. Banks back this deal and the couple gets a house they…
More like a 2M house and a 120K car. 500K/year isn't enough to live in a 10M house because it's 20 years of work (30, accounting for other expenses) and that assumes no cut in income. To get into a 10M house one needs…
The advice that I would give to myself in my early 20s is (1) nobody cares about your career except you: people come and go, change companies and have their own careers; (2) the only way to move up the ranks is by…
It's also far easier for an L4 to get competing offers for amount far exceeding what L5s make. That's also how many (most?) people get the L5 level: they negotiate with HRs when they have the leverage (competing…
650 is L6 which is maybe 5% of the Google's population. The median pay would be around 300.
I don't get this statement. Google doesn't force anyone to work overnight. It doesn't force you to work at all, to be honest. Some people can spend a workday skiing and then arrive at 6 pm for dinner. TC is 400K. And…
The other option is to realize that in the world of people, your people skills can be even more valuable than your technical skills. I think that L5 is the tipping point where people skills start to dominate.
That's because a decent programmer (especially one working at Google) has many companies fighting for him trying to offer more than others. It's usually easy to leave and that often comes with a hefty raise and it will…
I actually think capitalism is the problem. It's the best form we know to organize a society, but it has the serious problem when money tend to stick or gravitate towards bigger chunks of money. I'm making well over…