The feeling I'm getting is management took such a huge stance (the capex, the name change, etc) on it it'd be humiliating to turn 180 and ditch it now (they've spent 50 billion on Reality Labs so far). So they're…
The only reason I can think that this atrocity got deployed was from an engineering perspective, creating AI profiles to engage theoretically gives FB a powerful lever to increase engagement, because you'd have this…
I'd argue that it hasn't come to pass, but it is not wrong that its a better way to teach. Virtually all education has been set up in an industrial line style of pre-u education -> university -> companies -> profits ->…
I don't think the Biden admin can criticize Xi for cyber warfare with a straight face.
In intelligence/performance. It's admittedly a fuzzy notion. Most benchmarks will probably show decreasing gains between generations. Similar to time/space complexity, trying to debate about what…
We are likely going to get there. Similar to the steam/combustion engines (and other core technologies like computers, wireless transmission etc) there's first a massive rush to increase the power of it, at the cost of…
From the amount of data each successive generation used (which grew many orders of magnitude each time) to the decreasing, logarithmic performance, it's quite clear the steam is running out on shoving more data into it.…
I fear not the man who has written 10,000 features once, but the man who has written 1 feature 10,000 times
Something interesting I heard from a chip company that's huge in the space and work intimately with many automotive companies - why Chinese companies grow so fast is because their development cycle for a car is ~2-3…
If one gets into the weeds of the whole messy thing, the Shanghai Communique acknowledges the position of both sides (Taiwan and China) that there is one China, the 1982 Joint Communique acknowledged the Chinese…
There exists a third possibility where the US and China sign an under the table deal for China to invade, the US to saber rattle and China to allow the flow of chips to continue. The present direction seems to be the US…
That is false equivalence, there's a class of things that should rightfully be discouraged from military use (chemical/biological weapons, land mines, phosphorous weapons) because of the significant harm/side effects…
That seems like a good idea. I am puzzled by what benefit the RL has in OP. It seems like a well defined constraint optimisation problem that could be done without RL, for example in the way you mentioned.
Google is getting enshittified. It's already visible in many small ways. I was just using Google maps and in the route they called X (bus) Interchange as X International. I can only assume this happened because they are…
I'm also wondering this. Two possibilities. One, find the first principles/root node/glue that holds many disparate concepts together in some causative way. Two, the specific procedure/step/concept that you keep reusing…
The initial cram is an interesting concept. If you insert new things to learn at a constant rate, the repetition burden grows logarithmically. Assuming you have some fixed amount of time you can devote everyday…
I'm dubious of its scale and effects. Tech creates exponential value because of aggressive focus, iteration and critical mass of talent. The reserves seems very far from this.
I suspect the actual dollar value of AI from "companionship" far outstrips the value created from the endless junk like Gemini summaries.
Starting from the basics, Ramanujan was known to spend huge amounts of time in the library pouring over mathematical texts. He was also personally and spiritually obsessed with mathematics, thinking it was an expression…
As much as I love Anki there is enormous friction in creating the cards, especially as a beginner. And you very easily get overfitting when you keep seeing the same question.
That is IMO already done by domain experts in the form of textbooks, courses, university classes etc. And with formal, tested relationships between various islands of knowledge. I'm not too sure how much I would trust…
Same for Anki, Notion, Zettelkatsen etc. Even ignoring the setup cost, it costs as much effort to insert in something as it does to retrieve it. The value prop tends to be low for individuals.
Perplexity has a dubious idea based around harvesting user chats -> making service better -> getting more user prompts. I am quite unconvinced that user prompts and stored chats will materially improve an LLM that is…
I'd chime in on a somewhat lesser known part of networks that in practice the real determinant of performance: congestion control. The effects can be on the scale of an order of magnitude or two. The problem of how…
The number of cases AI is used for is too vast to cover, but I do have the same experience. I've a few heuristics about assessing how well AI will work. 1) AI's performance decreases exponentially with the sparsity of…
The feeling I'm getting is management took such a huge stance (the capex, the name change, etc) on it it'd be humiliating to turn 180 and ditch it now (they've spent 50 billion on Reality Labs so far). So they're…
The only reason I can think that this atrocity got deployed was from an engineering perspective, creating AI profiles to engage theoretically gives FB a powerful lever to increase engagement, because you'd have this…
I'd argue that it hasn't come to pass, but it is not wrong that its a better way to teach. Virtually all education has been set up in an industrial line style of pre-u education -> university -> companies -> profits ->…
I don't think the Biden admin can criticize Xi for cyber warfare with a straight face.
In intelligence/performance. It's admittedly a fuzzy notion. Most benchmarks will probably show decreasing gains between generations. Similar to time/space complexity, trying to debate about what…
We are likely going to get there. Similar to the steam/combustion engines (and other core technologies like computers, wireless transmission etc) there's first a massive rush to increase the power of it, at the cost of…
From the amount of data each successive generation used (which grew many orders of magnitude each time) to the decreasing, logarithmic performance, it's quite clear the steam is running out on shoving more data into it.…
I fear not the man who has written 10,000 features once, but the man who has written 1 feature 10,000 times
Something interesting I heard from a chip company that's huge in the space and work intimately with many automotive companies - why Chinese companies grow so fast is because their development cycle for a car is ~2-3…
If one gets into the weeds of the whole messy thing, the Shanghai Communique acknowledges the position of both sides (Taiwan and China) that there is one China, the 1982 Joint Communique acknowledged the Chinese…
There exists a third possibility where the US and China sign an under the table deal for China to invade, the US to saber rattle and China to allow the flow of chips to continue. The present direction seems to be the US…
That is false equivalence, there's a class of things that should rightfully be discouraged from military use (chemical/biological weapons, land mines, phosphorous weapons) because of the significant harm/side effects…
That seems like a good idea. I am puzzled by what benefit the RL has in OP. It seems like a well defined constraint optimisation problem that could be done without RL, for example in the way you mentioned.
Google is getting enshittified. It's already visible in many small ways. I was just using Google maps and in the route they called X (bus) Interchange as X International. I can only assume this happened because they are…
I'm also wondering this. Two possibilities. One, find the first principles/root node/glue that holds many disparate concepts together in some causative way. Two, the specific procedure/step/concept that you keep reusing…
The initial cram is an interesting concept. If you insert new things to learn at a constant rate, the repetition burden grows logarithmically. Assuming you have some fixed amount of time you can devote everyday…
I'm dubious of its scale and effects. Tech creates exponential value because of aggressive focus, iteration and critical mass of talent. The reserves seems very far from this.
I suspect the actual dollar value of AI from "companionship" far outstrips the value created from the endless junk like Gemini summaries.
Starting from the basics, Ramanujan was known to spend huge amounts of time in the library pouring over mathematical texts. He was also personally and spiritually obsessed with mathematics, thinking it was an expression…
As much as I love Anki there is enormous friction in creating the cards, especially as a beginner. And you very easily get overfitting when you keep seeing the same question.
That is IMO already done by domain experts in the form of textbooks, courses, university classes etc. And with formal, tested relationships between various islands of knowledge. I'm not too sure how much I would trust…
Same for Anki, Notion, Zettelkatsen etc. Even ignoring the setup cost, it costs as much effort to insert in something as it does to retrieve it. The value prop tends to be low for individuals.
Perplexity has a dubious idea based around harvesting user chats -> making service better -> getting more user prompts. I am quite unconvinced that user prompts and stored chats will materially improve an LLM that is…
I'd chime in on a somewhat lesser known part of networks that in practice the real determinant of performance: congestion control. The effects can be on the scale of an order of magnitude or two. The problem of how…
The number of cases AI is used for is too vast to cover, but I do have the same experience. I've a few heuristics about assessing how well AI will work. 1) AI's performance decreases exponentially with the sparsity of…