Fast as in time-to-market
Not common in Silicon Valley, but much more common in the rest of the country. There’s an archetype for bootstrapped tech businesses: - highly vertical specific - couple hundred million TAM - founder started the…
It’s a tensor stored in GPU memory to improve inference throughput. Check out the PagedAttention (which introduces vLLM) paper for how most systems implement it nowadays.
They slightly restructure their MoE [1], but I think the main difference is that other big models (e.g Llama 504B) are dense and have higher FLOP requirements. MoE should represent a ~5x improvement. FP8 should be about…
You can easily do a fermi estimate based on the information given. They are comparing GPU hours. See: https://planetbanatt.net/articles/v3fermi.html
I might be missing something, but DeepSeek’s recipe is right there in plain sight. Most of the cost efficiency of DeepSeek v3 seem to be attributable to MoE and FP8 training. DeepSeek R1s improvements are from…
LLMs are inherently bad at this due to tokenization, scaling, and lack of training on the task. Anthropic’s computer use feature has a specialized model for pixel-counting: > Training Claude to count pixels accurately…
Author: @fandzomga Username: fsndz Why try to funnel us to your paywalled article?
Conditionally yes. There are many libraries that cannot be tree shaken for various reasons. Libraries typically need to stick to a subset of full JS to ensure that the code can be statically analyzed.
GraphQL is very powerful when combined with Relay. It’s useless extra bloat if you just use it like REST. The difference between the two technologies is that LangChain was developed and funded before anyone know what to…
To be fair, LLM-based chatbots are much better about this because you don't need to discover the magic incantation to talk to a human. It's a trade-off because that same property introduces the possibility of…
It depends on the business, but the kind of metrics you are talking about are measured and taken seriously. People have absolutely gotten fired for CS quality KPI drops.
While it may not happen for you, “too lazy to look it up” is the vast majority of CS requests. My understanding from talking to a couple of CS execs is that these have been a slam dunk in terms of ROI because CS agents…
> AppStore would be dead on arrival Certainly not. PMF was already established via the jailbreaking scene and Installer.app / Cydia. Millions of people went through the annoying processing of jailbreaking their phone to…
Yes, this is a fundamental weakness with LLMs. Unfortunately this is likely unsolvable because the search space is exponential. Techniques like beam search help, but can only introduce a constant scaling factor. That…
They fall under a few buckets: Driver: - node-postgres - node-mysql2 Query Builder / Other thin clients: - knex - kysely - slonik ORM: - TypeORM - MikroORM - Objection.js - DrizzleORM - Prisma (actually runs a separate…
Its a two sided marketplace and companies only care about the conversion they get from different channels. If demand dries up, it will be reflected in more attractive pricing - I don’t think it’s likely that the entire…
I was thinking about this too, but the wife of an actor and someone two years out of her masters were not the caliber people that should have been on the board of an $80B company. I would expect people with backgrounds…
Firing a CEO is an extraordinary measure only taken in dramatic situations. Yes, the board can do it, but the legal and reputation risks are such that at the very least you let the CEO resign and pass the torch down.
You’re right - the board construction is remarkably bad. Seems like it was a classic case of centralizing power by stuffing the board with relative nobodies.
Mexico has been a victim of corruption since before it was a nation. Its political system under the Spanish was designed for efficient resource extraction and labor exploitation. Its home-grown system in the 1930's was…
I agree it's complex. I'm not blaming the US. Like most problems in the world, it's a result of circumstance, not because there's a bad guy. It's not like there's a magical solution to market forces applying to drugs.…
I'm not even sure how Mexico manages to dig itself out. The only way to root out the cartels seems to just hope that the US figures out how to manage its drug market. It's a pity - Mexico is so rich in culture but is…
I’ve never understood ESG funds. 1) It’s hard to reliably turn ESG goals into fair (non-gameable) portfolio metrics to incentivize funds 2) LPs still want funds to make returns, so even if they define good metrics, they…
Smart bulbs are a PITA anyways. If you just need on/off/dim (most people) a Lutron Caseta based system is way more reliable and you don't need to worry about unintuitive light switches.
Fast as in time-to-market
Not common in Silicon Valley, but much more common in the rest of the country. There’s an archetype for bootstrapped tech businesses: - highly vertical specific - couple hundred million TAM - founder started the…
It’s a tensor stored in GPU memory to improve inference throughput. Check out the PagedAttention (which introduces vLLM) paper for how most systems implement it nowadays.
They slightly restructure their MoE [1], but I think the main difference is that other big models (e.g Llama 504B) are dense and have higher FLOP requirements. MoE should represent a ~5x improvement. FP8 should be about…
You can easily do a fermi estimate based on the information given. They are comparing GPU hours. See: https://planetbanatt.net/articles/v3fermi.html
I might be missing something, but DeepSeek’s recipe is right there in plain sight. Most of the cost efficiency of DeepSeek v3 seem to be attributable to MoE and FP8 training. DeepSeek R1s improvements are from…
LLMs are inherently bad at this due to tokenization, scaling, and lack of training on the task. Anthropic’s computer use feature has a specialized model for pixel-counting: > Training Claude to count pixels accurately…
Author: @fandzomga Username: fsndz Why try to funnel us to your paywalled article?
Conditionally yes. There are many libraries that cannot be tree shaken for various reasons. Libraries typically need to stick to a subset of full JS to ensure that the code can be statically analyzed.
GraphQL is very powerful when combined with Relay. It’s useless extra bloat if you just use it like REST. The difference between the two technologies is that LangChain was developed and funded before anyone know what to…
To be fair, LLM-based chatbots are much better about this because you don't need to discover the magic incantation to talk to a human. It's a trade-off because that same property introduces the possibility of…
It depends on the business, but the kind of metrics you are talking about are measured and taken seriously. People have absolutely gotten fired for CS quality KPI drops.
While it may not happen for you, “too lazy to look it up” is the vast majority of CS requests. My understanding from talking to a couple of CS execs is that these have been a slam dunk in terms of ROI because CS agents…
> AppStore would be dead on arrival Certainly not. PMF was already established via the jailbreaking scene and Installer.app / Cydia. Millions of people went through the annoying processing of jailbreaking their phone to…
Yes, this is a fundamental weakness with LLMs. Unfortunately this is likely unsolvable because the search space is exponential. Techniques like beam search help, but can only introduce a constant scaling factor. That…
They fall under a few buckets: Driver: - node-postgres - node-mysql2 Query Builder / Other thin clients: - knex - kysely - slonik ORM: - TypeORM - MikroORM - Objection.js - DrizzleORM - Prisma (actually runs a separate…
Its a two sided marketplace and companies only care about the conversion they get from different channels. If demand dries up, it will be reflected in more attractive pricing - I don’t think it’s likely that the entire…
I was thinking about this too, but the wife of an actor and someone two years out of her masters were not the caliber people that should have been on the board of an $80B company. I would expect people with backgrounds…
Firing a CEO is an extraordinary measure only taken in dramatic situations. Yes, the board can do it, but the legal and reputation risks are such that at the very least you let the CEO resign and pass the torch down.
You’re right - the board construction is remarkably bad. Seems like it was a classic case of centralizing power by stuffing the board with relative nobodies.
Mexico has been a victim of corruption since before it was a nation. Its political system under the Spanish was designed for efficient resource extraction and labor exploitation. Its home-grown system in the 1930's was…
I agree it's complex. I'm not blaming the US. Like most problems in the world, it's a result of circumstance, not because there's a bad guy. It's not like there's a magical solution to market forces applying to drugs.…
I'm not even sure how Mexico manages to dig itself out. The only way to root out the cartels seems to just hope that the US figures out how to manage its drug market. It's a pity - Mexico is so rich in culture but is…
I’ve never understood ESG funds. 1) It’s hard to reliably turn ESG goals into fair (non-gameable) portfolio metrics to incentivize funds 2) LPs still want funds to make returns, so even if they define good metrics, they…
Smart bulbs are a PITA anyways. If you just need on/off/dim (most people) a Lutron Caseta based system is way more reliable and you don't need to worry about unintuitive light switches.