It is true that every major DB ventor, SQL or not, is smashing the AI/vector keyword on their front pages. In Elastic for example, their vector capabilities have gone from laughable to respectable in a year. Its a lot…
Don't worry. GPT written code gets committed to github (After human review, so its working code only). Github data gets shared with OpenAI (Microsoft). So GPT continues to improve. The recent deterioration is due to…
I think that is extremely obvious, given their interface looks 90% like github. They are trying to branch out into training AI models and running inference themselves. But their costs for inferencing look extremely…
H100s consume like 350W. 3000 H100s = 350kW 350*0.2h = 70kWh, about $20 at $0.3/kWh (lets assume data centers have expensive electrical costs).
H100s are intended to be retailed piecemeal. The big enterprise model is DGX GH200, at $10 mil each. Its just that current supply is extremely short, so the H100s end up only available to big buyers. But that will be…
You really, really don't want to use inferior models where accuracy is a life or death issue.
This seems like a very promising product, a ChatGPT interface, enterprise version, is a large gap in the market. However, this part in your advertising, sounds very dubious:"Credal can be deployed fully on-premise for…
The cutting edge for graphics is all raytracing, and Nvidia still dominates. DLSS3, pathtracing, etc, these are for 'graphics', but heavily dependent on AI post processing, so Nvidia still rules. So in the gaming…
Amazon only has AWS, their retail business isn't worth that much (maybe $200 bil max, given low margins). Online2Offline has mostly a disappointment, as the margins of tech just could not be replicated in offline…
Old people do not like radical new technology. That's not a new observation. It doesn't benefit you to adapt to the new workflow, with all its initial inefficiencies and errors, since you don't get the long term benefit.
Prompt engineering is merely the entry-drug to AI-wrangling. SD has gotten to the point that someone can fine tune a model (LORAs) with 2 days of time and $2 of GPU time. There'll be roles for AI wranglers in every…
This, pediatric and maternity wards are closing en masse in China. Its not because of any laws, its simply because of collapsing fertility rates. The rural doctors generally want to make an escape for the cities with…
The simplest and quickest benchmark is to do a rap battle between GPT-4 and the local models. Copy paste the responses between them to enable the cross-model battle. It is instantly clear how strong the model is…
This, AI more directly competes with service outsourcing than anything else. AI isn't reliable. But is your outsourced team any better? Outsourcing is cheap, but AI is 100 times cheaper. Communicating with AI, via…
Majority of the 'ordinary people' don't care, and don't want to care. They just want to think about their next tourist trip, or getting coffee, or where to get lunch and dinner next. You try talking about the…
The other AI companies also have discords. Midjourney does like biweekly townhalls on discord, from the CEO directly to the interested users. Emad also hangs out on the SD discord. Talk about having a pulse on…
"the training cost is going to be dominated by the inference cost." That's only true for general-mass-consumer models. Companies may want to fine-tune/train their own models, which don't have that many users for their…
"Either you already know the correct answer, making this useless, or you are not competent to utilize its answers because you can’t tell whether it’s about to kill someone with plausible nonsense" Evaluating if an…
Its not 'thanking', its positive signal that GPT's previous outputs were correct, so it should continue doing whatever it was doing. If you say no/bad etc, then GPT will try other approaches.
Even in the absence of AI, what's stopping this friend from going to a quack 'natural therapist'? If Steve Jobs can be fooled, what about an ordinary person? ChatGPT is motivated by sycophancy, humans are motivated by…
That's not required. The Amish have about a 10% defection rate. Their community deliberately allows young people to experience the outside world when they reach adulthood, and choose to return or to leave permanently.…
The Amish are dependent on a technological powerhouse that is the US to survive. They are pacifists themselves, but they are grateful that the US allows them their way of life, they'll be extinct a long time ago if they…
It can write novels... Like a middle schooler can. It has excellent style and tone, but its incapable of creating the most important elements. Motivation, suspense, surprise. The things that actually drive people to…
Two factors here: 1. Journalists don't necessarily want to write about 1 topic for their entire lives either. They can pivot, and its no harder than finding a different job for a journalist. 2. Journalist writers have a…
You are literally demonstrating how substack "does something right to spread your writing beyond your direct network" On substacks, writers own their brands. Their own brand is plastered everywhere on their website.…
It is true that every major DB ventor, SQL or not, is smashing the AI/vector keyword on their front pages. In Elastic for example, their vector capabilities have gone from laughable to respectable in a year. Its a lot…
Don't worry. GPT written code gets committed to github (After human review, so its working code only). Github data gets shared with OpenAI (Microsoft). So GPT continues to improve. The recent deterioration is due to…
I think that is extremely obvious, given their interface looks 90% like github. They are trying to branch out into training AI models and running inference themselves. But their costs for inferencing look extremely…
H100s consume like 350W. 3000 H100s = 350kW 350*0.2h = 70kWh, about $20 at $0.3/kWh (lets assume data centers have expensive electrical costs).
H100s are intended to be retailed piecemeal. The big enterprise model is DGX GH200, at $10 mil each. Its just that current supply is extremely short, so the H100s end up only available to big buyers. But that will be…
You really, really don't want to use inferior models where accuracy is a life or death issue.
This seems like a very promising product, a ChatGPT interface, enterprise version, is a large gap in the market. However, this part in your advertising, sounds very dubious:"Credal can be deployed fully on-premise for…
The cutting edge for graphics is all raytracing, and Nvidia still dominates. DLSS3, pathtracing, etc, these are for 'graphics', but heavily dependent on AI post processing, so Nvidia still rules. So in the gaming…
Amazon only has AWS, their retail business isn't worth that much (maybe $200 bil max, given low margins). Online2Offline has mostly a disappointment, as the margins of tech just could not be replicated in offline…
Old people do not like radical new technology. That's not a new observation. It doesn't benefit you to adapt to the new workflow, with all its initial inefficiencies and errors, since you don't get the long term benefit.
Prompt engineering is merely the entry-drug to AI-wrangling. SD has gotten to the point that someone can fine tune a model (LORAs) with 2 days of time and $2 of GPU time. There'll be roles for AI wranglers in every…
This, pediatric and maternity wards are closing en masse in China. Its not because of any laws, its simply because of collapsing fertility rates. The rural doctors generally want to make an escape for the cities with…
The simplest and quickest benchmark is to do a rap battle between GPT-4 and the local models. Copy paste the responses between them to enable the cross-model battle. It is instantly clear how strong the model is…
This, AI more directly competes with service outsourcing than anything else. AI isn't reliable. But is your outsourced team any better? Outsourcing is cheap, but AI is 100 times cheaper. Communicating with AI, via…
Majority of the 'ordinary people' don't care, and don't want to care. They just want to think about their next tourist trip, or getting coffee, or where to get lunch and dinner next. You try talking about the…
The other AI companies also have discords. Midjourney does like biweekly townhalls on discord, from the CEO directly to the interested users. Emad also hangs out on the SD discord. Talk about having a pulse on…
"the training cost is going to be dominated by the inference cost." That's only true for general-mass-consumer models. Companies may want to fine-tune/train their own models, which don't have that many users for their…
"Either you already know the correct answer, making this useless, or you are not competent to utilize its answers because you can’t tell whether it’s about to kill someone with plausible nonsense" Evaluating if an…
Its not 'thanking', its positive signal that GPT's previous outputs were correct, so it should continue doing whatever it was doing. If you say no/bad etc, then GPT will try other approaches.
Even in the absence of AI, what's stopping this friend from going to a quack 'natural therapist'? If Steve Jobs can be fooled, what about an ordinary person? ChatGPT is motivated by sycophancy, humans are motivated by…
That's not required. The Amish have about a 10% defection rate. Their community deliberately allows young people to experience the outside world when they reach adulthood, and choose to return or to leave permanently.…
The Amish are dependent on a technological powerhouse that is the US to survive. They are pacifists themselves, but they are grateful that the US allows them their way of life, they'll be extinct a long time ago if they…
It can write novels... Like a middle schooler can. It has excellent style and tone, but its incapable of creating the most important elements. Motivation, suspense, surprise. The things that actually drive people to…
Two factors here: 1. Journalists don't necessarily want to write about 1 topic for their entire lives either. They can pivot, and its no harder than finding a different job for a journalist. 2. Journalist writers have a…
You are literally demonstrating how substack "does something right to spread your writing beyond your direct network" On substacks, writers own their brands. Their own brand is plastered everywhere on their website.…