It is true that every major DB ventor, SQL or not, is smashing the AI/vector keyword on their front pages. In Elastic for example, their vector capabilities have gone from laughable to respectable in a year. Its a lot…
Don't worry. GPT written code gets committed to github (After human review, so its working code only). Github data gets shared with OpenAI (Microsoft). So GPT continues to improve. The recent deterioration is due to…
I think that is extremely obvious, given their interface looks 90% like github. They are trying to branch out into training AI models and running inference themselves. But their costs for inferencing look extremely…
H100s consume like 350W. 3000 H100s = 350kW 350*0.2h = 70kWh, about $20 at $0.3/kWh (lets assume data centers have expensive electrical costs).
H100s are intended to be retailed piecemeal. The big enterprise model is DGX GH200, at $10 mil each. Its just that current supply is extremely short, so the H100s end up only available to big buyers. But that will be…
You really, really don't want to use inferior models where accuracy is a life or death issue.
This seems like a very promising product, a ChatGPT interface, enterprise version, is a large gap in the market. However, this part in your advertising, sounds very dubious:"Credal can be deployed fully on-premise for…
The cutting edge for graphics is all raytracing, and Nvidia still dominates. DLSS3, pathtracing, etc, these are for 'graphics', but heavily dependent on AI post processing, so Nvidia still rules. So in the gaming…
Amazon only has AWS, their retail business isn't worth that much (maybe $200 bil max, given low margins). Online2Offline has mostly a disappointment, as the margins of tech just could not be replicated in offline…
Meta made the dumb decision to invest in VR, rather than AI. Those giant and expensive VR teams (Or the devs who made horizon worlds...) aren't going to easily transition into AI. AI generated content is the real core…
Old people do not like radical new technology. That's not a new observation. It doesn't benefit you to adapt to the new workflow, with all its initial inefficiencies and errors, since you don't get the long term benefit.
Prompt engineering is merely the entry-drug to AI-wrangling. SD has gotten to the point that someone can fine tune a model (LORAs) with 2 days of time and $2 of GPU time. There'll be roles for AI wranglers in every…
Stop linking paywalled articles. Also, can anyone summarize the differences between milvus and pinecone? And will vector databases remain separate from mainstream normal databases for long? What architecturally is…
This, pediatric and maternity wards are closing en masse in China. Its not because of any laws, its simply because of collapsing fertility rates. The rural doctors generally want to make an escape for the cities with…
The simplest and quickest benchmark is to do a rap battle between GPT-4 and the local models. Copy paste the responses between them to enable the cross-model battle. It is instantly clear how strong the model is…
This, AI more directly competes with service outsourcing than anything else. AI isn't reliable. But is your outsourced team any better? Outsourcing is cheap, but AI is 100 times cheaper. Communicating with AI, via…
Majority of the 'ordinary people' don't care, and don't want to care. They just want to think about their next tourist trip, or getting coffee, or where to get lunch and dinner next. You try talking about the…
The other AI companies also have discords. Midjourney does like biweekly townhalls on discord, from the CEO directly to the interested users. Emad also hangs out on the SD discord. Talk about having a pulse on…
"the training cost is going to be dominated by the inference cost." That's only true for general-mass-consumer models. Companies may want to fine-tune/train their own models, which don't have that many users for their…
"Either you already know the correct answer, making this useless, or you are not competent to utilize its answers because you can’t tell whether it’s about to kill someone with plausible nonsense" Evaluating if an…
Its not 'thanking', its positive signal that GPT's previous outputs were correct, so it should continue doing whatever it was doing. If you say no/bad etc, then GPT will try other approaches.
Even in the absence of AI, what's stopping this friend from going to a quack 'natural therapist'? If Steve Jobs can be fooled, what about an ordinary person? ChatGPT is motivated by sycophancy, humans are motivated by…
That's because you used ChatGPT. Rather than GPT-4. GPT-4 has more parameters, so can remember much more obscure facts. I had GPT-4 analyze the ethics of some obscure japanese visual novel from the perspective of…
Birth is not the limiter, childrearing is. Synthetic wombs are more expensive than just having surrogate mothers. For the same reason that synthetic food is more expensive than bread and cabbage. The actual counter to…
That's not required. The Amish have about a 10% defection rate. Their community deliberately allows young people to experience the outside world when they reach adulthood, and choose to return or to leave permanently.…
It is true that every major DB ventor, SQL or not, is smashing the AI/vector keyword on their front pages. In Elastic for example, their vector capabilities have gone from laughable to respectable in a year. Its a lot…
Don't worry. GPT written code gets committed to github (After human review, so its working code only). Github data gets shared with OpenAI (Microsoft). So GPT continues to improve. The recent deterioration is due to…
I think that is extremely obvious, given their interface looks 90% like github. They are trying to branch out into training AI models and running inference themselves. But their costs for inferencing look extremely…
H100s consume like 350W. 3000 H100s = 350kW 350*0.2h = 70kWh, about $20 at $0.3/kWh (lets assume data centers have expensive electrical costs).
H100s are intended to be retailed piecemeal. The big enterprise model is DGX GH200, at $10 mil each. Its just that current supply is extremely short, so the H100s end up only available to big buyers. But that will be…
You really, really don't want to use inferior models where accuracy is a life or death issue.
This seems like a very promising product, a ChatGPT interface, enterprise version, is a large gap in the market. However, this part in your advertising, sounds very dubious:"Credal can be deployed fully on-premise for…
The cutting edge for graphics is all raytracing, and Nvidia still dominates. DLSS3, pathtracing, etc, these are for 'graphics', but heavily dependent on AI post processing, so Nvidia still rules. So in the gaming…
Amazon only has AWS, their retail business isn't worth that much (maybe $200 bil max, given low margins). Online2Offline has mostly a disappointment, as the margins of tech just could not be replicated in offline…
Meta made the dumb decision to invest in VR, rather than AI. Those giant and expensive VR teams (Or the devs who made horizon worlds...) aren't going to easily transition into AI. AI generated content is the real core…
Old people do not like radical new technology. That's not a new observation. It doesn't benefit you to adapt to the new workflow, with all its initial inefficiencies and errors, since you don't get the long term benefit.
Prompt engineering is merely the entry-drug to AI-wrangling. SD has gotten to the point that someone can fine tune a model (LORAs) with 2 days of time and $2 of GPU time. There'll be roles for AI wranglers in every…
Stop linking paywalled articles. Also, can anyone summarize the differences between milvus and pinecone? And will vector databases remain separate from mainstream normal databases for long? What architecturally is…
This, pediatric and maternity wards are closing en masse in China. Its not because of any laws, its simply because of collapsing fertility rates. The rural doctors generally want to make an escape for the cities with…
The simplest and quickest benchmark is to do a rap battle between GPT-4 and the local models. Copy paste the responses between them to enable the cross-model battle. It is instantly clear how strong the model is…
This, AI more directly competes with service outsourcing than anything else. AI isn't reliable. But is your outsourced team any better? Outsourcing is cheap, but AI is 100 times cheaper. Communicating with AI, via…
Majority of the 'ordinary people' don't care, and don't want to care. They just want to think about their next tourist trip, or getting coffee, or where to get lunch and dinner next. You try talking about the…
The other AI companies also have discords. Midjourney does like biweekly townhalls on discord, from the CEO directly to the interested users. Emad also hangs out on the SD discord. Talk about having a pulse on…
"the training cost is going to be dominated by the inference cost." That's only true for general-mass-consumer models. Companies may want to fine-tune/train their own models, which don't have that many users for their…
"Either you already know the correct answer, making this useless, or you are not competent to utilize its answers because you can’t tell whether it’s about to kill someone with plausible nonsense" Evaluating if an…
Its not 'thanking', its positive signal that GPT's previous outputs were correct, so it should continue doing whatever it was doing. If you say no/bad etc, then GPT will try other approaches.
Even in the absence of AI, what's stopping this friend from going to a quack 'natural therapist'? If Steve Jobs can be fooled, what about an ordinary person? ChatGPT is motivated by sycophancy, humans are motivated by…
That's because you used ChatGPT. Rather than GPT-4. GPT-4 has more parameters, so can remember much more obscure facts. I had GPT-4 analyze the ethics of some obscure japanese visual novel from the perspective of…
Birth is not the limiter, childrearing is. Synthetic wombs are more expensive than just having surrogate mothers. For the same reason that synthetic food is more expensive than bread and cabbage. The actual counter to…
That's not required. The Amish have about a 10% defection rate. Their community deliberately allows young people to experience the outside world when they reach adulthood, and choose to return or to leave permanently.…