The technology is amazing. The marketing around it is a decade ahead of its capability, and the pushiness to make LLMs do what they still can't is just irritating. The question to me is "who is seeing the goal posts?"…
The article severely underestimates deployment times for large, world wide services. Usually the strategy is to have a smaller "blast radius" for deployments and going in stages that are also usually time bound ("let it…
I suspect the entire industry uses "auto-raters", where an agent instance is used to scores the agent's output. The idea is similar in intent as using adversarial networks to train image generation, minus the human…
The existence of a kill switch plus tracking in legislation very likely means the manufacturers wanted to track and sell user data and needed a scapegoat to avoid customer backlash. I would profoundly surprised if we…
I have not read the books, so I guess I'm the target audience. It was very hard to watch. The actors were fine, actually better than fine, but the writing was painful. There are lots of standard adventure and fantasy…
Calling failing to show up or nominate a legal representative to a judicial hearing in a country that offers a ridiculous number of opportunities to appeal as "feud" shows some bias in reporting.
You. don't. say. Really?!? OMG, what an insight! What are they going to say next? That startups also use the good will of the internet to create their IP to then take it private as a way to get free labor? I'm shocked!…
Allegedly Costco has a policy of making their white collar folks work on the floor of their stores and rotate positions before getting to the office, same with McDonalds. I would love to hear from someone with first…
Yes! I still can work on my open floor plan. Let's open the windows and connect to the awesome traffic jam outside.
I wrote last year's benchmark. The clusters are completely different, and so is the workload. Last year's cluster had 300 VMs, which was a much higher price point, and the workload was write only. This benchmark uses…
Hi, The cost we published includes the time to setup the whole cluster, warm up the data nodes, and run for 5 minutes at 1M per second. Our run rate is $281 per hour, which is the same as AWS a couple of years back.…
Hi - I figured you know what you're doing based on the details you picked on. I suspect you'd have way more fun reading the raw logs, but that would make for a post that is incredibly hard to parse. I will try to figure…
Network average utilization was low by design. Keeping it steady was more important than low, though, and harder too. Latency spikes come from Cassandra flushing data to disk (large sequential IO), Java garbage…
Here is the GIST link: https://gist.github.com/ivansmf/6ec2197b69d1b7b26153
This is hilarious - it would have saved me days of work. Here is the GIST with my step by step. https://gist.github.com/ivansmf/6ec2197b69d1b7b26153
I wrote the test - Yep. Tail latency is one of the key things here. And I took 100% of all samples, as opposed to the middle 80% the tool usually reports.
I ran those tests. One of the challenges in benchmarking is to pick the workload, so I chose one our customers do more often. For IO testing I prefer to run FIO tests, and for networking iperf, but unless you do this…
The technology is amazing. The marketing around it is a decade ahead of its capability, and the pushiness to make LLMs do what they still can't is just irritating. The question to me is "who is seeing the goal posts?"…
The article severely underestimates deployment times for large, world wide services. Usually the strategy is to have a smaller "blast radius" for deployments and going in stages that are also usually time bound ("let it…
I suspect the entire industry uses "auto-raters", where an agent instance is used to scores the agent's output. The idea is similar in intent as using adversarial networks to train image generation, minus the human…
The existence of a kill switch plus tracking in legislation very likely means the manufacturers wanted to track and sell user data and needed a scapegoat to avoid customer backlash. I would profoundly surprised if we…
I have not read the books, so I guess I'm the target audience. It was very hard to watch. The actors were fine, actually better than fine, but the writing was painful. There are lots of standard adventure and fantasy…
Calling failing to show up or nominate a legal representative to a judicial hearing in a country that offers a ridiculous number of opportunities to appeal as "feud" shows some bias in reporting.
You. don't. say. Really?!? OMG, what an insight! What are they going to say next? That startups also use the good will of the internet to create their IP to then take it private as a way to get free labor? I'm shocked!…
Allegedly Costco has a policy of making their white collar folks work on the floor of their stores and rotate positions before getting to the office, same with McDonalds. I would love to hear from someone with first…
Yes! I still can work on my open floor plan. Let's open the windows and connect to the awesome traffic jam outside.
I wrote last year's benchmark. The clusters are completely different, and so is the workload. Last year's cluster had 300 VMs, which was a much higher price point, and the workload was write only. This benchmark uses…
Hi, The cost we published includes the time to setup the whole cluster, warm up the data nodes, and run for 5 minutes at 1M per second. Our run rate is $281 per hour, which is the same as AWS a couple of years back.…
Hi - I figured you know what you're doing based on the details you picked on. I suspect you'd have way more fun reading the raw logs, but that would make for a post that is incredibly hard to parse. I will try to figure…
Network average utilization was low by design. Keeping it steady was more important than low, though, and harder too. Latency spikes come from Cassandra flushing data to disk (large sequential IO), Java garbage…
Here is the GIST link: https://gist.github.com/ivansmf/6ec2197b69d1b7b26153
This is hilarious - it would have saved me days of work. Here is the GIST with my step by step. https://gist.github.com/ivansmf/6ec2197b69d1b7b26153
I wrote the test - Yep. Tail latency is one of the key things here. And I took 100% of all samples, as opposed to the middle 80% the tool usually reports.
I ran those tests. One of the challenges in benchmarking is to pick the workload, so I chose one our customers do more often. For IO testing I prefer to run FIO tests, and for networking iperf, but unless you do this…