There are plenty of reasons, some might even be good. But prospects for a positive outcome where probably always slim. IMO, it is particularly dumb when there is a full scale conventional war happening in Ukraine.
Who is to say they won't? For the record, it's not all the big corps that are this bad. Many are borderline paranoid about privacy, both for appearance and compliance perspectives.
The only reason to pick anything but zstd is that platform support might be better. If your platform/sdk/browser/standard-library comes with zlib/gzip/.. then it's often easier to just pick that. No new dependencies is…
JSONL files are likely to have a lot of the same words repeated MANY times. Same as with headers... Because JSON is an inefficient text encoding, compression (with custom dictionary) are likely to really well on those.…
Also people are people and they will get emotionally attached to claude :)
> Parkinson admits now that she is embarrassed by her confrontational demeanor. Which was the real crime. To be fair, many places outside the US not respecting the police is a illegal -- but genuinely not enough that an…
> Honestly, what’s the worst that can happen here? Regulation that cannot practically be implemented or complied with (example: forks of open models), this leads to selective enforcement and by extension corruption and…
To be clear, making pages with bad training data for bots won't make the bots go away. It'll just punish the bad actors running the scrapers. As the original poster mentions that they are using TVs as proxies to get…
200k req/day = 2.3 req/s That's bad for static content. Try adding search, with pagination and 16 filters that can toggled on off. And 1000 tags, give each page 5.
Probably they must be deduplicating text they've seen before. The only punishment would be unique text that trains their models to be degenerate. And even then you'd probably have to serve across many domains.
I've seen this too. I think it's a few bad actors really. Because nobody serious about indexing content will do what these crawlers are doing.. They are consume lots of content that is unoriginal or duplicate or…
They allow you to diff commits, which is an awesome feature. But if bots a crawling diffs between all possible commits it's crazy. CDN will do nothing, because it's new urls each time. You can maybe find a CDN provider…
Or just burn some tokens scanning packages for bad behavior. Granted some human will likely have to review it. Or packages flagged by Al could require users to explicitly allowlist them.
> Corporate NPC That's a really good description, I should update my linkedin profile :)
Sometimes you generalize A into A'. But often results are incremental and obvious. But also if you jumped from A to A''''', nobody would understand why or what it relates to.
We're all biased here, me included. IMO the concurrency model in go is the biggest reason, I'd hesitate to use it. Managed memory, single threaded with lots of lints and good tooling. Is IMO what can raise my confidence…
Software engineering is and has always involved engineering situations where you can let your co-workers/third-parties run wild with limited review oversight and limited blast radius. Example: a plugin architecture with…
> Doesn't that mean guaranteed failure in the market if you use taste as your guiding star? If taste is maintainability, etc.. the no quite the opposite. The startup that has no taste and vibecodes mindlessly might end…
Taste will always be there. But toil is not gone. We have still have code owners, lawyers, physical hardware, thousands of configurations that we can't test them all. And notably: we will still be asked to write…
Selling properties you don't own, ideally land owned by government..
I object! The dashboard clearly says 89.15% uptime! Who says nines need to be leading?
This offers little because while P != NP, in most practical cases it doesn't matter. NP problems gets solved with heuristics every day.
Wouldn't noise be a concern? And what is the failure mode?
Competent government wouldn't do this either... ...also why I think it won't last. Doubtful it'd hold in court; this admin would have to show that it's not corruption, because we'd all assume otherwise.
The specification doesn't have to be. But yeah, writing specs is usually harder than reviewing the code 4 times :)
There are plenty of reasons, some might even be good. But prospects for a positive outcome where probably always slim. IMO, it is particularly dumb when there is a full scale conventional war happening in Ukraine.
Who is to say they won't? For the record, it's not all the big corps that are this bad. Many are borderline paranoid about privacy, both for appearance and compliance perspectives.
The only reason to pick anything but zstd is that platform support might be better. If your platform/sdk/browser/standard-library comes with zlib/gzip/.. then it's often easier to just pick that. No new dependencies is…
JSONL files are likely to have a lot of the same words repeated MANY times. Same as with headers... Because JSON is an inefficient text encoding, compression (with custom dictionary) are likely to really well on those.…
Also people are people and they will get emotionally attached to claude :)
> Parkinson admits now that she is embarrassed by her confrontational demeanor. Which was the real crime. To be fair, many places outside the US not respecting the police is a illegal -- but genuinely not enough that an…
> Honestly, what’s the worst that can happen here? Regulation that cannot practically be implemented or complied with (example: forks of open models), this leads to selective enforcement and by extension corruption and…
To be clear, making pages with bad training data for bots won't make the bots go away. It'll just punish the bad actors running the scrapers. As the original poster mentions that they are using TVs as proxies to get…
200k req/day = 2.3 req/s That's bad for static content. Try adding search, with pagination and 16 filters that can toggled on off. And 1000 tags, give each page 5.
Probably they must be deduplicating text they've seen before. The only punishment would be unique text that trains their models to be degenerate. And even then you'd probably have to serve across many domains.
I've seen this too. I think it's a few bad actors really. Because nobody serious about indexing content will do what these crawlers are doing.. They are consume lots of content that is unoriginal or duplicate or…
They allow you to diff commits, which is an awesome feature. But if bots a crawling diffs between all possible commits it's crazy. CDN will do nothing, because it's new urls each time. You can maybe find a CDN provider…
Or just burn some tokens scanning packages for bad behavior. Granted some human will likely have to review it. Or packages flagged by Al could require users to explicitly allowlist them.
> Corporate NPC That's a really good description, I should update my linkedin profile :)
Sometimes you generalize A into A'. But often results are incremental and obvious. But also if you jumped from A to A''''', nobody would understand why or what it relates to.
We're all biased here, me included. IMO the concurrency model in go is the biggest reason, I'd hesitate to use it. Managed memory, single threaded with lots of lints and good tooling. Is IMO what can raise my confidence…
Software engineering is and has always involved engineering situations where you can let your co-workers/third-parties run wild with limited review oversight and limited blast radius. Example: a plugin architecture with…
> Doesn't that mean guaranteed failure in the market if you use taste as your guiding star? If taste is maintainability, etc.. the no quite the opposite. The startup that has no taste and vibecodes mindlessly might end…
Taste will always be there. But toil is not gone. We have still have code owners, lawyers, physical hardware, thousands of configurations that we can't test them all. And notably: we will still be asked to write…
Selling properties you don't own, ideally land owned by government..
I object! The dashboard clearly says 89.15% uptime! Who says nines need to be leading?
This offers little because while P != NP, in most practical cases it doesn't matter. NP problems gets solved with heuristics every day.
Wouldn't noise be a concern? And what is the failure mode?
Competent government wouldn't do this either... ...also why I think it won't last. Doubtful it'd hold in court; this admin would have to show that it's not corruption, because we'd all assume otherwise.
The specification doesn't have to be. But yeah, writing specs is usually harder than reviewing the code 4 times :)