Ask a model if code is malicious and it reaches for its morals (manifold.security) 2 points by codyznash 25d ago ↗ HN
[–] prasadvara 25d ago ↗ This is great writeup, can we do a cross comparison with "human" experts?? whether models perform better OR worse?? [–] LambdaComplex 25d ago ↗ This writeup reads like it was written by Claude, which makes me immediately question its accuracy.> Each dot is one code sample; bars mark the median. The split between malicious and benign packages, perfect before the prune, was perfect after.People do not write like this.
[–] LambdaComplex 25d ago ↗ This writeup reads like it was written by Claude, which makes me immediately question its accuracy.> Each dot is one code sample; bars mark the median. The split between malicious and benign packages, perfect before the prune, was perfect after.People do not write like this.
[–] cortesoft 25d ago ↗ I feel like LLMs really highlight the ambiguity and imprecision of the english language in normal use. LLMs are getting really good at guessing what we mean, but it is still a guess.
4 comments
[ 3.1 ms ] story [ 203 ms ] thread> Each dot is one code sample; bars mark the median. The split between malicious and benign packages, perfect before the prune, was perfect after.
People do not write like this.