This is exactly the kind of issue that makes me skeptical of LLM-focused tooling. Source control should make the human/LLM distinction less important, not build the workflow around it.
OMG!
We had a probe that checked whether a connection was using post-quantum cryptography. It looked for "Cipher is" in the output. But when the handshake failed, it would print "Cipher is (NONE)." So it reported that…
[flagged]
A monitoring probe of ours matched on the substring "Cipher is" to decide a TLS handshake had succeeded. A failed handshake prints "New, (NONE), Cipher is (NONE)" - which contains it. It reported github.com and…
This is exactly the kind of issue that makes me skeptical of LLM-focused tooling. Source control should make the human/LLM distinction less important, not build the workflow around it.
OMG!
We had a probe that checked whether a connection was using post-quantum cryptography. It looked for "Cipher is" in the output. But when the handshake failed, it would print "Cipher is (NONE)." So it reported that…
[flagged]
[flagged]
[flagged]
[flagged]
[flagged]
[flagged]
[flagged]
[flagged]
[flagged]
A monitoring probe of ours matched on the substring "Cipher is" to decide a TLS handshake had succeeded. A failed handshake prints "New, (NONE), Cipher is (NONE)" - which contains it. It reported github.com and…