Here a case study that happened due to AI written code [0] all because it also read the comments and changed a single keyword based on the comment and the tests still passed.
Yes, you don’t write tests based on the implementation. You tell it to write tests based on the specification, which must exist, because it cannot read your mind.
4 comments
[ 0.23 ms ] story [ 21.2 ms ] threadThe article is painfully obviously AI-written.
Here a case study that happened due to AI written code [0] all because it also read the comments and changed a single keyword based on the comment and the tests still passed.
Yet that still caused an outage.
[0] https://sketch.dev/blog/our-first-outage-from-llm-written-co...