i think it's unfair to assume the labs paying top dollar for cybersecurity engineers somehow have an incompetent bunch of nincompoops running their evals. it's a hard problem! to conduct effective evals, you sometimes…
cool! im @Aaquib111 on github if you would like to credit, but no pressure
why not mask attention and do it all in one forward pass ? tokens belonging to a question can just see that question and the main prompt
i think it's unfair to assume the labs paying top dollar for cybersecurity engineers somehow have an incompetent bunch of nincompoops running their evals. it's a hard problem! to conduct effective evals, you sometimes…
cool! im @Aaquib111 on github if you would like to credit, but no pressure
why not mask attention and do it all in one forward pass ? tokens belonging to a question can just see that question and the main prompt