Clarification: Regarding the Performance of IQuest-Coder-V1 (github.com) 1 points by bbatsell 8mo ago ↗ HN
[–] bbatsell 8mo ago ↗ Anchor to new information (HN strips it from the URL): https://github.com/IQuestLab/IQuest-Coder-V1/issues/14#issue...Context: Earlier this week a new model was released and researchers discovered that during training it had "cheated" on SWEBench by issuing git commands to find information it should have been blinded to.Previous discussion: https://news.ycombinator.com/item?id=46472667
1 comment
[ 43.4 ms ] story [ 38.5 ms ] threadContext: Earlier this week a new model was released and researchers discovered that during training it had "cheated" on SWEBench by issuing git commands to find information it should have been blinded to.
Previous discussion: https://news.ycombinator.com/item?id=46472667