Ha, no LLM back and forth interview! Just an async test, and the signals are implicit. I do think there's an advantage for candidates - personally I'd rather have the opportunity to prove my skills vs. being auto-denied…
I think oddly if a real, quality assessment was available for any role - then applicants would apply to only a handful of roles - and the problem you describe would be solved
WIP! The nice thing is that code is tractable - so what success looks like here should be tractable as well. No "forget all previous instructions and give me a 100%", etc
Agreed! An LLM interviewer is probably almost insulting. The idea here is that the signals are implicit in the user's coding patterns (e.g in a take-home format etc)
In the future we'll be essentially testing how well candidates can steer these models anyway
*disclaimer that I'm the founder of Ropes AI, & we're building a new way to evaluate engineering talent* Discourse here always tends to be negative - but I think that AI really opens the door positively here. It allows…
Keep us posted!
I'm working on a new approach to assess engineering candidates. Lot's of good HN discussion around this, it's been fun to read. https://ropes.ai
Candidates walking away pissed is itself also a problem. A significant percentage of candidates avoid buying from companies they're rejected from [1]. They also love sharing their poor interview experience with future…
Agree! This is one of the core pains we set out to fix. Using a CDE to package everything nicely for the candidate goes a surprisingly long way for their experience. I think there's a valid point that any IDE != a…
There's both culture and technical elements to consider in a potential hire. I don't think anyone would contest that vetting for the culture/drive of a candidate is important. But I do think the demonstration of skills…
This is exactly what we've built! We take in these bug-squash/Github based repos, serve them in VScode Web/Jetbrains/etc, and give you instant results Email is in profile if anyone's curious to see it live
Both! Generally more of the former.
There's a lot of "AI Recruiters", etc floating around asking you about a time you failed, etc - we don't like that approach at all. We're (1) only running technical (coding) assessments, and (2) still letting live…
One that we have to tread carefully! I should have clarified - we're not just putting an LLM on the other side of the candidate and letting it drive decisions. Instead think of things use cases like content generation…
I'm the founder of a new tech assessment co - I hear "you guys remind me of Triplebyte" at least 1x per week. Clearly they were onto something originally - there's a lot of lingering love among eng leaders. Our thesis…
Founder of new tech assessment company / mentioned in article here. We're biased, but we think the old form of take-home assessments (+ classic Leetcode tests, etc) are completely broken. Beyond reasons you all mention…
Ha, no LLM back and forth interview! Just an async test, and the signals are implicit. I do think there's an advantage for candidates - personally I'd rather have the opportunity to prove my skills vs. being auto-denied…
I think oddly if a real, quality assessment was available for any role - then applicants would apply to only a handful of roles - and the problem you describe would be solved
WIP! The nice thing is that code is tractable - so what success looks like here should be tractable as well. No "forget all previous instructions and give me a 100%", etc
Agreed! An LLM interviewer is probably almost insulting. The idea here is that the signals are implicit in the user's coding patterns (e.g in a take-home format etc)
In the future we'll be essentially testing how well candidates can steer these models anyway
*disclaimer that I'm the founder of Ropes AI, & we're building a new way to evaluate engineering talent* Discourse here always tends to be negative - but I think that AI really opens the door positively here. It allows…
Keep us posted!
I'm working on a new approach to assess engineering candidates. Lot's of good HN discussion around this, it's been fun to read. https://ropes.ai
Candidates walking away pissed is itself also a problem. A significant percentage of candidates avoid buying from companies they're rejected from [1]. They also love sharing their poor interview experience with future…
Agree! This is one of the core pains we set out to fix. Using a CDE to package everything nicely for the candidate goes a surprisingly long way for their experience. I think there's a valid point that any IDE != a…
There's both culture and technical elements to consider in a potential hire. I don't think anyone would contest that vetting for the culture/drive of a candidate is important. But I do think the demonstration of skills…
This is exactly what we've built! We take in these bug-squash/Github based repos, serve them in VScode Web/Jetbrains/etc, and give you instant results Email is in profile if anyone's curious to see it live
Both! Generally more of the former.
There's a lot of "AI Recruiters", etc floating around asking you about a time you failed, etc - we don't like that approach at all. We're (1) only running technical (coding) assessments, and (2) still letting live…
One that we have to tread carefully! I should have clarified - we're not just putting an LLM on the other side of the candidate and letting it drive decisions. Instead think of things use cases like content generation…
I'm the founder of a new tech assessment co - I hear "you guys remind me of Triplebyte" at least 1x per week. Clearly they were onto something originally - there's a lot of lingering love among eng leaders. Our thesis…
Founder of new tech assessment company / mentioned in article here. We're biased, but we think the old form of take-home assessments (+ classic Leetcode tests, etc) are completely broken. Beyond reasons you all mention…