I think it's true that our biggest gains vs other agents are in codebase-wide sweeps, because to your point, PR checks are limited in scope. However, there's still value in running Mo on those features because: 1. It…
Thanks for the feedback. - Your first point sounds like a frontend bug to me. I wonder if there's missing revalidation. - Sounds like the defaults need a little more tuning. You can actually update the definition…
Hey there! I'm not 100% sure how many came from Mo originally, but I can add a bit about our process: - The candidate ground truth bugs are generated using runs from all agents - Every candidate gets reviewed by the…
Hey there! This is Henry, one of the engineers working on Mo. Thanks for reading our post! A lot of interesting stuff here: - Precision/recall vs pass/fail: I really like this point, and I would say QA bench is actually…
This sounds a lot like what we call an "AI check" in a regular Momentic test. These work great on known flows, and are actually one of the main reasons a lot of our customers love Momentic. Mo doesn't replace that; it…
Hey there! Sorry to hear that the onboarding experience didn't meet your expectations. Would you mind reaching out to support@momentic.ai and sharing your account details so that we can debug this? We'd love to help you…
Hey! I'm Henry, one of the engineers working on Mo. To answer your questions: - I expect there will be many more competitors to come, as there already are. I also think achieving these performance improvements is…
Update: we just added iOS 27 support. You can select it in the session settings dropdown. Feel free to try it out and let us know what you think!
Thanks! That's fair feedback. We'll update the writeup to make this clearer. We're also hoping to release a v2 benchmark soon with more fixtures and hopefully an even more optimized Mo.
Hey! I'm Henry, one of the engineers working on Mo. Currently, Mo is super focused on being the absolute best at finding bugs, but isn't meant to be a general purpose coding agent. For that we ship a CLI…
Hey! I'm Henry, one of the engineers working on Mo. Let me try to answer some of your questions: 1. We have a lot of proprietary tooling under the hood. This is a big part of the reason why we're able to achieve the…
Hey! I'm Henry, one of the engineers working on Mo. You're looking at the right numbers, but the takeaway is slightly different from ours. The main thing we're trying to show is that Mo finds over 3x as many correct…
Hey! I'm Henry, one of the engineers working on Mo. The approach to testing itself is very similar to UAT, except that it's fully automated. This means you can speed up the feedback loop significantly. Imagine instead…
I think it's true that our biggest gains vs other agents are in codebase-wide sweeps, because to your point, PR checks are limited in scope. However, there's still value in running Mo on those features because: 1. It…
Thanks for the feedback. - Your first point sounds like a frontend bug to me. I wonder if there's missing revalidation. - Sounds like the defaults need a little more tuning. You can actually update the definition…
Hey there! I'm not 100% sure how many came from Mo originally, but I can add a bit about our process: - The candidate ground truth bugs are generated using runs from all agents - Every candidate gets reviewed by the…
Hey there! This is Henry, one of the engineers working on Mo. Thanks for reading our post! A lot of interesting stuff here: - Precision/recall vs pass/fail: I really like this point, and I would say QA bench is actually…
This sounds a lot like what we call an "AI check" in a regular Momentic test. These work great on known flows, and are actually one of the main reasons a lot of our customers love Momentic. Mo doesn't replace that; it…
Hey there! Sorry to hear that the onboarding experience didn't meet your expectations. Would you mind reaching out to support@momentic.ai and sharing your account details so that we can debug this? We'd love to help you…
Hey! I'm Henry, one of the engineers working on Mo. To answer your questions: - I expect there will be many more competitors to come, as there already are. I also think achieving these performance improvements is…
Update: we just added iOS 27 support. You can select it in the session settings dropdown. Feel free to try it out and let us know what you think!
Thanks! That's fair feedback. We'll update the writeup to make this clearer. We're also hoping to release a v2 benchmark soon with more fixtures and hopefully an even more optimized Mo.
Hey! I'm Henry, one of the engineers working on Mo. Currently, Mo is super focused on being the absolute best at finding bugs, but isn't meant to be a general purpose coding agent. For that we ship a CLI…
Hey! I'm Henry, one of the engineers working on Mo. Let me try to answer some of your questions: 1. We have a lot of proprietary tooling under the hood. This is a big part of the reason why we're able to achieve the…
Hey! I'm Henry, one of the engineers working on Mo. You're looking at the right numbers, but the takeaway is slightly different from ours. The main thing we're trying to show is that Mo finds over 3x as many correct…
Hey! I'm Henry, one of the engineers working on Mo. The approach to testing itself is very similar to UAT, except that it's fully automated. This means you can speed up the feedback loop significantly. Imagine instead…