I replaced Firecrawl with 2,700 lines of Elixir

3 points by pipboyguy ↗ HN
I was paying about $190/month for Firecrawl. It worked, but it was expensive and felt half baked. The CLI was awkward to use. Maybe I wasn't using it right, but the whole thing felt like it was in flux. I figured if they vibe coded it I might as well do it myself.

So I vibed my own. 3k lines of Elixir, custom readability engine, no external services. It even manages, for some sites at least, to evade bot protection.

It saves a lot of cash and helps pay the Claude Code Max subscription.

I guess my realization is that you shouldn't just take tooling aimed at AI agents for granted. Code is a commodity now, so a price tag for an MCP tool nearly as much as the most expensive subscription tiers for Claude Code/Codex makes no sense to me.

Just ask your agent to code 80% of the tool for yourself.

4 comments

[ 5.4 ms ] story [ 20.2 ms ] thread
[dead]
Indeed. Though rotating proxies I got from lightpanda hosted. That actually gets me more than you'd think
lightpanda is the most detectable thing ever. A custom built browser with fingerprints any serious antibot instantly blocks.