Show HN: Web Ingest – Convert websites to LLM-friendly text (webingest.com)

8 points by chrisnolet 1y ago ↗ HN

I really love Git Ingest, but I needed something more general. So I built this!

It crawls websites and converts each page to Markdown.

It’s great for developer documentation.

And it’s free. I built it over the excellent Jina Reader. I hope you get some use out of it!

2 comments

[ 13.0 ms ] story [ 223 ms ] thread

lord-squirrel 1y ago ↗

Is it open source?

chrisnolet 1y ago ↗

Thanks for trying it! It's not open source, but it is a single-page app. You could download the source and run it locally.

The web app is calling Jina Reader under the hood. If you needed something a little different, it wouldn't be too hard to write a CLI tool to call Jina and achieve similar results.

It's cheap to host, so I'll be leaving this up for the foreseeable future.