I love the general shape of this, of having some semantic record of what you browse. It's been a long goal/dream and this is an interesting neat hack to get there, a path towards that future that hasn't been open until recently.
I haven't run this yet/don't know what the UI looks like (nudge nudge), but looks like this is less for record-keeping? More for finding similar thing to what you are seeing now, although it does have a cached view?
Sending requests to pure.md (?) seems pretty insecure and inefficient to me.
If you're going to MitM yourself, KEEP IT LOCAL, then use reliable code to convert HTML to Markdown efficiently with a queue, drop text parts that are noise, summarise if that's the format desired, and THEN embed!
I made another approach that detects browser tab text changes with a Userscript that sends changes as Markdown to a server that appends to a JSONL file. MitM might be interesting to compare: https://gist.github.com/lukestanley/c3a37ab61a45e72b74995a5c... (two files here BTW)
3 comments
[ 3.3 ms ] story [ 14.9 ms ] threadI haven't run this yet/don't know what the UI looks like (nudge nudge), but looks like this is less for record-keeping? More for finding similar thing to what you are seeing now, although it does have a cached view?