Ask HN: How do you save and browse external interesting URLs?
But over time, I forget. I don't know what I know, and as soon as I need something like, I google it. For example, it could be the 10th time I google "efficient logging with Python". I may come across a link I already clicked, or not.
To me, it would be much more efficient to be able to search among all my external resources I already read and decided to keep, because it is limited to quality contents that I have already filtered, and that I already read, so that memory will activate when I read it another time.
At that point, you could tell me to use bookmarks. And it's what I do. Then 6 months later, I end up with 200 bookmarks I will not sort. And even if they were sorted, I will be too slow to find something in them with no tagging, I and I would use Google anyway.
In a ideal world, It would be easy to save and tag external resources (one click from the browser), and then, browse and find them back easily.
Do you have this feeling too, or it's just me? If so, what do you use for this?
68 comments
[ 3.2 ms ] story [ 144 ms ] threadI’m using raindrop.io to save all the bookmarks in one place, and then while working on them I go through the top of the unsorted bookmarks, and select the ones I will feature in the newsletter.
This still doesn’t solve the problem of heaps of unsorted links (over 1.4k after around 3 years).
If I was to do something that you describe, I would probably look into dedicating some time into organizing your bookmarks, and if taking it to the next level then I would consider using TriliumNotes for making notes and categorizing the knowledge.
When I click on the extension's icon (or right-click > Save to Keep), a draft note pops up with the page link in the body of the note, as well as any text selected on the page prior to clicking the icon.
From there I can add more text to the body, insert a title, and add or select a tag. Once the note is in Keep more features are available, such as attaching an image or archiving the note to move it out of the way. And the note is accessible and searchable from any device.
1. you often don't know what resources you will really "value" in the future, so no more "to save or not to save, this is the question"
2. tagging, to be effective, requires discipline (thinking about then sticking to an agile system). So, we just replace it with search, preferably NLP/AI (so you don't have to remember the exact keywords)
Apps do exist, from the expensive [1] to the experimental [2].
[1] https://heyday.xyz/
[2] https://github.com/karlicoss/promnesia
1. Capture: every interesting idea that I think up or read is immediately stored in Google Keep (on mobile or laptop). It can be very rough at this point, the goal is simply to not forget.
2. Transcribe & Organize: every weekend, I go through the notes I accumulated during the week. It tends to be between 10 and 30 notes. Sometimes the note is "read this article" or "catch up on all newsletters", so understanding a single note can take over an hour. On some tough weekends the process takes an entire day, but that is invariably a day where I feel like I learned a ton. Once the note is cleaned up (transcribed), I feel like I understand it. At this point I rarely forget it - it has been absorbed into my brain. The final step here is "categorizing" the note. I classify it using OneNote with tabs like "Clinical psychology" (nested under "Psychology") or "Investment management" (nested under "Finance") or "Math" or "Physics". This way, in the future, I don't have a million notes scattered around, but one clear place I know where to look. On average, this process takes 2-4 hours per weekend. I never accumulate bookmarks, Google Keep notes or unread emails more than a week to prevent existential dread.
3. Revisit: generally, people recommend you revisit your notes from time to time. I almost never do this. But if I ever am thinking about "Marketing" or "Sociology", I have an immense, high SNR repository of everything I've ever found valuable on the topic. I've done this for software interviews and it's been incredibly helpful.
Overall, I attribute this system to making me much smarter. It has been an invaluable investment.
https://news.ycombinator.com/item?id=25302365
I use Logseq, and I have a sandbox for the particular day. Using Tagging, I can have a #inbox #interest - or any sort of sorting, and then create queries for pages where I process that reading when it's tied to a project. A lot of them never end up being read, and as they go further down the list, they become less important to me.
1) for any article, I save to read later. I used to use Pocket for many years, but recently switched to the new readwise reader. This makes it easy to search later.
2) if it’s a website or service/repo I want to be able to find later, I often screenshot it on the iPhone, and that’s it. The only downside is that you end up with a lot of screenshots in your camera roll. But now it’s quite easy to search for any text and the new iPhone automated OCR works incredibly well. I also sync all these images to google photos, which also lets you search for text in the images.
If it’s a resource that I want to refer back to (like how to do something or a tool I found interesting) I keep it in Drafts in a resource workspace appropriately tagged. If it’s a resource I keep and share a lot, I move it into Obsidian and write text around it to make sharing easy.
If it’s a longer item — say a paper that’s building my knowledge in a subject area — I move it into DEVONThink and annotate.
I do need to recall and reuse things and I find having different tools and workflows for different kinds of information helps me.
There are over 10k of such files I've saved in this manner. With practice it becomes second nature to categorize and tag them just using the filename, which makes them findable within seconds.
These have become like my own private search engine, without the issue of not being able to find answers to queries you know exist (which increasingly has become an issue with online search engines).
In Chromium the saving to MHTML feature is enabled by launching the browser with the CLI argument `--save-page-as-mhtml` (Vivaldi browser enables this by default without any arguments needed). Firefox used to support it via excellent addons up until their Quantum update but they haven't supported it since and is a dealbreaker to my daily use of it.
Often when searching for a specific thing, be it technical queries, useful reviews, troubleshooting, etc, it can take many, many searches and looking through pages before finding something worthwhile, at which point I'll save it (and name it with keywords for future me) since the effort required to even find it is not worth repeating. I'm not sure how such save everything utilities would make that part easier when I wish to return to the relevant page in the future (ie: finding the relevant page, among all the pages that aren't relevant when they share so many similar internal keywords).
https://addons.mozilla.org/en-GB/firefox/addon/single-file/
Back when Firefox supported the UnMHT addon it would also work on Firefox for Android and had the nice feature of being able to customize which replacement Unicode was used for illegal filename characters (instead of just using underscores like Chromium does and SingleFile says it does).
Btw the comparison table of SingleFile mentions MHTML can't be 'unzipped' to extract the resources but there is an open source program on Windows which can extract the resources called ExtractMHT[1], which later became bundled with Universal Extractor.
[1] https://www.legroom.net/software/extractmht
It felt good to "catalog" all this knowledge but in reality I never went back to it, just like bookmarks and I realized that if something is important enough I'll always be able to re-find or re-download almost everything I ever found.
Not feeling like you have to catalog and store everything in personal knowledge management apps is very liberating.
[1] https://joplinapp.org/clipper
There's a higher likelihood of them being deleted if they can't fit into a folder shared by other bookmarks.
Personally I’ve found it useful to just scroll through it time to time to refresh my memory on what I’ve read/watched/listened to.
Maybe not the most ideal or fancy solution, but it works well for me, even as my note has gotten longer and longer.
As you can see, the harder part is using what you have tagged. If you have a custom menu that you do searches with, it can show matches, and if you keep a history of searches then more frequently used links can be seen first.
You can do all sorts of things with tag hierarchies and other stuff that a browser won't do, so tagging is often saner than thinking of how to make hierarchies using folders in a browser.
But I do sorta like the idea you hint at, of a 1 click "add to my web" with its own personal webcrawler. I'd give it a try.
This gives me a good search history, plus it automatically creates a cache of the page!
https://www.richardosgood.com/posts/yacy-personal-search-eng...
I'm thinking about a script that receives the URL and saves its main content (e.g., using Mozilla's Readability) in a text file. It also stores the URL on the first line and maybe sends a request to Archive.org to take a snapshot of the page and adds its URL to the second line in the file. Then, whenever I need something, I can search the content of those files (I use the Silver Searcher) and find what I'm looking for. If the main content stored in the file is not enough, I can open the original URL or the Archive's snapshot.
I think I won't need to categorize or tag them; searching seems enough to me.
The only difficulty I can think of is that extracting the main content of pages is not easy, and, for example, Mozilla's Readability doesn't work well all the time. It may be required to have a manual process for copying and pasting the data.
I have about 5,000 notes in Evernote. I haven't found a good alternative so far.
[1] https://getpocket.com/en/