I have recently started using hister [0] this index’s everything I read and allows me to half remember bits and have a LLM find it.

[0] https://hister.org/

I've been using Archivebox for years also, but it recent years it started to have multiple issues. My queues are full of pages that failed to scan, and it's been several versions since I actually had anything new there.

I did small amount of troubleshooting a few times with no resolution, but now I'm thinking of switching my thought process. Maybe something like a "web clipper" is much better, as complex SPA pages often fail to archive well anyway. And I should focus on content itself, not the page. That SingleFile extension fits well here as well.

Did you run into similar dilemmas at some point?

I used ArchiveBox for years. It's really good. The self-hosting and maintenance gets annoying after a while though.

Link rot really bothers me and I want people to get into archiving web pages so that eventually there will be a decentralized mirror of the unslopped web sitting on people's hard-drives, ready to share whenever someone needs it. So, I made a worse version of ArchiveBox ( https://memoryhole.app ). My philosophy is that, if people see how it is easy to start archiving and how useful it is, then they'll keep it up with SingleFile, or ArchiveBox or anything else.

SingleFile is great for single pages. All the tweaking I do is enable or disable saving scripts, and it works for >90% of webpages. Output being a single file (heh) simplifies things enormously, there’s no hierarchy or folders to deal with - hard to imagine your saved files not loading or breaking in some way as long as the original capture works.

I haven't tried archivebox, but self-hosted https://karakeep.com/ has been working well for me. When the server-side parsing fails I'll fallback to using SingleFile in my browser which then forwards it to my Karakeep instance.

On MacOS, I use my own built app called HEAP which lets me archive in various formats locally (full page image, pdf, markdown, html, and webarchive) via a single right click of the menu bar button:

https://apps.apple.com/ca/app/heap-website-full-page-image/i...

Disclosure: I am the developer.

Avg bookmark is valid for 5 yrs.

My bookmarks file is a disastrous graveyard as I have 20 yrs’ old ones…

And as a publisher I don’t link fresh sites (don’t even mention Netlify, Lovable, Vercel…) … Vannevar Bush would be surprised how his Xanadu evolved.

I'm using Linkding hooked up with SingleFile to bookmark+archive all important pages. Highly recommend! https://linkding.link/archiving/#using-the-singlefile-browse...

Archivebox annoys me because (as far as I remember) it doesn't have any options for capturing a webpage on your end and uploading it to your self-hosted Archivebox instance. With numerous sites moving to Cloudflare to mitigate AI agent crawling, it makes it really hard (or outright impossible) to capture a page because it wants to do it server side.

[flagged]