upvote
As long as you're taking suggestions, since many of the books are quite old, adding a publication date or date range to the search functionality might be nice. I personally would find it very useful since I have a tendency to look for things that are older than year _x_ when researching various things.

Thanks for all the effort put into the site!

reply
Have you considered having a detailed version history for each book (etext)? The process of submitting fixes to typos etc in books involves sending an email (https://www.gutenberg.org/help/errata.html) and although the last time I did this (2011) the fixes did get applied reasonably quickly (couple of days), it all felt a bit opaque. The version history could also include the project (usually PGDP correct?) the etext originated from; that way one would be able to compare against the actual page scans.

I have very mixed feelings about Standard Ebooks and would much prefer being able to use Project Gutenberg directly, but one good thing Standard Ebooks does is that every book has an associated git repository (on GitHub), so it's (in principle) possible to see a history of fixes to the text over time.

reply
We're using git repos internally to keep history for each book. They existed on github for a while, but our implementation was awkward, and too big of project for the volunteer dev team. But it's likely that we'll evolve towards that.
reply
I believe our new-ish CEO Eric Hellman actually did some work on something very similar
reply
That's an interesting idea. not a small feat to accomplish though ...
reply
When I thought about Project Gutenberg I remembered that original brutalist non-design. The current site has been very tastefully updated but looks like it's still very accessible if you turn styles off. Great job!
reply
sadly HN doesn't have a "heart" emoji I could use :D
reply
<3

Less than three is a classic!

reply
Huh that's interesting: 4.5 seconds for the TCP handshake and an additional 9.2 seconds for the TLS handshake. Is this some kind of captcha, since most bots would disconnect before that, so if you complete it once then it knows you're good? (Until the bots catch on of course, but so long as it works it's relatively unintrusive and not discriminatory against uncommon client software (that is, non-Chrome/ium).) The rest of the requests were lightning fast

Edit: welcome to your first comment after 9 years on HN btw, nice to have you here!

reply
I think their site is just slow, potentially because more people than they are used to are trying to view it.

I was unable to load it initially (got an error from firefox) and had to re-attempt. Still slow if one forces a reload (shift-r, etc, to not use local cache).

reply
we are having occasional lows in page speed performance due to LARGE amounts of bot traffic. full disclosure - we've not really been able to resolve this fully/well. Let us know if you have a good idea for how to deal with it
reply
Do you host a torrent?

I have about 50k of the books, I would have used a torrent of just the txt files if it was prominent.

reply
I'm only a small-scale sysadmin but the way that I understand the internet is that you send abuse notifications to the IP address block owner and, if it doesn't get resolved, you block. The whois/rdap database reveals which IPs all belong to the same hosting provider or ISP, so you can summarize that all to one list of IP addrs + timestamps per some time period

The ISP actually knows which subscriber is on that line, can send them notices, block them, terminate them... loads of things that you simply cannot do because you have no relation to this person. And frankly I wouldn't want to need to have a personal relation with every website that I visit; my ISP can reach me if there is anything relevant to continued use of the internet. From personal experience, when I was a teenager, the ISP cutting our household off after an abuse report was an effective way of stopping what I was doing

reply
CF cache?
reply
The book list elements on front page render as both horizontally and vertically scrollable divs on mobile - seems like an opportunity for improvement.

Keep up the good work!

reply
good feedback thanks! Doing an iteration on the homepage design is actually pretty high on the priority list. will keep your feedback in mind!
reply
Any interest in offering PG as a multi-lingual web e-reader in any language?

I've since discontinued hosting it, but happy to add you all and merge into an official PG offering: https://www.reddit.com/r/SideProject/s/VtYKxjrMme

reply
More content visible on various videos I took and posted to X

https://x.com/abal_ai

reply
Thank you for your work. This site is an international treasure.
reply
Thanks for the free work! Project Gutenberg is nice to have :).

On the site I noticed the library boxes have roughly a single extra line causing a scrollbar to appear and the last line to be chopped off https://i.imgur.com/PQ8T0qc.png is there an issues/bug portal to properly submit these kinds of things?

reply
Thank you for being one of the best places on the internet
reply
Oh, my! This does look nice. Thank you for your hard work!
reply
Thanks! We're currently working on a design update of the page of any specific book. Should be online soon (next 1-2 weeks or so)
reply
There's a minor bug with chrome in android where the menu will not close when you tap outside the menu or on the menu link/button
reply
I've messaged the guy who's best suited to fixing this. He'll be on it this weekend
reply
will open an "Issue" for it
reply
I can't say for project Gutenberg specifically, but in general a huge issue I see is OCR errors. What do you all do to address OCR?
reply
Check out Distributed Proofreaders: https://pgdp.net
reply
I didn't realized DP was still around. I used to do it quite a bit, 15 years ago, but OCR has improved considerably since then.
reply
I uploaded a PDF to archive.org that auto-OCRs with plenty of mistakes. I have found no way of updating the entire stack of documents produced. I wonder if Project Gutenberg is similar
reply
Great Work. Thank you. I'm also a programmer. If you are ever short on help, let me know. I would love to contribute.
reply
https://github.com/gutenbergtools

autocat3 and gutenbergsite are repos responsible for generating gutenberg.org

reply
Very cool! Do you have a recommended way for an agent to see an index of the books and epub links?

(I can’t quite tell if that’s an egregious abuse of the site or you’re perfectly fine to share without human eye balls hitting your www?)

reply
Now i'm not associated with gutenberg in any form, but they do have a page for offline consumption:

https://www.gutenberg.org/ebooks/offline_catalogs.html

Perhaps you can find the information you are looking for there.

However if you plan on scraping or otherwise hitting them with a ton of traffic, consider at least to donate a good amount for the traffic you cause them. It ain't free after all.

reply
Donations are always appreciated ;)
reply
Thanks for the answers! Found it:

> All Project Gutenberg metadata are available digitally in the XML/RDF format. This is updated daily (other than the legacy format mentioned below). Please use one of these files as input to a database or other tools you may be developing, instead of crawling or roboting the website.

And strongly consider a donation! (My addition)

https://www.gutenberg.org/ebooks/offline_catalogs.html#the-p...

reply
Check out https://www.gutenberg.org/ebooks/offline_catalogs.html

Don't hit the site with agent. The section furtherst bottom machine readable.

reply
if what you want is all the text, please use the tarball or data files at https://www.gutenberg.org/cache/epub/feeds
reply
not yet, but that's not a bad idea imo. Dealing with Ai crawler traffic is definitely a challenge if that's what you were referring to.
reply
OPDS?
reply
OPDS 2.0 coming RSN. email us if you want to test. OPDS 0.x is currently available (not recommended) by adding .opds to the end of a url
reply
[flagged]
reply
Wanna let you know you’re doing great work and you have my dream job, thanks to the team for everything!
reply
it's not my day job. PG is open-source. I'm "just" a contributor
reply
Oh, right. That makes sense.
reply
[dead]
reply
Thanks so much for the work you and your team do!
reply