Show HN: Crunching 1,200 Authors' Favorite Reads of 2023 (shepherd.com)
I launched Shepherd.com on a Show HN in April 2021 (https://news.ycombinator.com/item?id=26871660), and it has come a long way.
My goal with Shepherd is to create an experience that feels like wandering your local bookstore, along with little notes from authors & experts sharing why each book is one of their all-time favorites.
For 2023, I surveyed 1,200+ authors to get their three favorite reads of the year. Then I crunched that data and broke it by genre, age range, and when it was published. Publisher data is a nightmare, so some of the genres are not perfect; I am working on improving that and some of the NLP/ML that drives this.
Check out their top sci-fi reads: https://shepherd.com/bboy/2023/science-fiction
Or, their top nonfiction reads: https://shepherd.com/bboy/2023/nonfiction
You can also zoom in on each author’s favorite 3 reads.
Louise Carey - https://shepherd.com/bboy/2023/f/louise-carey
Kevin Klehr - https://shepherd.com/bboy/2023/f/kevin-klehr
Alice C. Hill - https://shepherd.com/bboy/2023/f/alice-c-hill
Sara Ackerman - https://shepherd.com/bboy/2023/f/sara-ackerman
My email is ben@shepherd.com if you want to share ideas or suggestions for 2024.
Thanks, Ben
P.S. I have a newsletter for readers here where I share what I am building, new features, my fav book lists: https://forauthors.shepherd.com/newsletter-for-readers
79 comments
[ 3.5 ms ] story [ 172 ms ] thread(As an aside, always happy to see "A Gentleman in Moscow" appear in anything to do with "best book" lists!)
I do have a "by the author" list but only for each individual book: for example, here you can see all the recommendations by authors for A Gentlemen in Moscow and click to see the book list it came from: https://shepherd.com/book/a-gentleman-in-moscow
A Gentlemen in Moscow is one of the most recommended books on the entire website.
It also shows how disparately people read. No doubt because every year there are thousands of new titles.
The top non-fiction book has 8 readers from 1200.
If you asked 1200 people what TV shows they had been watching there would be much more overlap.
I bet if you asked about music you would get even less agreement.
This is the first year I've done this, and I was surprised at how widely authors reads. I had expected authors to read wider than most readers but visualizing it still surprised me. I've still got ~250 authors votes to add to the system in the next few weeks.
What I am very curious to graph in 20224 when I do this, is how many of the books published in 2023 show up at the "most read books in 2024". IE, how long does it take for those to pop?
For 2024 I am hoping to 2x to 3x how many authors take part. And I am looking at possibly adding reader votes as well but with a very different format. I need to see if I have enough money to be able to build that this year as that has some tech challenges.
1. Use links, when there’s a list, I open links in new tabs that I want to check. This is some kind of JS-only app that doesn’t have links, only JS behavior. Please don’t break the browser for no good reason, this makes it really hard to actually use the site.
2. Get a better source for the book data:
> What is this book about?
> Read the award-winning, critically acclaimed, multi-million-copy-selling science-fiction phenomenon - soon to be a Netflix Original Series from the creators of Game of Thrones.
> 15+ pages of new, original content, including a glossary of terms, in-universe writings, and more!
> A USA Today Best-Selling Novel!
> "Unlike anything I've ever read. " --V.E. Schwab
> "Lesbian necromancers explore a haunted gothic palace in space!" --Charles Stross
> "Brilliantly original, messy and weird straight through." --NPR
Almost everything I checked had a bunch of absolutely useless marketing blurbs at the top, maybe one or two paragraphs of explaining what the book is about at the end, but not even always that. I don’t know how accessible it is, but goodreads tends to have descriptions without those blurbs.
Yep, this is on my list to do for next year. I just ran out of time to do that this year (this is the first year I've done this).
I will also rethink what data I show for 2024 as I want to better show which authors picked which books visually.
> 2. Get a better source for the book data:
I wish there were a better source; book data is a nightmare. There is only one source of book data and that is the publishers through a format called ONIX. The publishers have no idea what they are doing, and so they stuff the book's "description" full of marketing crap as well as abuse the BISAC-defined genres :(. Goodreads has an army of unpaid people who clean this all up.
I am looking at rewriting the book's description using AI as it seems like it is the only choice to get rid of that nonsense without a ton of manual work (since I don’t have user accounts to crowdsource that).
Genre miscategorization is harder, I am playing with AI to help me clean that up, but also thinking about using crowdsourcing some of that.
Just one example: I found several editions of Dune that report they were published in the 1780s and 1880s... and this is a book selling millions of copies a year.
Great news for 1. ;)
[0]: https://openlibrary.org
AI could indeed help with that.
But if you're publishing a books-of-the-year list, you could also check the categorisation manually - especially if you adjust the inclusion criteria to give you a tractable number of books.
For some datasets, 4 hours of manual classification will do a better job than 40 hours of trying-to-get-the-AI-to-work :)
For sites I use regularly that have problematic UIs like this, I write TamperMonkey userscripts (yes, I have quite a lot of them at this point).
This does properly describe Gideon The Ninth, by Tamsyn Muir.
Also it seems if I filter to 2023 published most of the books have very few people. It might be better to ask for 3 books for each category (optionally of course).
For example, a publisher will say a book is in categories of AI, Sci-Fi, Fantasy, and Space Opera. AI is a nonfiction category so that instantly tags it fiction and nonfiction. And the internet they have doing this often doesn't know the difference between sci-fi and fantasy. It is a mess.
On the plus side, this is the first I am learning of Project Hail Mary, and definitely plan to give it a read. Thank you for compiling this list!
So my hope is that as I keep growing this every year that we get a very wide selection even if a lot of classics also popup :).
The Red Rising series is also very good.
I highly recommend anything by Adrian Tchaikovsky. His themes and ideas are deep and fascinating. https://www.amazon.com/stores/Adrian-Tchaikovsky/author/B002... (Children of Time Series, Dogs of War and City of Last Chances are great). Him and Dan Simmons are my favorite new(ish) authors. If you haven't read the Hyperion quadrilogy, it's my favorite sci-fi series ever.
I hate to be that guy, but I find Andy Weir's books to be very simple and 'light' sci-fi. Fun reads but usually suffers from the protagonist being a genius and smart aleck. No deep themes or characters. I never understood the crazy appeal after reading all of Asimov and Arthur C Clarke. Personally I want giant themes, huge space operas, complex characters and long storylines!
I agree with your take that Andy Weir's writing can feel a bit lacking - at least in the Martian. But I was willing to give him a bit of a pass based on how the story was originally self-published in serial form. My hope is that Project Hail Mary will be a bit more refined - but even if it reads just like the Martian, I am definitely interested to give it a read.
And a more recent one about Django which touches on Shepherd: https://salomvary.com/django-the-good-the-bad-and-the-ugly.h...
but.. I am not liking the recommendations. I consider The Midnight Library to be one of the worst books I have read this year, but it has highest ratings in Sci Fi beating Project Hail Mary By Andy Weir and Klara and the Sun By Kazuo Ishiguro
https://shepherd.com/bboy/2023/science-fiction
Everyone loves books for different reasons, it is something I am hoping to start peeling apart in future years. I find that Midnight Library is enough traditional sci-fi so it pulls a different type of reader. So you get a lot of non-sci-fi readers who love it. I hope it is a gateway drug :)
Try the sections on space opera, cyberpunk, and hard sci fi... they are usually going to be more hardcore.
I would love a more inclusive, multilingual culture, but I’m not sure qualifying sentences to refer to the language they’re written in is the right place to start?
hacker news is a discussion board attached to a startup accelerator based in silicon valley. it's only global because many people find the content that's *already here* valuable.
Allow me to respectfully disagree: they are not. The dominance of US culture around the world, for the best and for the worst, is a fact of life for all of us who live outside it. If you look at the rates of translation of books from and to English, you will immediately see where the center and the periphery lie.
Going through some the biggest countries by population: China, India, Indonesia, Pakistan, Brazil, Nigeria, Bangladesh, Russia, Mexico, Japan, Iran, UK, Germany, France, which one would you say would have a big to moderate US cultural influence? I would say UK, Mexico, and to a lesser degree Germany, and then France, everything else hardly?
Book publishing looks also healthy in a lot of countries https://en.m.wikipedia.org/wiki/Books_published_per_country_...
- US presidents
- US pop artists
- US filmmakers
- US cities
- US CEOs
- US companies
- US TV shows
I stopped there but I could go on for long. Now, take any country X other than the US and ask a random resident of any of the other countries to name just one of each category: a president of X, a CEO, a film, etc... If you think the answer has any chance to compete with the equivalent question asked of the US, well, I think you don't realize how big the cultural influence of the US is. What is domestic news in the US is still news in the rest of the world, but the reverse is simply not true.
Of course a random Indonesian would know Indian, Chinese, and French presidents, and vice versa. Young people I see hype up Korean bands. Chinese, Japanese, German, French and Indian companies are well known and highly influential (Ant, Tata, Huawei, all car brands, Samsung, Sony, Nintendo, …). Who are US filmmakers that are more known than non-US ones, Spielberg and Nolan?
Your experience is obviously vastly different. Let’s just not state it as fundamental truth.
I don’t understand what there is to hate. If I was visiting a site written entirely in French I would have zero expectation that any book list would clarify that the books are French language. What game is being played?
Of course we all know the books are going to be written in English. I am not trying to ask for an idiot-proof label stating the obvious lest a reader might waste a click expecting German-language books.
The point I am trying to make is that the word "book" in the dominant anglosphere has come to mean almost exclusively books coming from an English-speaking country (and even among those I'm sure the proportions are skewed towards the US/UK, although I would be happy to be disproved). So if I discuss "books" in an English conversation (English being the language we are all forced to speak globally now) it is often implicitly expected that we are discussing those books, the books of the anglosphere. Some food for thought, less than 1% of books read in the US are translations[0], which is not the case in other countries (if only because a lot of countries read a lot of translated books from.. English).
> If I was visiting a site written entirely in French I would have zero expectation that any book list would clarify that the books are French language
This comment seems to assume that all languages are equal and interchangeable; they are not. This is maybe hard to realize from within the English-speaking global culture, but other languages are now vassals of English. What I'm saying is that it would be a small act of acknowledgement of this hegemony to remember what is being left out of the conversation.
[0] https://lithub.com/why-do-americans-read-so-few-books-in-tra...
To the larger point, I understand what you are saying. The world is moving toward one global language, and that has pros and cons. My hope is it has more pros than cons, but we could also be losing or minimizing some very special aspects of culture/thinking that language impacts. I think about this a lot as I live in Portugal, and I am likely moving to France in 2024.
I was just reading this NY Times about this type of thing happening within French today: https://www.nytimes.com/2023/12/12/world/africa/africa-frenc...
For a native speaker, it’s obvious. For the rest of the world that speaks English as a second language, there is no such implication; most content we consume and platforms we visit online is in English, and the language also serves as a common denominator between speakers of several foreign languages, where the only shared one is English. Hence, we absolutely use English platforms to discuss non-English content.
Sadly books accessible in the US / English language is slowly becoming synonymous with general availability, through no fault of the US/UK or other English speaking countries. A huge amount of books are simply never translated to language with smaller markets. I can read English just fine, but an entire book is a struggle. There are so many books that I want to read, mostly non-fiction, and they are never going to be translated and even when they are circulation is low and reprints are rare. Normally I can read a book in Danish in about a week, depending on the time available, and English book is normally about three to four weeks.
To be clear: I solely blame Danish publishers and bookshops. They churn out crime/detective novel at an absolutely insane pace. Want to read about someone being killed and have the murder investigate by an alcoholic Scandinavian cop, the Danish publishers have you covered. Want to read "Meditations" in Danish, well screw you. Want to read the most popular book on this list, Demon Copperhead, well to bad. Slaughterhouse-Five you can get, for more than three times the price of the English version.
I get this is probably different for Chinese, German, French or Spanish, but for smaller language you either read what everyone else reads or you read English language books.
It's true that translations are costly, so instead they opt to push books they know will sell well, but the supermarkets sell those exact same books. It's just that without a large selection there's no reason to specifically go to a bookstore and so they die out.
A side note I want to add to this: copyright and other IP laws make sure a lot more money goes from Denmark to the US than from the US to Denmark. I think smaller cultural domains are loosing in a sense. European movie makers constantly need grants where Hollywood booms.
Depends on the market I guess. I've checked the availability of the top 10 books of 2023 on Shepherd (https://shepherd.com/bboy/2023) in Hungary, which is a tiny market of ~10 million people. 50% of the books are available in in translated version, which I think is not terrible.
- another Ben
My wish is that the book blurbs were better. For instance I click on Demon Copperhead to learn "What is this book about?" And what I see is "*A SUNDAY TIMES BESTSELLER* WINNER OF THE PULITZER PRIZE FOR FICTION TWICE WINNER OF THE WOMEN'S PRIZE ..."
That's marketing garbage (in all caps, no less) that doesn't tell me anything about what the book actually is.
I imagine you're pulling this summary from the publisher's website or somewhere similar. Not sure how to automate a more useful blurb. FWIW, Goodreads starts "Set in the mountains of southern Appalachia, this is the story of a boy born to a teenaged single mother in a single-wide trailer..." which is much more what I was looking for.
I am working to fix this and have AI clean it up.
Goodreads relies on an army of unpaid labor :), GoodReads librarians fix a lot of that type of stuff.
It seems you are asking them for the top 3/5 in a niche category? It’s not clear to me if you ask for books in the category or in general for 2023 or both. For example I saw one author giving a list of the top books on Leonardo da Vinci in 2023. This would make aggregation of limited value, and the first thing I am presented with is a list of books which have reached some kind of consensus amongst authors, but the lack of consensus was quite surprising before I found out how it worked!
I think there is a lot of value in getting an author's consensus of best reads, and then maybe secondarily including books from a niche interest. This would be a value-add for the author too, since there is more diversity of books.
Nice project, I wish you the best of luck with it.
Right now, I have two formats:
The first is a 5 book list where an author/expert recommends 5 books around a theme, topic, or mood. I've got 10,000 of those on the website that I have done with authors over the last 2.5 years. This one has nothing to do with the best books of the year and is an entirely different setup.
I just added this "favorite 3 reads" of the year, and that is where they pick their favorite 3 reads from the last 12 months. So I take their reads and then try to classify it to these categories on the best books of the year page (plus it fills into other parts of the website).
Does that make sense?
The idea is I am going to collect super high quality votes from authors, and then find cool ways to help readers connect with topics, genres, and eventually themes. And just kinda wander the virtual shelves. Slowly getting there...