25 comments

[ 3.3 ms ] story [ 36.8 ms ] thread
Is MariaDB included in MySQL? I see no mention of it in the post, but MySQL trending downwards would make sense as people upgrade and switch over. Besides of course novelty wearing off as posited for all engines further down the post
Some of the insights match my personal experience and preferences. At $dayjob we're migrating from Mongo to TimescaleDB (now TigerData ¯\_(ツ)_/¯) which is basically a PostgreSQL extension for time series data and couldn't be happier. We are getting better performance and massive storage savings.

On the analytics side of things we are starting to use DuckDB for some development efforts, but we are keen on potentially replacing some or all of our Snowflake usage with DuckDB.

The data query tool linked at the bottom of the post doesn't work for me. Cloudflare shows error 600010, whatever that means. Nice that there is "no login required" but if it did, or allowed that option, maybe it wouldn't need an algorithm to decide whether my traffic is abusive because you could block abusive accounts instead
Sqlite seems to be growing recently which matches my perception, but it‘s not listed among the growing databases. Weird.
>a ClickHouse database of every HN story

I remember downloading it a few years ago, but the bookmark I have is dead. where is it now? is it still public?

the funniest thing about this graph is that it proves there was a raw drop off in all popularities in the last 2 years, which of course directly coincides with the great layoffening that has been happening for almost 3 years now.

this shows that people are definitely rotating out of "web technologies" in general, not because they aren't useful, but because the money isn't there anymore.

perhaps a large chunk have switched to AI hype trains, and it would be interesting to compare raw results of different AI headlines, but i suspect maybe 30% of people have left tech all together.

Snowflake seems to have peaked; 2023 was hellish dealing with roomfuls of inexperienced devs and even architects convinced it was the fastest cheapest thing ever.
Would be great to share the queries. Are these results weighted for storypoints and/or number of comments?
Interesting to see SQL Server not listed here, am curious whether it didn't have enough signal, or suffered from being a two-word product, with "SQL" being far too generic on its own.
More unsolicited feedback: Month-by-month is kind of noisy. You might do 3 month average to smooth it a little and make the trend clearer.
UPDATE: Added a weighted average analysis based on story points and comments. SQLite ranks highest in points per story and Redis ranks highest in comments per post. Also added SQLite to the growth table. I had accidentally deleted this row in the original post.
There's an online playground with the data here: https://play.clickhouse.com/

Wrote up this query:

  SELECT
    db_name,
    sum(if(type = 'comment', 1, 0)) AS comment_mentions,
    sum(if(type = 'story', 1, 0)) AS post_mentions,
    count(*) AS total_mentions,
    sum(score) as total_score
  FROM hackernews
  ARRAY JOIN
    extractAll(replaceAll(LOWER(text), ' ', ''), '(sqlite|postgres|mysql|mongodb|redis|clickhouse|mariadb|oracle|sqlserver|duckdb)') AS db_name
  WHERE toYear(time) >= 2022
  GROUP BY
    db_name
  ORDER BY
    post_mentions DESC;
How are you handling sanitization? Anything interesting?
Absolute drivel. Comparing operational/transactional databases like MongoDB and Postgres to analytics / columnar datastores like Redshift and Snowflake is meaningless. You might as well as say "...the popularity of hammers is way up, with screwdrivers appearing to be in decline..". If this is the type of data analysis that AI is supporting, we're all in trouble.
MS Sql Server not even mentioned. This tells us there is a whole world almost totally omitted from discussion on HN: "Enterprise"
Any commentary on DuckDB from users? I keep hearing about it but am not a user myself. Is it a fad or here to stay?
Is it weird or just me that bigquery is mentioned, but bigtable and spanner are not? The article presents a grab-bag of database concepts that do not seem related. BigQuery and PostgreSQL are just fundamentally different things.

It all makes me wonder what is the biggest "dark" database, the one nobody on HN wants to talk about, but it's out there serving the most transactions.

I really wanted to see the chat with HN data option or something https://camelai.com/hackernews/

But I am stuck at the cloudflare cf turnstile challenge and when I do click on it and it works, it shows error occured try again.

So frustating since I was so curious.

I almost knew that postgresql would be the winner just because of how much people recommend it here or literally anywhere. Postgres is cool.

My personal favourite depending on situations are postgres (technically supabase is postgres too),sqlite,duckdb,(valkey?)

I am just curious but guys what are your favourite options and why?

That's really interesting; I knew postgres was the most popular database on here, but also looking at that chart, SQLite had a burst of popularity on HN last year.