Ask HN: Are there good alternatives to ElasticSearch for storing logs?

6 points by gehel ↗ HN
Some clients have asked me to deploy ElasticSearch clusters in order to store and search their logs. But, as much as I love Kibana and Grafana, I find them lacking when I just want to browse and see my logs in context.

I started a side project to solve this, and I'm thinking of selling it. What I would like to know is: - Do you have the same issue ? Did you find a solution ? - Do you use another system to store the logs ? If yes, do you still face this problem ?

10 comments

[ 6.1 ms ] story [ 46.9 ms ] thread
What about something like s3? Now you can use Athena to query data stored there
It seems interesting, but what I have in mind is more high level interface. Like tailing and greping maybe, but for ElasticSearch.

For reference, this is what I've been working on: https://logvue.xonoko.com

I use it everyday, but I don't know if I should use something better that already exist, or if I should really work to make it available for everyone.

> I find them lacking when I just want to browse and see my logs in context.

Does this mean that you don't need charts - only usual datagrid for your Elastic index where you can easily filter/sort documents?.. My product SeekTable can do that. In addition to that, it can build pivot tables by ElasticSearch (say, you may get summary by log entry type, or group by date parts).

What context is missing in Kibana? How are you storing the data in ElasticSearch?