Ask HN: How to built a HIGHLY scalable API monitoring tool?

2 points by mrameezraja 4y ago ↗ HN

I am looking for best resources to get started with to built a HIGHLY scalable API monitoring tool. I did some research to use Hangfire, AWS SNS/Lambda/SQS, couldn't figure out the best possible solution. There will be thousands of APIs and minimum interval could be 10secs.

4 comments

[ 2.7 ms ] story [ 20.6 ms ] thread

verdverm 4y ago ↗

Are you looking to see of they are up or to inspect the input/output pairs for correctness?

For the first, Prometheus should suffice

mrameezraja 4y ago ↗

We are looking to built something in house using .NET Core, and we are looking for the first. Thanks

verdverm 4y ago ↗

I'd just use Prometheus then, no sense in reinventing the wheel

[dead] hagen1778 4y ago ↗

There are plenty of modern opensource scalabale monitoring systems:

* Cortex https://cortexmetrics.io/

* Thanos https://thanos.io/

* VictoriaMetrics https://github.com/VictoriaMetrics/VictoriaMetrics

* Timescale https://www.timescale.com/

Choose any which fits your needs. Also, for "thousands of APIs and minimum interval could be 10secs" one Prometheus server might be more than enough.