Ask HN: If not Apache NiFi, what would you use?

3 points by Winsaucerer 6y ago ↗ HN

I read with great interest the comments here (https://news.ycombinator.com/item?id=23144450), and there seemed to be many who didn't like it. However, I didn't really see alternatives suggested. So I wondered, suppose you have an integration task to get data flowing from one system to another. Are there open source alternatives you would recommend? Particularly ones that are friendly to dropping to custom code where needed, and are friendly to storage in (say) git?

2 comments

[ 2.8 ms ] story [ 16.4 ms ] thread

[dead] recessionproof 6y ago ↗

You can't trust HN comments because they consistently have a "I'm a smarter than thou" valence.

NiFi reminds me of Yahoo Pipes and Yahoo Pipes was a good product. So if NiFi is doing similar things then it's more than likely a good product and you should discount HN comments.

chrisMyzel 6y ago ↗

If you are completely ditching the graphical approach you'd consume your data producers and work with that, you'd throw your files into a S3 Bucket and it gets picked up - all those would require custom software to be written