I was replying to a comment not saying airflow is capable of stream processing. > Not for multinode analytics of huge data sets. Airflow does this just fine with celery.
Actually that's not true. Have a look at the airflow project by AirBnB. https://github.com/airbnb/airflow
I was replying to a comment not saying airflow is capable of stream processing. > Not for multinode analytics of huge data sets. Airflow does this just fine with celery.
Actually that's not true. Have a look at the airflow project by AirBnB. https://github.com/airbnb/airflow