I'm not sure operators are a good example, they can be idempotent or not depending on the implementation. The operator is a function that takes two values and return a result: result = op(left, right).
But that safety net doesn't extend to startup founders does it? AFAIR In Norway, you need to have worked in a company as a regular employee for at least one or two years before you can claim unemployment benefits.…
In Faust we've had the ability to take a very different approach towards quality control. We have a cloud integration testing setup, that actually runs a series of Faust apps in production. We do chaos testing: randomly…
Yes, they do serve different purposes but they also share similarities. You could easily write a task queue on top of Faust. It's important to remember that users had difficulty understanding the concepts behind Celery…
Faust is a library that you can import into your Python program, and all it requires is Kafka. Most other stream processing systems require additional infrastructure. Kafka Streams has similar goals, but Faust…
We had support for it initially, but we ended up not using the schema registry server. We want to add support for this back in if it provides value.
There's an examples/django project in the distribution. I think they removed the gevent bridge from PyPI for some reason, but you can still use the eventlet one. Gevent is production quality and the concept of bridging…
We added two levels of abstractions for this purpose: - A Stream iterates over a channel - A Channel implements: `channel.send` and `channel.__aiter__`. - A topic is a "named" channel backed by a Kafka topic - Further…
Faust can serve the data over HTTP/websockets and other transports, so you can query it directly!
I'm looking at Redis Streams and it seems to lack the partitioning component of Kafka. One of the properties that we rely on is the ability to manually assign partitions such that a worker assigned partition 0 of one…
My name is Ask and I am one of the co-creators along with Vineet. Thanks for pointing this out. Fixed the links. You can also find the docs here: http://faust.readthedocs.io/en/latest/ Faust uses Kafka for message…
My name is Ask and I'm the co-creator of this project, along with Vineet. Yes, we're definitely interested in supporting Redis Streams! Faust is designed to support different brokers, but Kafka is the only…
My name is Ask and I'm co-creator on this project, along with Vineet Goel. This answer sums up why we wanted to use Python for this project: it's the most popular language for data science and people can learn it…
You don't think Equifax have lawyers? Of course they do, and they know that the clause exists. Just having the clause in the first place is a conspiracy to abuse consumers.
Celery was never meant as a replacement for cron, it was simply a nice bonus that fits the messaging pattern well. Writing a task queue is actually very simple using for example Redis, but that doesn't necessarily mean…
Thank you for the kind words, it's so very appreciated :) I have merged many features, like broker transports, result backends, etc, and while the initial contribution was great, it ends up being unmaintained with…
Definitely questionable, but maybe it's related to germs transferred during birth: http://well.blogs.nytimes.com/2016/02/01/post-cesarean-bacte...
I use hjkl consistently in vim and in the shell. Just think about how long it takes you to move your fingers to the cursor keys. You should spend some effort getting used to it, as using hjkl means you can keep your…
I agree it has some advantages, but citing commonality seems weird when it's increasingly unlikely for new to be homeowners to afford a home in cities like London, SF, etc. I doubt most people waste thousands of dollars…
Does it really apply to just browser histories? Does it mean they can take your computers without warrant to get to this history, or does it mean ISPs will have to sniff traffic to extract URLs visited and keep a log of…
Edit: Ignorance is bliss
I found your project very interesting! I'm very familiar with Erlang/OTP, and have been meaning to play with Elixir for some time. Since you're separating downloading from processing, maybe IPC is a better term for what…
Author of Celery here. This is an interesting presentation! I want to clarify something about Celery and RAM usage. When writing web crawlers, and other (mostly) I/O-bound tasks, you should be using the eventlet/gevent…
People need more venues to meet new people, but by greeting I meant more like saying "evening!" when you pass your next door neighbor in the hallway. I don't think there's an expectation to chat in this case. If I…
I was also brought up to greet people, but try to greet neighbors in London, UK and they will look at you like you fell from the sky. Most of them will not even give a response. Big cities are a lot like this now.
I'm not sure operators are a good example, they can be idempotent or not depending on the implementation. The operator is a function that takes two values and return a result: result = op(left, right).
But that safety net doesn't extend to startup founders does it? AFAIR In Norway, you need to have worked in a company as a regular employee for at least one or two years before you can claim unemployment benefits.…
In Faust we've had the ability to take a very different approach towards quality control. We have a cloud integration testing setup, that actually runs a series of Faust apps in production. We do chaos testing: randomly…
Yes, they do serve different purposes but they also share similarities. You could easily write a task queue on top of Faust. It's important to remember that users had difficulty understanding the concepts behind Celery…
Faust is a library that you can import into your Python program, and all it requires is Kafka. Most other stream processing systems require additional infrastructure. Kafka Streams has similar goals, but Faust…
We had support for it initially, but we ended up not using the schema registry server. We want to add support for this back in if it provides value.
There's an examples/django project in the distribution. I think they removed the gevent bridge from PyPI for some reason, but you can still use the eventlet one. Gevent is production quality and the concept of bridging…
We added two levels of abstractions for this purpose: - A Stream iterates over a channel - A Channel implements: `channel.send` and `channel.__aiter__`. - A topic is a "named" channel backed by a Kafka topic - Further…
Faust can serve the data over HTTP/websockets and other transports, so you can query it directly!
I'm looking at Redis Streams and it seems to lack the partitioning component of Kafka. One of the properties that we rely on is the ability to manually assign partitions such that a worker assigned partition 0 of one…
My name is Ask and I am one of the co-creators along with Vineet. Thanks for pointing this out. Fixed the links. You can also find the docs here: http://faust.readthedocs.io/en/latest/ Faust uses Kafka for message…
My name is Ask and I'm the co-creator of this project, along with Vineet. Yes, we're definitely interested in supporting Redis Streams! Faust is designed to support different brokers, but Kafka is the only…
My name is Ask and I'm co-creator on this project, along with Vineet Goel. This answer sums up why we wanted to use Python for this project: it's the most popular language for data science and people can learn it…
You don't think Equifax have lawyers? Of course they do, and they know that the clause exists. Just having the clause in the first place is a conspiracy to abuse consumers.
Celery was never meant as a replacement for cron, it was simply a nice bonus that fits the messaging pattern well. Writing a task queue is actually very simple using for example Redis, but that doesn't necessarily mean…
Thank you for the kind words, it's so very appreciated :) I have merged many features, like broker transports, result backends, etc, and while the initial contribution was great, it ends up being unmaintained with…
Definitely questionable, but maybe it's related to germs transferred during birth: http://well.blogs.nytimes.com/2016/02/01/post-cesarean-bacte...
I use hjkl consistently in vim and in the shell. Just think about how long it takes you to move your fingers to the cursor keys. You should spend some effort getting used to it, as using hjkl means you can keep your…
I agree it has some advantages, but citing commonality seems weird when it's increasingly unlikely for new to be homeowners to afford a home in cities like London, SF, etc. I doubt most people waste thousands of dollars…
Does it really apply to just browser histories? Does it mean they can take your computers without warrant to get to this history, or does it mean ISPs will have to sniff traffic to extract URLs visited and keep a log of…
Edit: Ignorance is bliss
I found your project very interesting! I'm very familiar with Erlang/OTP, and have been meaning to play with Elixir for some time. Since you're separating downloading from processing, maybe IPC is a better term for what…
Author of Celery here. This is an interesting presentation! I want to clarify something about Celery and RAM usage. When writing web crawlers, and other (mostly) I/O-bound tasks, you should be using the eventlet/gevent…
People need more venues to meet new people, but by greeting I meant more like saying "evening!" when you pass your next door neighbor in the hallway. I don't think there's an expectation to chat in this case. If I…
I was also brought up to greet people, but try to greet neighbors in London, UK and they will look at you like you fell from the sky. Most of them will not even give a response. Big cities are a lot like this now.