asksol

5 ms·

1.
by asksol 7y ago
I'm not sure operators are a good example, they can be idempotent or not depending on the implementation. The operator is a function that takes two values and return a result: result = op(left, right).
2.
by asksol 8y ago
But that safety net doesn't extend to startup founders does it? AFAIR In Norway, you need to have worked in a company as a regular employee for at least one or two years before you can claim unemployment benefits. Health insurance is a
3.
by asksol 8y ago
In Faust we've had the ability to take a very different approach towards quality control. We have a cloud integration testing setup, that actually runs a series of Faust apps in production. We do chaos testing: randomly terminating wor
4.
by asksol 8y ago
Yes, they do serve different purposes but they also share similarities. You could easily write a task queue on top of Faust. It's important to remember that users had difficulty understanding the concepts behind Celery as well, perhaps
5.
by asksol 8y ago
Faust is a library that you can import into your Python program, and all it requires is Kafka. Most other stream processing systems require additional infrastructure. Kafka Streams has similar goals, but Faust additionally enables you to us
6.
by asksol 8y ago
We had support for it initially, but we ended up not using the schema registry server. We want to add support for this back in if it provides value.
7.
by asksol 8y ago
There's an examples/django project in the distribution. I think they removed the gevent bridge from PyPI for some reason, but you can still use the eventlet one. Gevent is production quality and the concept of bridging them is s
8.
by asksol 8y ago
We added two levels of abstractions for this purpose: - A Stream iterates over a channel - A Channel implements: `channel.send` and `channel.__aiter__`. - A topic is a "named" channel backed by a Kafka topic - Further the topic i
9.
by asksol 8y ago
Faust can serve the data over HTTP/websockets and other transports, so you can query it directly!
10.
by asksol 8y ago
I'm looking at Redis Streams and it seems to lack the partitioning component of Kafka. One of the properties that we rely on is the ability to manually assign partitions such that a worker assigned partition 0 of one topic, will also b
11.
by asksol 8y ago
My name is Ask and I am one of the co-creators along with Vineet. Thanks for pointing this out. Fixed the links. You can also find the docs here: http://faust.readthedocs.io/en/latest/ Faust uses Kafka for message
12.
by asksol 8y ago
My name is Ask and I'm the co-creator of this project, along with Vineet. Yes, we're definitely interested in supporting Redis Streams! Faust is designed to support different brokers, but Kafka is the only implementation as of now
13.
by asksol 8y ago
My name is Ask and I'm co-creator on this project, along with Vineet Goel. This answer sums up why we wanted to use Python for this project: it's the most popular language for data science and people can learn it quickly. Performa
14.
by asksol 9y ago
You don't think Equifax have lawyers? Of course they do, and they know that the clause exists. Just having the clause in the first place is a conspiracy to abuse consumers.
15.
by asksol 10y ago
Celery was never meant as a replacement for cron, it was simply a nice bonus that fits the messaging pattern well. Writing a task queue is actually very simple using for example Redis, but that doesn't necessarily mean Celery is over-e
16.
by asksol 10y ago
Thank you for the kind words, it's so very appreciated :) I have merged many features, like broker transports, result backends, etc, and while the initial contribution was great, it ends up being unmaintained with issues that nobody fi
17.
by asksol 10y ago
Definitely questionable, but maybe it's related to germs transferred during birth: http://well.blogs.nytimes.com/2016/02/01/post-cesarean-bacte...
18.
by asksol 10y ago
I use hjkl consistently in vim and in the shell. Just think about how long it takes you to move your fingers to the cursor keys. You should spend some effort getting used to it, as using hjkl means you can keep your hands in the middle
19.
by asksol 10y ago
I agree it has some advantages, but citing commonality seems weird when it's increasingly unlikely for new to be homeowners to afford a home in cities like London, SF, etc. I doubt most people waste thousands of dollars each month for
20.
by asksol 10y ago
Does it really apply to just browser histories? Does it mean they can take your computers without warrant to get to this history, or does it mean ISPs will have to sniff traffic to extract URLs visited and keep a log of them (for how long?)
21.
by asksol 10y ago
Edit: Ignorance is bliss
22.
by asksol 10y ago
I found your project very interesting! I'm very familiar with Erlang/OTP, and have been meaning to play with Elixir for some time. Since you're separating downloading from processing, maybe IPC is a better term for what you&
23.
by asksol 10y ago
Author of Celery here. This is an interesting presentation! I want to clarify something about Celery and RAM usage. When writing web crawlers, and other (mostly) I/O-bound tasks, you should be using the eventlet/gevent execution
24.
by asksol 10y ago
People need more venues to meet new people, but by greeting I meant more like saying "evening!" when you pass your next door neighbor in the hallway. I don't think there's an expectation to chat in this case. If I wante
25.
by asksol 10y ago
I was also brought up to greet people, but try to greet neighbors in London, UK and they will look at you like you fell from the sky. Most of them will not even give a response. Big cities are a lot like this now.
26.
by asksol 10y ago
I think it's more readable in isolation, but when you have workflows it distracts you from what it's actually doing, making it harder to see what the purpose is at a glance. An API can probably not have many shortcuts like this,
27.
by asksol 10y ago
>Be careful using the multiprocessing module, it has some very serious bugs. I've spent the last 4 years rewriting parts of it for Celery I regretted this as soon as I submitted it. I would hate for someone to do the same thing to
28.
by asksol 10y ago
>This is a very limited type of communication. Asyncio with stuff like crossbar.io allow pub/sub. Celery also supports pub/sub, and other topologies. >So can your celery workers. It happened to me many times. With the major
29.
by asksol 10y ago
Celery can use async I/O too! Using the gevent pool you can have e.g. 4 celery worker instances with 1000 threads each.
30.
by asksol 10y ago
> - You are limited to x number of blocking operations, where x >is the number of workers. It means you cannot do massively >parallel I/O such as network operations with it (e.g: a web >server). Celery can use eventlet&#x2F

More ›