wanshao

6 ms·

1.
by wanshao 2y ago
Scaling Kafka clusters has always been a challenging task. Kafka uses the ISR multi-replica mechanism to ensure data persistence, which was a natural choice when the cloud was not yet mature. However, in 2024, when cloud computing is very m
2.
Ask HN: What you most concerned when choosing streaming platform?
2 points by wanshao 2y ago|0 comments
3.
Ask HN: Is it true that Kafka API has become the de facto standard of streaming?(kai-waehner.de)
3 points by wanshao 2y ago|1 comments
4.
by wanshao 2y ago
In recent years, we have seen many challengers to Kafka emerge. Without exception, they all claim to be fully compatible with the Kafka API. Some challengers have even directly forked Kafka's code to innovate further. Has the Kafka API
5.
Ask HN: How challengers survive from Confluent Freight Cluster?
7 points by wanshao 2y ago|0 comments
6.
by wanshao 2y ago
What is BufStream?Is it a new streaming system?
7.
by wanshao 2y ago
Thanks for your advice
8.
by wanshao 2y ago
Thanks, I've joined.
9.
Ask HN: How can I obtain an invite to Lobste.rs?
7 points by wanshao 2y ago|5 comments
10.
by wanshao 2y ago
I agree with your viewpoint. The crux of the matter is not whether to use tiered storage or not, but what trade-offs have been made in the specific storage architecture and what benefits have been gained. Here( https://github.com&
11.
by wanshao 2y ago
Buddy, you've hit the nail on the head. Everything is a trade-off. For a stream processing system, I believe it's entirely possible to balance cost, ease of use, and latency. AutoMQ( https://github.com/AutoMQ/a
12.
by wanshao 2y ago
Examples of this are quite common. Many tech company blog pages offer tag-based searches. The articles published can be tagged either by the system or manually, allowing us to filter content we're interested in by searching for these t
13.
by wanshao 2y ago
That makes sense. Every choice has its pros and cons. Simplicity is the philosophy of HN. If complexity gets out of control, HN would cease to exist. However, perhaps some small experiments could be feasible while maintaining simplicity?
14.
by wanshao 2y ago
Thank you for sharing. However, I might be looking for more specific categorizations. For instance, if I'm only interested in AWS-related content, I would like to be able to search for the 'AWS' tag.
15.
Ask HN: Why doesn't HN provide some categories or tags for easier search?
1 points by wanshao 2y ago|7 comments
16.
by wanshao 2y ago
The last conversational approach is very practical because it provides a concrete example.
17.
by wanshao 2y ago
This is a tremendous feat. Your success should be greatly tied to the actions you've taken. You've listed a lot of experiences that contributed to this outcome. Many projects have done the same, but they haven't succeeded. Wh
18.
by wanshao 2y ago
The ban is not just about the issue of traffic fabrication. The fake story created by this influencer has occupied limited social media resources. This has prevented many more important news and events from being understood by the public.
19.
Ask HN: Will you contribute code to a BSL Licensed project?
4 points by wanshao 2y ago|1 comments
20.
by wanshao 2y ago
Thank you for your response. I will adjust my behavior to ensure that I comply with community rules and provide something truly valuable to everyone.
21.
by wanshao 2y ago
Thank you for your explanation and advice. I will adjust my behavior to ensure that I can comply with the rules of the HN community.
22.
by wanshao 2y ago
The elasticity of the public cloud mainly manifests in the user's ability to use its resources on demand. When you need more resources to support the workload, you can quickly purchase resources; when you no longer need these resources
23.
by wanshao 2y ago
Thanks for your kind action.I want to know is the post really dead? When I look at it in my personal account's submissions, I find that the post has not been marked as dead. My account has been set to showdead=yes. If it's really
24.
by wanshao 2y ago
It's so strange, now others can see my post as well. The title of the post is: 'Why it's difficult to utilize the elasticity of the public cloud?'. When I encountered the issue, I also sent an email to the moderator expl
25.
Ask HN: Why others can't see my post even it is not dead?
1 points by wanshao 2y ago|9 comments
26.
by wanshao 2y ago
When Kafka deals with large volumes of data, scaling out or in requires large data replication of the partitions, which is a very heavy operation. With the architecture based on S3 using shared storage, everything becomes much simpler. In m
27.
by wanshao 2y ago
Thank you for your openness to new things. Your support is indeed very important to a new project. BTW, AutoMQ itself provides real comparison data tested on AWS, and the related code is open for users to reproduce these tests. For a cost c
28.
by wanshao 2y ago
jpgvm is right. AutoMQ didn't modify the computation layer of Kafka, but only revamped the storage layer. This means you can use AutoMQ just like Kafka. This is very user-friendly for those who are already using Kafka and applying tool
29.
Show HN: AutoMQ - A Cost-Effective Kafka Distro That Can Autoscale in Seconds(github.com)
58 points by wanshao 2y ago|23 comments
30.
by wanshao 2y ago
Reasonable skepticism. Rather than changing the agreement at some point in the future, it's better to clarify it from the beginning. Perhaps introducing an enhanced version of the BSD license, which does not allow the project to modify

More ›