AJSDfljff

9 ms·

1.
by AJSDfljff 2y ago
"So subsecond I would say is a requirement." you do not make any specific point why you came to that conclusion. You can easily entertain users to show them that the system is doing something in the background without loosing them
2.
by AJSDfljff 2y ago
It will be interesting how long business people overestimate what they can do until the tools get good enough that it is okay again. Take small companies with eveyrone being business people besides the nerds in the IT department. If you don
3.
by AJSDfljff 2y ago
Whats your usage? The 'around town' triggered me to ask :)
4.
by AJSDfljff 2y ago
Do they understand the difference between logs and metrics? Feels like they just log instead of having a separation between logs and metrics.
5.
by AJSDfljff 2y ago
The question is why would someone need search through TBs of data. If you are not google cloud and just have your workers ready to stream all data in parallel on x amount of workers in parallel, i would force usefull limitations and for bro
6.
by AJSDfljff 2y ago
I would probably build my own storage pods, keep a day or a week on cloud and move everything over every night.
7.
by AJSDfljff 2y ago
Yes but audit requirements doesn't mean you need to be able to search everything very fast. Binance might not have a 24/7 constant load, there might be plenty of time to compact and write audit data away at lower load while levera
8.
by AJSDfljff 2y ago
I would question first if the system needs to search with subsecond latency and if the same system needs to be which can handle 10k writes/sec. Even google cloud and others let you wait for longer search queries. If not business ciriti
9.
by AJSDfljff 2y ago
Would be curious what they are searching exactly. At this size and cost, aligning what you log should save a lot of money.
10.
by AJSDfljff 2y ago
Good question. I thought it would be a no brainer to put it on s3 or similiar but thats already way to expensive at 2m/month without api requests. Backplace storage pods are an initial investment of 5 Million, thats probably the best b
11.
by AJSDfljff 2y ago
Unfortunate the interesting part is missing. Its not hard at all to scale to PB. Junk your data based on time, scale horizontally. When you can scale horizontally it doesn't matter how much it is. Elastic is not something i would use f