eightnoteight

5 ms·

31.
by eightnoteight 3y ago
extra margins for products on top of ec2 are mostly fine, there is a huge R&D effort and continued maintenance, so extra charges to recuperate that spend are totally justifiable. but 16-20% extra charges for foundational compute tech li
32.
by eightnoteight 3y ago
> A government agency isn't in a business to make money. true, but it's not in the business of wasting money either. if they don't take care about economic efficacy, then someday voters are going to judge them for wasting
33.
QuickWit Serverless Architecture would greatly reduce observability costs(twitter.com)
3 points by eightnoteight 3y ago|1 comments
34.
by eightnoteight 3y ago
Most of the cost comes from ingestion and running the servers all the time (OpenSearch, Loki, Clickhouse) But the free s3 data transfer and using on-demand lambda compute for searching makes it really cheap
35.
S3 Express One Zone Costs(optiowl.cloud)
1 points by eightnoteight 3y ago|0 comments
36.
by eightnoteight 3y ago
> Cutting costs by adopting a better architecture was a big thing at one of my previous jobs. People were praised and promoted for cutting thousands of dollars off monthly AWS bills. I think this is a slippery slope. praising is fine, bu
37.
by eightnoteight 3y ago
like who would care if you can bring certain type of knowledge's half life to 200 years. since you can't live anymore for that much time, you don't even need to think about solving that problem. just need to think about how t
38.
by eightnoteight 3y ago
while I agree that there is a half-life to certain type of knowledge but I think it would be overstating to reasonably apply to all knowledge. its very easy to retain a significant portion of the knowledge by building mental models. sure yo
39.
by eightnoteight 3y ago
> If it were a battery break through it would take 10 years to turn it into a mass producible product I think it really did take approximately that much time for LLMs as well. first transformers paper came in 2017, almost 6 years back. t
40.
by eightnoteight 3y ago
as in the motivation is already there, but there aren't any good solutions to help engineers ensure efficient resources on cloud
41.
by eightnoteight 3y ago
its high time that cost is treated as a requirement of software delivery itself. even now cloud cost optimisation is essentially a requirement driven out of top down goals like FOMO, P&L etc,... its not wrong but that is a pretty late m
42.
by eightnoteight 3y ago
exactly, a typical REST server spends a lot of compute time in json encoding and decoding. which could be sped up significantly if there is better memory bandwidth
43.
by eightnoteight 3y ago
I felt like the real lesson is a missing flight recorder system, if each action and behaviour is properly logged, it would have been pretty clear that the telemetry was lost before chris even began testing the RAT motor
44.
by eightnoteight 3y ago
I want to better understand the reasoning behind the "scale to zero" point that many people mention. only case I could think of is that businesses that want "scale to zero" have very low total expenditure on the database
45.
by eightnoteight 3y ago
remember it is aws, "leverage" is built into their DNA, I don't believe that they would go on the route of building a totally new SQL database like google did
46.
by eightnoteight 3y ago
I think they are internally using postgres only. aurora uses a custom storage process on host which internally supports the custom storage engine (s3) given the mentions of "log as a database", I believe that depending on the tran
47.
by eightnoteight 3y ago
I think we mean different things, it is enabled by default but I'm saying thats not the default IMDS version that metadata endpoint points to for `/latest/` for example if you run below curl request on ec2 instances launched
48.
by eightnoteight 3y ago
IMDSv2 was initially introduced after the capital one attack. but aws users will have to explicitly enable it and its not enabled by default. now they are changing the default modes for instances launched from aws console using quick start
49.
by eightnoteight 3y ago
actually I think this might be the intention of mirage as well, especially since they put "modularity" in the title
50.
by eightnoteight 3y ago
exactly this, debugging is a pretty big part when it comes to operational aspects. but I feel like similar to kubernetes container injection systems. I suspect in future we would see dynamic injection into the unikernel where you can enable
51.
by eightnoteight 3y ago
I think its about efficiency. thats why you may not be seeing "new problems" being solved. like people used to be able to travel before cars as well, cars didn't solve a new problem and the world didn't have any demand f
52.
by eightnoteight 3y ago
in hindsight, you got the context pretty accurate i.e importance of microsoft in all of this
53.
by eightnoteight 3y ago
@sama @gdb joined microsoft
54.
by eightnoteight 3y ago
this is a predictable worse latency due to CPU throttling, i.e nothing is suddenly introduced in the system. but the other case is worse i.e a non critical microservice can cause outage on your critical microservice. imagine some non critic
55.
by eightnoteight 3y ago
imagine amazon's order history microservice causes outage for ordering creation microservice. regardless of the monitoring and alerting, you never want a non critical system to cause outage on the most critical system you have
56.
by eightnoteight 3y ago
Reservations are not limits, they are minimum guaranteed CPU usage constraints. while theoretically, those are minimum guaranteed resources, if there are other busy containers running on the host, you will still see your tail latencies and
57.
by eightnoteight 3y ago
aurora serverless v2 now supports io optimized mode. which increases the pricing for instances by constant amount but makes the io pricing to 0 https://aws.amazon.com/about-aws/whats-new/2023/05/amazon-au
58.
by eightnoteight 3y ago
most of the benefits of writing are pretty clear to me but I'm still unable to improve the efficiency of writing i.e ability to put down thoughts properly and quickly rather than spending a lot of time on structuring the blog, very rar
59.
Notes on Go 1.21(blog.eightnoteight.dev)
2 points by eightnoteight 3y ago|0 comments
60.
Health Checking(blog.eightnoteight.dev)
1 points by eightnoteight 4y ago|0 comments

More ›