nikhilsimha

8 ms·

1.
by nikhilsimha 1mo ago
Shameless plug, we built Chronon to solve a very similar problem. Chronon is now open source (apache 2) and used at Netflix, OpenAI, Airbnb, Stripe etc. It is used to serve features/context to ML/AI models and rule engines, along
2.
by nikhilsimha 2mo ago
Congrats! Andy is incredible!
3.
by nikhilsimha 2mo ago
the last note about the agent sending emails without approvals is a very common problem!
4.
by nikhilsimha 3mo ago
Files that codex and any other coding agent has access to, should be opt-in NOT opt-out. I think codex is not the right layer to solve this if you want a sane(one-click) UX. We built our own internal sandboxing-terminal around claude and co
5.
by nikhilsimha 7mo ago
It is very common to find tables with 1000+ columns in machine learning training sets at e-commerce companies. The largest I have seen had over 10000 columns.
6.
by nikhilsimha 7mo ago
easily the most memorable comment i have ever seen on hackernews so far. kudos good sir!
7.
by nikhilsimha 8mo ago
usually when a sharp sensation arises in an area, there is a habitual tendency to counteract - unconsciously tense surrounding muscles or antagonistic muscles or switch posture etc. the idea is to observe with clarity the counteraction and
8.
by nikhilsimha 2y ago
Not saying that our current approaches will lead to intelligence. No one can know. It could very well be that the internal mechanism of our thought has an auto-regressive reasoning component. With the full system effectively "combining
9.
by nikhilsimha 2y ago
just skimmed the proposal, dont see how inline rendered f-strings are more complicated than the alternative.
10.
by nikhilsimha 2y ago
gotcha! thanks for the clarification
11.
by nikhilsimha 2y ago
So the writes are O(N) then - to keeps reads at O(1)?
12.
by nikhilsimha 2y ago
dumb question: how do z-sets or feldera deal with updates to values that were incorporated into the max already? For example - max over {4, 5} is 5. Now I update the 5 to a 3, so the set becomes {4, 3} with a max of 4. This seems to imply t
13.
by nikhilsimha 2y ago
i personally like nim’s approach to memory management - implicitly refcounted, but exposes clean manual memory management when needed
14.
by nikhilsimha 2y ago
great job on open sourcing!
15.
by nikhilsimha 2y ago
publicly funded research, but behind paywalls, was scraped to build the chatbot - by “china” not open ai, causes “people” to lose their s**t. i do think ip infringement is not cool in general - but it doesnt seem right that geo research is
16.
by nikhilsimha 2y ago
duckdb is mit licensed. [1] datafusion is apache v2 licensed. [2] pg_lakehouse built on top of data fusion is AGPL v3 + business licensed. [3] [1] https://github.com/duckdb/duckdb/blob/main/LICENSE [2]
17.
by nikhilsimha 2y ago
Nim?
18.
by nikhilsimha 2y ago
almost every button click is either powered by a model or guarded by a model.
19.
by nikhilsimha 2y ago
We don't accept hints yet - but we determine what to cache.
20.
by nikhilsimha 2y ago
To be pedantic, even in star schema - the dim tables are denormalized, fact tables are not. I agree that my statement would be much better if used snowflake schema instead.
21.
by nikhilsimha 2y ago
"Imagine" is the operative word :-)
22.
by nikhilsimha 2y ago
These are reconstruction of features / columns that don’t exist yet.
23.
by nikhilsimha 2y ago
Normalization is overloaded. I was referring to schema normalization (3NF etc) not feature normalization - like standard scaling etc.
24.
by nikhilsimha 2y ago
We do this for training data generation already. We have plans to implement this behavior for computing the batch arm of feature serving.
25.
by nikhilsimha 2y ago
Snapshots can’t travel back with milliseconds precision or even minute level precision. They are just full dumps at regular fixed intervals in time.
26.
by nikhilsimha 2y ago
Pardon the jargon. But it is a necessary addition to the vocabulary. To evaluate if a feature is valuable, you could attach the value of the feature to past inferences and retrain a new model to check for improvement in performance. But thi
27.
by nikhilsimha 2y ago
Imagine you are building a customer support bot for a food delivery app. The user might say - I need a refund. The bot needs to know contextual information - order details, delivery tracking details etc. Now you have written a prompt templa
28.
by nikhilsimha 2y ago
We haven’t tried materialize - IIUC materialized is pure kappa. Since we need to correct upstream data errors and forget selective data(GDPR) automatically - we need a lambda system. Tecton, we evaluated, but decided that the time-travel st
29.
by nikhilsimha 2y ago
Let’s say you want to compute avg transaction value of a user in the last 90days. You could pull individual transactions and average during the request time - or you could pre compute a partial aggregates and re-aggregate on read. OLAP syst
30.
by nikhilsimha 2y ago
Two main differences - ability to time travel for training data generation and the ability to push compute to the write side of the view rather than the read side for low latency feature serving.

More ›