5 ms·
How does Chronon handle mutable data when backfilling? Or does it make some assumptions on the underlying data?
by xiasongh 2y ago
How does Chronon handle mutable data when backfilling? Or does it make some assumptions on the underlying data?
- nikhilsimha 2y agoBy mutable data do you mean - change data coming from OLTP databases? If yes, we do this via the EntitySource api. https://www.chronon.ai/authoring_features/Source.html#streaming-entitysource https://www.chronon.ai/authoring_features/Source.html#stream...
- xiasongh 2y ago> By mutable data do you mean - change data coming from OLTP databases? Yes, exactly! I see there is some kind of support, but is it possible to use the OLTP database as an event source? For example, say I had a table in my OLTP database, `data.returns`, that had columns `ts`, the event time, and `status`, which can be PENDING or COMPLETED. I'd like to generate point-in-time correct training data, where the feature is the count of completed returns. It seems like all the necessary information to calculate this is there