great work! When it comes to batched computations, why not leverage intermediate... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		evolutionblues on April 9, 2024 \| parent \| context \| favorite \| on: Chronon, Airbnb's ML feature platform, is now open... great work! When it comes to batched computations, why not leverage intermediate state much like streaming jobs. For example, if we need to calculate past 30 day sum for a value daily - it seems like this would compute so from scratch daily. Would it not make sense to model this as a sliding window that's updated daily?

nikhilsimha on April 9, 2024 [–]

We do this for training data generation already.

We have plans to implement this behavior for computing the batch arm of feature serving.

evolutionblues on April 10, 2024 | [–]

can you point to documentation/ examples which talk about it - I could not find this while exploring the pages (or maybe I missed it altogether).

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact