7 ms·
OpenTSLM: Language models that understand time series
Paper: https://www.opentslm.com/OpenTSLM-whitepaper.pdf https://www.opentslm.com/OpenTSLM-whitepaper.pdf
Repo: https://github.com/StanfordBDHG/OpenTSLM https://github.com/StanfordBDHG/OpenTSLM
Foundation models excel at text, images, audio, and video, but lack temporal reasoning capabilities over time-series data streams that run the real world: vitals, prices, telemetry, grid loads, clickstreams, machine logs, business processes.
Time Series Language Models (TSLMs) are open foundation models, supporting time‑series as a native modality, next to text, letting users ask questions, get explanations, and recommendations, all in natural language.
The OpenTSLM White Paper released today demonstrates state-of-the-art temporal reasoning performance. Unlike prior approaches, the cross-attention architecture scales to long time-series remaining viable at scale.
The results:
- Sleep staging: 4.4× accuracy with a model 200× smaller (~880× efficiency)
- Activity recognition: ~6× accuracy with 200× smaller (~1,000× efficiency)
- ECG interpretation: ~2× accuracy with 200× smaller (~400× efficiency)
— first model to process 12-lead ECG signals and text simultaneously with chain-of-thought reasoning validated by cardiologists.
For the first time, foundation models can handle multiple time-series streams of varying lengths concurrently, integrate them with textual context, and produce interpretable explanations (verified by domain experts, clinicians).
This work is the result of a growing collaboration between researchers from Stanford, ETH Zurich, UIUC, University of St. Gallen, University of Washington, Google, and Amazon.
It points to the next foundation model frontier: temporal intelligence that unlocks proactive healthcare, adaptive robotics, resilient infrastructure, and new forms of human-AI collaboration.
- deleted 1y ago[deleted]
- let_tim_cook_ 1y ago"Stanford Repo Released Sep 31, 2025" Seems like something sampled from a distribution with non-zero probability that the day after Sep 30, 2025 would is the 31st....
- Imad_mkdm 1y ago[flagged]
- esafak 1y agoYou know this adds nothing.
- deleted 1y ago[deleted]
- esafak 1y agoWouldn't it be better to have the model write a script that calls a TS library and give it access to an interpreter to run it? That's how a human would do it. I'm not convinced of the need to bake this into the model. What can you do with native TS capability that you can't by tool calling?
- ForHackernews 1y agoDoes it actually have a concept of time? Does it understand causality?
- esafak 1y agoThere are papers on that, such as https://arxiv.org/abs/2410.15319 https://arxiv.org/abs/2410.15319. Time series modeling will not bring about an understanding of causality except in a weak sense https://en.wikipedia.org/wiki/Granger_causality https://en.wikipedia.org/wiki/Granger_causality. To truly connect a cause and effect you need a graphical model. And automated causal discovery, the hardest part of which is proposing the nodes of the graph, is a nascent field.
- sync 1y agoAnthropic is encouraging the "have the model write a script" technique as well, buried in their latest announcement on Claude Agent SDK, this stuck with me: > The Claude Agent SDK excels at code generation—and for good reason. Code is precise, composable, and infinitely reusable, making it an ideal output for agents that need to perform complex operations reliably. > When building agents, consider: which tasks would benefit from being expressed as code? Often, the answer unlocks significant capabilities. https://www.anthropic.com/engineering/building-agents-with-the-claude-agent-sdk#code-generation https://www.anthropic.com/engineering/building-agents-with-t...
- RealLast 1y agoI think you missed the point. Would you call an image analysis library to describe an image or reason over a sequence of images? Check out some of the plots in the paper to see what these models can do.
- brandonb 1y agoThis is very cool! From the paper, this technique seems to work well for question answering in time-series. In medical AI, IMO, the most exciting work is detecting disease signals too subtle for humans—for example, estimating ejection fraction from an ECG (which cardiologists can’t do this, but algorithms can and have been tested in RCTs: https://www.nature.com/articles/s41591-021-01335-4 https://www.nature.com/articles/s41591-021-01335-4 ). Since OpenTSLM tokenizes time-series into an LLM embedding space, would that process prevent capturing such subtle signals? Or could the approach be extended to handle that use case?
- RealLast 1y agoOpenTSLM models are exactly made to capture these subtle signals. That was one of the original motivations. The model integrates the raw time series data via cross attention, with concrete time series representations learned by a raw time series encoder.
- brandonb 1y agoCan you explain how? If I'm understanding the paper right, the timeseries encoding is a Conv1D and the cross-attention layer is constrained to output the token space of a pre-trained LLM. My naive expectation is these constraints would make the model less expressive / fine-tunable to pick up on these types of subtle signals. But obviously ML is an empirical field, so if you found that a constrained architecture worked well in practice, that's an interesting result in its own right.
- RealLast 1y agoSure! There is more after the 1D conv, another transformer architecture that encodes further features of the time series. The LLM can then basically query this encoder for information, also able to capture more subtle patterns. In away it's similiar to how some vision language models work.
- t_mann 1y ago> Read the White Paper > A universal TSLM will power proactive healthcare, adaptive robotics, resilient infrastructure, and new forms of human-AI collaboration. > scientists, engineers, and builders from ETH, Stanford, Harvard, Cambridge, TUM, CDTM, Google, Meta, AWS, and beyond What's with all this fuss? Why not just upload your paper to arxiv? Time series models are interesting enough, but from the abstract it's not even clear whether they are using transformers or a recurrent architecture like xLSTM - arguably a more intuitive choice for time series - or something else. This website is barely distinguishable from a crypto/DeFi pitch.
- RealLast 1y agoThe full paper is on the website. The arxive release of the exact same paper is pending. Click the button "read the white paper" to get the full paper.
- dschaurecker 1y agoVery cool!
- amelius 1y agoIf you view a byte sequence as a time series then I suppose this could be a good file compression algorithm.
- Animats 1y agoThe underlying work is something called "Flamingo".[1] This is a system for understanding interleaved text and images in sequence. So it can process two "modalities" that are both sequential. This new work seems to put some kind of time token in one "modality" channel, leading to more awareness of time. (The web site is too cute. Applying a left to right gradient on text is a bit much.) [1] https://arxiv.org/pdf/2204.14198 https://arxiv.org/pdf/2204.14198
- llmslave 1y agoGuaranteed there are hedge funds with language models that can predict time series. Alot of really good time series research has never been published, and is locked in some guys head that lives in a 20 million dollar apartment in NYC
- constantcrying 1y agoThis isn't (just) time series forecasting, it is about interacting with time series data through natural language.
- senorrib 1y agoI doubt those are language models.
- RealLast 1y agoCheck it out, they are completely based on Llama and Gemma, outputting text. Models are open-source.
- reactordev 1y agoCan confirm, kdb+ exists… and you’ll probably never be able to get your hands on it. There are lots of models that use it. And they are indeed locked inside some guys head high up in the towers of midtown.
- IAmGraydon 1y agoKBD+ is no secret, but what does this have to do with anything? It's just a database optimized for time series data and has nothing to do with AI. It's widely used in the financial business and even for non-financial things like Formula-1 race analysis.
- reactordev 1y agoCool. You missed the part where I said there are models using that. Those models are shhhhhhh… PyTorch is no secret either yet… The point I’m making is there are models, based on database stream data, that you’ll never get access to even if you had $100m dollars.
- pks016 1y agoLooks promising! I'll try it once I get home today. I work with a large number of audio time series data (not words and all have subtle variation). It would be interesting to see how it compares to traditional statistical methods.
- pdntspa 1y agoOF COURSE the good stuff is proprietary....
- zubairov 1y agoThis is very cool! Amazing work guys!
- iLoveOncall 1y agoYou don't need specially trained LLMs for this. My team has been using successfuly Claude 3.5 for a year for the purpose of analyzing huge time series data sets (close to the max context window), without anything special beyond a prompt describing the task at hand.
- nowittyusername 1y agoI agree, LLM's are capable of doing this right out of the box if you provide it grounding data like current time and a few other things in the system prompt. Its really odd that this is getting any attention.
- RealLast 1y agoYou guys are so funny, when papers like these exist: https://arxiv.org/abs/2404.11757 https://arxiv.org/abs/2404.11757 Numerous research, INCLUDING the OpenTSLM paper has PROVEN they are NOT able to do this out of the box. Did you even check out the results at all? They literally compare OpenTSLM against standard text only baselines. Gemma3-270M performs better than GPT-4o using tokenized time series alone. Thus, I guess you guys are being ironic.
- iLoveOncall 1y agoAn experiment is not a proof. If this is the level of one of the contributors to the OpenTSLM paper (which you very obviously are), no wonder due diligence wasn't done properly.
- RealLast 1y ago[flagged]
- rjakob 1y agoIt’s less about proof and more about demonstrating a new capability that TSLMs enable. To be fair, the paper did test standard LLMs, which consistently underperformed. @iLoveOncall, can you point to examples where out of the box models achieved good results on multiple time-series? Also, what kind of time-series data did you analyze with Claude 3.5? What exactly did you predict, and how did you assess reasoning capabilities?
- deleted 1y ago[deleted]
- ghc 1y ago> Few studies use cross-attention to integrate time series into LLMs I mean, sure, but why would you need a study for that? There's plenty of prior work using cross-attention to integrate time series dynamics into non-LLM transformer models, right? Or maybe I'm assuming that integrating a time series embedding with an LLM is easier than it is. Looking at the repo, the training data seems extremely health-focused. I guess I would have to tune the model with my own datasets if I want it to answer questions about multi-source sensor data?
- orbifold 1y agoThis is a terrible idea and direction but it will not stop people from pursuing it and as soon as they have a critical mass of people reviewing each other it will go on for quite a while. Transformers for time series is one of those things that seems to make sense but not really.
- EGreg 1y agoCan you elaborate as to why, actually? What specifically makes this the case
- posidoli 1y agoThat is outstanding work and will revolutionize the approaches in this topic!
- yawnxyz 1y agowould be cool to use this to predict series of passages for directed evolution, e.g. appelman protocol or similar, in phage/host interactions
- deleted 1y ago[deleted]
- copypaper 1y agoI understand this provides a way to interact with ts data via natural language, but is there any benefit to this over tool calling to a library that uses signal processing and/or rule based algos (or using machine learning if the data is noisy/variable)? For example, you ask an off-the-shelf LLM to analyze your ECG data. The LLM uses a tool to call out to your ECG ts analysis library. The library iterates over the data and finds stats & ECG events. It returns something like "Average heart rate: 60bpm, AFib detected at <time>, etc...". The LLM has all the info it needs to give an accurate analysis at a fraction of computational cost. On top of that, this requires a large annotated dataset and a pre-trained model. And correct me if I'm wrong, but I don't think it's possible to have a "general" model that could handle arbitrary time series data. I.e. a model that is trained on ECG data would not be compatible with stock market data. And there isn't a way to have a model that understands both stock market data and ECG data.
- SebastianSosa 1y agoI understand this provides a conversation interface for interacting with internet scale data (ChatGPT), but is there any benefit to this over searching in Google then clicking on the top link, (avoiding the ad) clicking accept my cookies, reading the header, scrolling down, Xing out of premium subscription, reading rest of article, repeat for the 4 next links? Ok bro.
- copypaper 1y ago> Limitations: ... Finally, while we report strong results on individual datasets, we have not yet demonstrated generalization to unseen data, an essential step toward general TSLMs. From the paper itself... Imagine you asked ChatGPT a question but it could only give you answers from a single blog.
- manquer 1y agoYou couldn’t run that on the edge though . The point is to be reliably run it on the edge , nobody sane would want their heart rate monitor to be run via the cloud with the uptimes and reliability that come that would come with any remote service plus the extra challenges of llm inference . The goal would be running on the edge in addition to standard rules based detection which already these machines have and add advanced pattern detection that llms can provide to reduce alert fatigue and also detect new class of complex patterns which these sensors typically don’t.
- syntaxing 1y agoHow many parameters are a basic model?
- ivape 1y agoYou'd be fine tuning a base model, and they suggested 1B and 3B variants, possibly bigger.
- LudwigNagasena 1y agoAs I understand it, the model is trained for classification and interpretation of time series data, but have you tried benchmarking it at forecasting? Explanation and recommendations are often deeply intertwined with forecasts, so there must be at least some effect there?
- resters 1y agoIt would be nice if claude code could monitor a time series of my heart rate to realize when it is soiling the bed.
- lsh0 1y agofwiw, I'm finding claude2 released a few days ago to be a lot less infuriating
- resters 1y agoI had stopped using the sonnet model for anything important after some very big goof ups. 4.5 is definitely significantly better. I've been totally blown away by opus except on a project I'm working on I discovered a few unexpected weaknesses that have cost quite a bit of time.
- qwe----3 1y ago“Researchers from Google” (did an internship)
- FilosofumRex 1y agoA fun litmus test for it would be to de-trend S&P500 to its individual components and to identify and rank contributions of all 500 stocks. But that alone would not get it a job at Rentec or the NSA. Unlike most commercial & medical applications where signals are stationary with white (uncorrelated) noise, the NSA & Rentec mostly deal with non-stationary signals with regime changes and correlated noise, which can't be denoised without loss of information. The idea is not so much to predict the next stock price tick or to decipher an intercepted signal (most likely encrypted anyways), but rather to detect "regime changes", ie quickest detection of a change of pattern in non-stationary signals. Then the detected pattern is matched to known trading patterns for a particular stock or to the expected spy activities.
- RLAIF 1y ago[dead]
- woadwarrior01 1y agoLink to their huggingface account with (some of) the model weights. I couldn't find a link to it on their website, white paper or GitHub. https://huggingface.co/OpenTSLM https://huggingface.co/OpenTSLM
- aerugo_ 1y agoWhat I really want to know is - how do LLMs understand time series at all? Admittedly, even the best LLMs are not fantastic at analyzing time series and tabular data, but they also don’t completely suck at it. Why is that? They seem better at it that my intuition tells me they should be. In my opinion we need a multi-modal model that is great at both tabular datasets and text analysis. Most analytical work in economics, policy, public health, medicine etc requires a combination of crosschecking between both. Current gen LLMs are not good enough at generating novel insights by looking at tables and text at the same time. I also haven’t have found any data on this so please serve it to be on a plate if I’m wrong.