pipette
ESEspañol

Perceive, Solve, Reason: Progressive Capability Formation in Time Series-LLMs

Xin Qiu, Junlong Tong, Wei Zhang, Xiaoyu Shen

PreprintClaims a big step

In the authors' words

Large language models (LLMs) can now perceive, describe, and reason about images and audio, yet time series understanding remains underestimated: most work uses LLMs as forecasters and classifiers, reasoning studies are few and narrow, and no suite trains and evaluates the full range of capabilities. In this paper, we build the first such suite, with 337K training and 44K evaluation samples across three progressive capabilities, Perceive, Solve, and Reason, and use it to ask how time series should enter an LLM that must master all three, and in what order. We find that a dedicated encoder is essential: with one, a 4B model surpasses GPT-4o on every perception attribute we test, whereas textualizing the series costs 8--10 points in reasoning accuracy. The capabilities then build on one another: learning them in order beats mixing the same data and rivals reasoning-only training with over three times the reasoning data, but only when an encoder is used. Analyses further reveal that capabilities are transferred through distinct network depths rather than simply stacked, and that a stage converged on its own benchmark is not necessarily ready for the next. Distilled into a simple recipe, these findings yield 4B TS-LLMs that, without any target-domain data, outperform four recent 7B TS-LLMs on seven of eight out-of-domain metrics, by up to 11 points. We therefore advocate treating time series as a first-class modality for LLMs, read through dedicated encoders and taught to perceive before they reason.

Main resultThe abstract does not state a limitation.

In plain words AI summary

The authors built the first training and testing suite for three time-series skills: perception, solving, and reasoning. They found that a dedicated encoder is essential: with one, their 4-billion-parameter model beats GPT-4o on every perception test. Converting time series to text instead costs 8 to 10 points in reasoning accuracy. Learning the three skills in order works better than mixing the data, and matches training on over three times as much reasoning data. Their 4-billion-parameter models beat four recent 7-billion-parameter models on seven of eight out-of-domain tests, by up to 11 points, without using any target-domain data.

Written by Kimi K2.5 using only the abstract above. Jev checked that every sentence is supported by the abstract sentences it cites, and removed any that were not. Point at a sentence to highlight its source.

Appeared: Monday, October 19. arXiv. Preprint, not yet peer-reviewed.