State-space & long-context models

Trend over time

Evidence papers — 50 most recent of 1180

• TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching
  Zhihao Shu, Md Musfiqur Rahman Sanim, Jie Hu, Kun Yuan, Minghai Qin, Gagan Agrawal, Wei Niu · Sep 2026 · arXiv
• S3VD: Semantic-Guidance Spatio-Temporal Scanning for Video Deraining
  Kui Jiang, Yiang Chen, Yan Luo, Zhaocheng Yu, Junjun Jiang, Xianming Liu · Sep 2026 · arXiv
• WS-NeRF: A Mamba-Driven World-State-Aware Adaptive Deblurring Neural Radiance Field
  Hang Jiang, Jinghao Wang, Yiming Zhang, Xinhong Wang, Luwei Ran, Yinfeng Yu · Sep 2026 · arXiv
• Dual-Interest Sequential Product Recommendation With Multi-Granular SSM
  Shuiying Liao, P. Y. Mok · Sep 2026 · arXiv
• SpecQuant: Speculative Decoding with Multi-Parent Quantization for Adaptive LLM Inference
  Harish KB, Jagadeeswaran M, Pradheep P, Yuvanesh S, Sivakumar T · Sep 2026 · arXiv
• Adaptive Uncertainty-Aware Modeling and Stochastic Radial Basis Function Predictive Control for Personalized Fluid Resuscitation
  Elham Estiri, Hossein Mirinejad · Sep 2026 · arXiv
• PointLAM: Local Attentive Mamba for Efficient Point-based 3D Object Detection
  Xuanming Shang, Weijia Zhang, Chao Ma · Sep 2026 · arXiv
• SIMLIFE: Pattern Understanding for Long-Horizon Human-Agent Partnership
  Run Peng, Zinnia Nie, Jing Ding, Yinpei Dai, Yichi Zhang, Zengqing Wu, Yao Fu, Ziqiao Ma, Jiayuan Mao, Joyce Chai · Sep 2026 · arXiv
• Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation
  Haocheng Xi, Yiming Xie, Hexu Zhao, Yiwen Zhang, Michael Liu, Thomas Creavin, Kurt Keutzer, Xiuyu Li, Zhaoyang Lv, Chenfeng Xu, Haiwen Feng · Sep 2026 · arXiv
• RBS-Attention: Radius-Bounded Sparse Prefill for Long-Context Large Language Models
  Chuxu Song, Jiuqi Wei, Zhencan Peng · Sep 2026 · arXiv
• On-Demand Attention: Language Models Know When to Recall
  Haibo Feng, Ruiqi Liang, Hanyang Peng, Shiqi Yu · Sep 2026 · arXiv
• DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
  DeepSeek-AI, :, Anyi Xu, B. Li, Bangcai Lin, Bing Xue, BingCheng Xian, Bingzheng Xu, Bochao Wu, Bowei Zhang, Boyi Deng, C. C. Yu, Chao Jin, Chaofan Lin, Chen Dong, Chenbing Wang, Chenfan Feng, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chengyuan Zhang, Chenhao Xu, Chenqi Zhao, Chenze Shao, Chuhao Wang, Chuqi Zhang, Damai Dai, Dejian Yang, Deli Chen, Di Huang, Di Wu, Donghao Li, Erhang Li, Eric Fu, F. Zhou, Fangwei Zhou, Fangyun Lin, Fangzhou Yuan, Feiyu Xia, Fucong Dai, Guangbo Hao, Guanglin Li, · Sep 2026 · arXiv
• REACT: A Fully Spiking State-Space Model for Real-Time Event-Driven Temporal Perception
  Geoffroy Keime, Nicolas Cuperlier, Benoit R. Cottereau · Sep 2026 · arXiv
• ASPIRE: Asynchronous Batched Self-Speculative Decoding for Long-Context LLM Inference
  Amir Ziashahabi, Hossein Entezari Zarch, Lei Gao, Murali Annavaram, Salman Avestimehr · Sep 2026 · arXiv
• Block Parallelism For Efficient Distributed Long-Context Diffusion Language Model Training
  Tarun Suresh, Pranshu Chaturvedi, Hangoo Kang, Parth Shroff, Ishan S. Khare, Hermann Kumbong, Azalia Mirhoseini · Sep 2026 · arXiv
• Elastic Threshold Attention: Learned Contextual Sparsity for Long-Context Decoding
  Themistoklis Haris, Henry Li, Maryam Karimzadehgan · Sep 2026 · arXiv
• The Attention Within: Consensus Dynamics in Selective State Space Models
  João Pedro Silvestre, Álvaro Rodríguez Abella, Paulo Tabuada · Sep 2026 · arXiv
• SG-Mamba: Sparse Graph-Guided Mamba for Audio-Visual Speech Enhancement
  Guo-Ruei Tseng, Hung-Shin Lee, Hsin-Min Wang, Berlin Chen · Sep 2026 · arXiv
• MeshKV: A Network-on-Chip KV Cache Fabric for Scalable Transformer Decoding Accelerators
  Dong Liu, Yanxuan Yu · Sep 2026 · arXiv
• Riemannian--Lorentz Fusion of Vision Transformers and State-Space Models
  Badri N. Patro, Vijay S. Agneeswaran · Sep 2026 · arXiv
• What Does Layer-Importance Reveal About Transformers and State-Space Models?
  Istabrak Abbes, Nizar Islah, Irina Rish, Sarath Chandar · Sep 2026 · arXiv
• Long-Context Demonstration Selection Using State Space Models
  Ziniu Zhang, Zhenshuo Zhang, Ruoxuan Xiong, Gene Cooperman, Hongyang R. Zhang · Sep 2026 · arXiv
• Channel-Wise and Token-Aware Post-Training Quantization for Visual State Space Duality
  Jonghyeon Lim, Changhoon Yim · Sep 2026 · arXiv
• Video-HolmesV2: Can MLLMs Reason with Spatio-Temporal Audio-Visual Evidence in Long Videos?
  Zhaoyang Wei, Zipeng Wang, Yushe Cao, Chenhui Qiang, Shuaibing Cheng, Xuesong Yang, Sen Nie, Bowen Jiang, Wenchao Ding, Yanchao Hao, Zheng Wei, Xuehui Yu, Zhenjun Han · Sep 2026 · arXiv
• On the Importance of Gating: Memorization vs. In-Context Learning in State Space Models
  William L. Tong, Aryo Lotfi, Emmanuel Abbe, Kostas Vaggelakos, Vishnu Banna, Etai Littwin, Josh Susskind, Cengiz Pehlevan, Eran Malach · Sep 2026 · arXiv
• CapMem: A Benchmark for Caption-Based Episodic Memory in Egocentric Video
  Dingli Liang, Yiqiao Xie, Yukai Huang, Zhaokai Wang, Weitong Cai, Guangwen Feng, Jifei Song, Zhensong Zhang, Hang Zhang · Sep 2026 · arXiv
• Principled Koopman Representations with Kalman Inference for Efficient Time-Series Prediction
  Ruiquan Li, Yuheng Bu · Sep 2026 · arXiv
• How Good Are Time-Series Foundation Models for Pedestrian Crowd Count Forecasting? A Cross-Dataset Comparative Study
  Theivaprakasham Hari, Ziteng Li, Yanan Xin, Winnie Daamen, Serge Hoogendoorn · Sep 2026 · arXiv
• LLM Inference in a Flash!
  Sebastian Zhao, Minseo Kim, Coleman Hooper, Luca Manolache, Michael W. Mahoney, Yakun Sophia Shao, Kurt Keutzer, Amir Gholami · Sep 2026 · arXiv
• EEG-Xplain: Decoding Neural Black-Boxes of EEG Foundation Models
  Hansong Ma, Junxiao Wang · Sep 2026 · arXiv
• MambaMPD: A Mamba-Driven Segmentation Framework for Marine Pollution Detection from Remote Sensing Imagery
  Shuaiyu Chen, Wei Han, Peng Ren, Chunbo Luo, Zeyu Fu · Sep 2026 · arXiv
• Anatomy of Associative Recall in Fixed-State Recurrences: A Matched-State Decomposition, an Interference Wall, and a Curriculum That Breaks It
  Julian Boesch, Andrew Wee · Sep 2026 · arXiv
• Self-Orchestrating Language Models: Leveraging Semantic Dependence for Efficient Inference
  Tian Jin · Sep 2026 · arXiv
• Physically Partitioned KVCache Format for CPU--GPU Load Balancing in MoE Inference
  Enda Yu, Dezun Dong, Xiangke Liao · Sep 2026 · arXiv
• SpectralShift: Effective Context Window Extension of Gated DeltaNet via Spectral Reparameterization
  Zian Liu, Yiwen Hu, Zican Dong, Tian Xie, Wayne Xin Zhao, Yucheng Ding, Ran Tao, Bryan Dai · Sep 2026 · arXiv
• State of Thought Enables Endogenous Reasoning
  Zhiren Gong, Yikun Hou, Zihao Zeng, Ming Xiao, Chau Yuen, Wei Yang Bryan Lim · Sep 2026 · arXiv
• YOLO12-MambaScan: An Efficient Object Detector with High-Frequency Enhancement and State-Space Modeling
  Hao Wang · Sep 2026 · arXiv
• URCHIN: A Horizontal Spiking Language Model for Data-Constrained Pretraining
  Po-Han Chiang · Sep 2026 · arXiv
• Tabby: An Open Pretraining Recipe for Time Series Foundation Models
  Shifeng Xie, Bahaeddine Abdessalem, Zehao Xiao, Youssef Attia El Hili, Ambroise Odonnat, Zhiwei Dong, Lei Zan, Themis Palpanas, Jianfeng Zhang, Lujia Pan, Keli Zhang, Malik Tiomoko · Sep 2026 · arXiv
• FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometry
  Meng-Li Shih, Shih-Yang Su, Yuliang Zou, Hao Xiang, Haidong Zhu, Vincent Casser, Brian Curless, Dmitry Kalenichenko, Mingxing Tan, Dragomir Anguelov · Sep 2026 · arXiv
• An Ultra-Widefield Swept-Source OCTA Dataset and a Polar-Gated Mamba Network for Retinal Vessel Segmentation
  Yang Liu, Yibing Shen, Keming Zhao, Cenk Jiang, Zhenghang Qian, Zhicheng Du, Chen Xiong, Qidong Shao, Zijun Lin, Yunqi Hu, Jingjing Zhou, Lian Zhang, Peter E. Lobie, Peiwu Qin, Chengming Yang · Sep 2026 · arXiv
• SCDM: Spatial-Contextual Disentanglement Mamba via Differential Inference for Efficient Image Classification
  Mustafa Bora Çelik, Hayriye Aktaş Dinçer, Ayse Keles · Sep 2026 · arXiv
• OneLA: Scaling Linear-Attention Decoding to Large Beams in Generative Recommendation
  Xiangrui Yang, Cheng Peng, Yunfeng Zhao, Liang Zeng, Ao Hu, Jiawei Yang, Shengzhe Wang, Jingshan Lv, Xiao Liang, Chen Yang, Jiaqiang Liu, Yiming Qiu · Sep 2026 · arXiv
• RunningTensor: Generalizing Linear Attention to Higher-Order Recurrent States
  Luca Herranz-Celotti, Vincent Guigue · Sep 2026 · arXiv
• ZGCM-1: A Fully Open and Extremely Efficient Foundation Model for Math and Agentic Search
  Jiyan He, Guang Liang, Hao Liu, Haoxiang Guan, Jinbo Sun, Junyi Guo, Wenjun Feng, Yantai Xie, Yifei Shen, Bin Shao, Chuyang Wei, Kai Chen, Kexin Zhou, Minghang Zhu, Shuxin Zheng, Tie-Yan Liu, Taine Zhao, Wenhui Zhu, Xueyin Xu, Xiaoqing Zhang, Yatao Li, Yuxuan Ren · Sep 2026 · arXiv
• SAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
  Zhiwei Li, Lei Zhu, Hao Gu, Xiang Hu, Yan Wang, Haitao Mi, Sirui Han, Leo Liang, Zhijiang Guo · Sep 2026 · arXiv
• Observation-Anchored Selective Assimilation for Longitudinal Tumor-State Proxy Forecasting in Post-Treatment Glioma
  Yeonjae Jung, Minwoo Shin · Sep 2026 · arXiv
• Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size
  MyungHoon Ryu, XinYu Piao, Jong-Kook Kim · Sep 2026 · arXiv
• Doc2FRC: Length-Consistent Document-Level Machine Translation via Fixed-Range Chunking
  Xiaotian Wang, Youyuan Lin, Zhan Shen, Hitomi Yanaka · Sep 2026 · arXiv
• RoES: Rotational Equivariant Selective-frequency Fusion for Multimodal Images
  Jiabao Wang, Wenjian Liu, Yaoming Cai, Gengyu Zhang, Boyan Zhao, Zijia Zhang, Yao Ding, Xiaobo Liu · Sep 2026 · arXiv