Multimodal foundation models

Trend over time

Evidence papers — 50 most recent of 7241

• Hiding in Plain Sight: A Diffusion-based Mitigation of Geolocation Privacy Leakage in Vision-Language Models
  Yining Wang, Xi Li, Mi Zhang, Xiaohan Zhang, Xiaoyu You, Zhenxing Qian, Mi Wen · Sep 2026 · arXiv
• LLM-Generated Feature Pools for Time Series Anomaly Detection
  Youssef Attia El Hili, Malik Tiomoko, Corinne Ancourt · Sep 2026 · arXiv
• JEPA Guided Diffusion: Predictive Vision-Language Conditioning for Generative Traffic Forecasting
  Trinh Tra Giang Nguyen, Thanh Nguyen Vo, Nguyen Hoai Thuong Bui, Ha Duc Bui · Sep 2026 · arXiv
• AgentVidBench: A Multi-Hop Video Question Answering Benchmark for Evaluating MLLM Agents
  Seoyeon An, Hyeonseo Jang, Minsu Kim, Chanho Lee, Younghan Park, Kangwook Lee · Sep 2026 · arXiv
• The Spoken Wikipedia Presentation Corpus
  Thomas Ranzenberger, Steffen Freisinger, Tobias Bocklet, Korbinian Riedhammer · Sep 2026 · arXiv
• ECG Mirage: Revealing and Mitigating the Underutilisation of ECGs in Vision-Language Models for Clinical Prediction
  Jinning Liang, Mingcheng Zhu, Tingting Zhu · Sep 2026 · arXiv
• Configurable Multi-Stage Vision Pipeline for Crop Disease and Pest Diagnosis
  Naga Ganesh, Chandrashekar M S, Lakshmi Pedapudi, Aakash Singh, Vineet Singh · Sep 2026 · arXiv
• SkillIR: Evolving Scene-Aware Skills for Agentic Image Restoration
  Jie Shao, Shengkai Hu, Xu Zhang, Beihang Song, Yongcheng Jing, Xu Wu, Jun Wan · Sep 2026 · arXiv
• SIRA: Reasoning-Aware Surgical Instrument Segmentation via Query-Anchored Alignment
  Zhibo Zhang, Qijie Wang, Zengqiang Yan · Sep 2026 · arXiv
• Offline Multimodal Large Language Models for Decision Support in Air Operations
  Joao P. A. Dantas, Jelton A. Cunha, Gabriel Dietzsch · Sep 2026 · arXiv
• VLA-Scope: Shift-Aware Failure Prediction for Vision-Language-Action Models
  Kaiwen Zhu, Dongfang Liu, Liangkai Liu · Sep 2026 · arXiv
• ProTracer: Proprioception-Guided Failure Diagnosis in Robot Manipulation
  Chang Dong, Mehdi Hosseinzadeh, King Hang Wong, Lingqiao Liu, Francois Fraysse, Feras Dayoub, Minh Hoai Nguyen · Sep 2026 · arXiv
• Fewer Steps, Better Actions: Rethinking Flow-Matching Inference for VLA Policies
  Zhipeng Tang, Xinda Chen, Weining Rao, Xiao Li, Wenting Tan, Yuning Wang, Xiao Shi, Xiaofang Zhao · Sep 2026 · arXiv
• Beyond Benchmark Scores: Auditing Medical Vision-Language Models for Chest X-Ray Tuberculosis Screening
  Mushir Akhtar, M. Tanveer, Mohd. Arshad · Sep 2026 · arXiv
• Balanced Prompt Adaptation against Entropy-Induced Collapse for Test-Time Binary Segmentation
  Zhengshan Wang, Joshua Charles Webster-Ford, Yifei Tian, Xinxin Wang, Long Chen, Weiping Ding · Sep 2026 · arXiv
• Outcome-Conditioned End-Effector Geometry Across Vision-Language-Action Policies
  Xingyu Lin, Zhuang Li, Zhongrun Wu, Shouquan Zhou, Dehui Du · Sep 2026 · arXiv
• From Retrieval to Recognition:How Vision--Language Models Become OCR Specialists
  Yuanxiang Huangfu, Hanmeng Zhong, Linqing Chen, Jeffrey Tiong Jee Hui · Sep 2026 · arXiv
• Driving on Registers, Reasoning on Risk: Risk-Aware Occupancy for Register-Based End-to-End Autonomous Driving
  Jiaxing Chen, Hengduo Zou, YuKai Qin, Yiren Zhao, Lidong Yu, Bolin Gao · Sep 2026 · arXiv
• ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation
  Boni Hu, Xiong Wei, Haoming Huang, Yong Huang, Chenbo Wang, Yi Yang, Jiancheng Wang, Ruicheng Zhu, Zhimin Yang, Guanglai Liu, Qiaowan Jin, Dongzhuo Wang, Haiwei Kuang, Jiajun Fan, Yue Wu, Jiaxin Wei, Hao Sun, Feihong Yan, Wei Bi, Kaixuan Wang, Zichao Guo, Xiaozhi Chen · Sep 2026 · arXiv
• Touvigation: Embodied Adaptive Object Acquisition for Blind and Low-Vision Users in Unfamiliar Indoor Environments
  George Xi Wang, Xiangyu Li, Shaoyue Wen, Jiaqian Hu, Junan Xie, Yupeng Wang, Ziyue Shi, Qijun Chen, Maaike Bouwmeester, Yuhua Jin, Jing Qian · Sep 2026 · arXiv
• A Scene Language Model for Open-Vocabulary Scene Mapping
  Adam Lilja, Fabio Hübel, Siming He, Junsheng Fu, Claire Tomlin, Lars Hammarstrand, Jitendra Malik, Jonas Frey, Marco Pavone · Sep 2026 · arXiv
• Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interaction
  Qi Chen, Yunfei Chu, Haolin He, Yifan Yang, Zihan Liu, Yuxuan Wang, Ziyang Ma, Ruiyang Xu, Meng Gao, Yinsong Yan, Ling Wang, Hui Wang, Wen Huang, Yiheng Chen, Guanrou Yang, Qiuqiang Kong, Jin Xu, Xie Chen · Sep 2026 · arXiv
• VeriFuse: Bounded Vision-Language Arbitration and Reason-Guided Refinement for Cooperative 3D Perception
  Hongyi Lin, Yiyao Liu, Qi Kang, Heye Huang, Yang Liu, Haris Koutsopoulos, Jinhua Zhao · Sep 2026 · arXiv
• Cube-Splat: High-Fidelity 360° Gaussian Splatting SLAM via Cubemap Factorization and Adjoint-Consistent Optimization
  Xiangfei Guo, Hao Shi, Yufan Zhang, Zhonghua Yi, Yongqi Mao, Xiaoting Yin, Kaiwei Wang · Sep 2026 · arXiv
• Beyond Exact Match: Task-Aware GRPO for Cross-Domain PCBA Visual Question Answering
  Jia Li, Li Dai, Peng Jia, Zhenzhen Hu, Chee Seng Chan, Bingkun Bao, Richang Hong · Sep 2026 · arXiv
• PlaceReasoner-Beta: Reasoning-Driven Macro Placement and Benchmarking
  Qiufeng Li, Chengxuan Wang, Rongqian Chen, Quan Cheng, Yihui Ren, Chia-Tung Ho, David Z. Pan, Tian Lan, Weidong Cao · Sep 2026 · arXiv
• KnowDemo: Knowledge-Guided Robot Demonstration Generation from Human Videos
  Zhiyuan Gao, Yanxiang Zhan, Mohammad Khoshnazar, Jeroen Schäfer, Michael Beetz · Sep 2026 · arXiv
• FOCAL-VLA: Subtask-Guided Geometry Distillation and Implicit World Modeling for Vision-Language-Action Models
  Zhiyuan Gao, Di Wen, Yanxiang Zhan, Mohammad Khoshnazar, Jeroen Schäfer, Kunyu Peng, Michael Beetz · Sep 2026 · arXiv
• M2G-LLM: Enhancing Clinical Prediction via Multimodal Graph Reasoning and LLM Context Injection
  Inyoung Choi, Sukwon Yun, Jiayi Xin, Jie Peng, Tianlong Chen, Qi Long · Sep 2026 · arXiv
• XCalib Depth-Guided Geometric Optimization for Dense Thermal-Visible Video Registration
  Aurelien Godet, Gabriel Jobert, Mauro Dalla Mura · Sep 2026 · arXiv
• MintAct: A Unified Visual Agent for Digital Environments
  Mingfei Gao, Rui Tian, Haiming Gang, Bohan Zhai, Le Zhang, Yuanzheng Gong, Di Feng, Ege Özsoy, Kaixin Ma, Vishwesh Kirthivasan, Oğuzhan Fatih Kar, Roman Bachmann, Anders Boesen Lindbo Larsen, Afshin Dehghan · Sep 2026 · arXiv
• DiaVLo: Diagnosing Behaviours of Vision-Language Models
  Lorenzo Corti, Jie Yang · Sep 2026 · arXiv
• DRT: Dense Reasoning Trace for Efficient and Grounded Multimodal Reasoning
  Wan Xu, Yuanfan Guo, Kevin Han, LaLa Chen, Wangmeng Zuo · Sep 2026 · arXiv
• Samsone: A Family of Open Small Audio Language Models for On-Device Inference
  Piotr Masztalski, Michał K. Grzeszczyk, Olaf Sikorski · Sep 2026 · arXiv
• PRIME: Perception Feedback with Situational Memory Embeddings in VLA Models
  Erik Deinzer, Naya Baslan, Luca Paparusso, Narunas Vaskevicius, Peter Knott, Luigi Palmieri · Sep 2026 · arXiv
• SynthDemo-RL: Breaking the Zero-Reward Barrier in VLA Adaptation with LLM-Guided Synthetic Demonstrations
  Hiroaki Kingetsu, Hiroaki Kurihara, Kaoru Yokoo, Kenji Fukumizu, Manohar Kaul · Sep 2026 · arXiv
• PolyBridgeBench: Benchmarking Multimodal LLMs for Physics-Grounded Bridge Design
  Zicheng Zhao, Dongyin Chen, Rui Xu, Yinghui Xu · Sep 2026 · arXiv
• Refine Then Fusion: Training-Free 3D Point Cloud Adaptation with Priority Refinement and Multi-Modal Knowledge Fusion
  Hang Cheng, Yan Chen, Mingyu Fan, Long Zeng · Sep 2026 · arXiv
• GALA: Geometry-Aware Latent Action Modeling for Vision-Language-Action Model Pretraining across Embodiments
  Yichen Liu, Puzhen Yuan, Xiang Zhu, Yanjiang Guo, Jianyu Chen · Sep 2026 · arXiv
• MIST: Multimodal Survival Prediction with Genomic-Guided Histology Attention
  Muhammet Sami Yavuz, Sabri Mustafa Kahya, Richard R. Chen, Jana Lipkova, Benedikt Wiestler · Sep 2026 · arXiv
• When Should a Failing Robot Ask? Initiating Corrective Human-Robot Dialogue from Audited Sensor Evidence
  Eshika Pathak, Leela Krishna · Sep 2026 · arXiv
• Benchmarking the Explanatory Quality of Open-Weight Vision-Language Models in Face Recognition
  Laurent Colbois, Sébastien Marcel · Sep 2026 · arXiv
• From Stress to Affect: Multimodal Deep Learning for Physiological Emotion Recognition Across Wearable Sensor Modalities
  Desta Haileselassie Hagos, Saurav Keshari Aryal, Legand L. Burge · Sep 2026 · arXiv
• MemeTAG: Keyword-Driven Meme Classification through Tag Embedding Reconstruction
  Akshit Sharma, Prashant W. Patil · Sep 2026 · arXiv
• PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers
  Jiachen Yao, Zi-Siang Hsu, Xi Deng, Aditi Gupta, Xin Ju, Sally M Benson, Gege Wen, Anima Anandkumar · Sep 2026 · arXiv
• GeoAAC: Geometry-Based Adaptive Action Chunking from Denoising Trajectories in VLA Policies
  Xin Chen, Sen Chen, Yujuan Ding, Jian Liu, Guoqing Wang, Wei Ye, Heng Tao Shen, Yi Bin · Sep 2026 · arXiv
• Agile-WAM: An Agile Tactile World Action Model for Contact-Rich Robot Control
  Hanchu Zhou, Brendan Lynch, Raman Goyal, Dechen Gao, Begum Kasap, Boqi Zhao, Junshan Zhang · Sep 2026 · arXiv
• Earth Surface Immune System for Rapid Monitoring of Unknown Anomalies
  Jingtao Li, Qian Zhu, Xinyu Wang, Deren Li, Liangpei Zhang, Yanfei Zhong · Sep 2026 · arXiv
• E-AVI: Evidence-Grounded Multimodal Assessment for Automated Video Interviews
  Haoshen Wang, Dongbo Che, Zeyi Xie, Yuanjie Du, Shicheng Hua, Xingyu Wang · Sep 2026 · arXiv
• HIL-UMI: Bringing Human-in-the-Loop Post-Training of Vision-Language-Action Models to Universal Manipulation Interface
  Zimu Han, Yiming Zeng, Jiyao Zhang, Zihao Zhao, Yuanfei Wang, Yixiang Jin, Shiqi Li, Shuangben Chen, Wei Huang, Ruodai Li, Hui Shen, Hao Dong · Sep 2026 · arXiv