ArXiv

SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecture

Authors
Haiwen Diao, Penghao Wu, Hanming Deng...
Categories
cs.CV
arXiv
https://arxiv.org/abs/2605.12500v1
PDF
https://arxiv.org/pdf/2605.12500v1

Brief

SenseNova-U1 introduces NEO-unify, a unified multimodal paradigm that treats understanding and generation as a single process. The authors release two models (8B dense and 30B MoE A3B) and claim parity with top-tier understanding-only VLMs across perception, reasoning, decision-making, and spatial tasks, while also achieving strong any-to-image synthesis and interleaved multimodal generation; full design and training details are provided on the project page.

Why it matters

SenseNova-U1 proposes NEO-unify, a native unified multimodal architecture and ships two variants: SenseNova-U1-8B-MoT (dense 8B) and SenseNova-U1-A3B-MoT (mixture-of-experts 30B A3B). Paper posted to arXiv 2026-05-12; authors provide model design, data preprocessing, training, and inference details.

Key details

  • Authors report the models rival top-tier understanding-only VLMs on text understanding, vision–language perception, knowledge reasoning, agentic decision-making, and spatial intelligence, while also delivering strong any-to-image (X2I) synthesis, complex text-rich infographic generation, interleaved vision–language generation, and preliminary success in vision–language-action and world-model scenarios (project: https://github.com/OpenSenseNova/SenseNova-U1).
Source evidence

Abstract

Recent large vision-language models (VLMs) remain fundamentally constrained by a persistent dichotomy: understanding and generation are treated as distinct problems, leading to fragmented architectures, cascaded pipelines, and misaligned representation spaces. We argue that this divide is not merely an engineering artifact, but a structural limitation that hinders the emergence of native multimodal intelligence. Hence, we introduce SenseNova-U1, a native unified multimodal paradigm built upon NEO-unify, in which understanding and generation evolve as synergistic views of a single underlying process. We launch two native unified variants, SenseNova-U1-8B-MoT and SenseNova-U1-A3B-MoT, built on dense (8B) and mixture-of-experts (30B-A3B) understanding baselines, respectively. Designed from first principles, they rival top-tier understanding-only VLMs across text understanding, vision-language perception, knowledge reasoning, agentic decision-making, and spatial intelligence. Meanwhile, they deliver strong semantic consistency and visual fidelity, excelling in conventional or knowledge-intensive any-to-image (X2I) synthesis, complex text-rich infographic generation, and interleaved vision-language generation, with or without think patterns. Beyond performance, we show detailed model design, data preprocessing, pre-/post-training, and inference strategies to support community research. Last but not least, preliminary evidence demonstrates that our models extend beyond perception and generation, performing strongly in vision-language-action (VLA) and world model (WM) scenarios. This points toward a broader roadmap where models do not translate between modalities, but think and act across them in a native manner. Multimodal AI is no longer about connecting separate systems, but about building a unified one and trusting the necessary capabilities to emerge from within.

Comment: Project page: https://github.com/OpenSenseNova/SenseNova-U1