Pith. sign in

REVIEW 7 cited by

Neighboring Autoregressive Modeling for Efficient Visual Generation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2503.10696 v1 pith:WSI376Y5 submitted 2025-03-12 cs.CV eess.IV

Yefei He , Yuanyu He , Shaoxuan He , Feng Chen , Hong Zhou , Kaipeng Zhang , Bohan Zhuang This is my paper · ORCID
classification cs.CVeess.IV
keywords tokensgenerationvisualautoregressiveadjacentdecodedpredictiontimes
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
abstract

Visual autoregressive models typically adhere to a raster-order ``next-token prediction" paradigm, which overlooks the spatial and temporal locality inherent in visual content. Specifically, visual tokens exhibit significantly stronger correlations with their spatially or temporally adjacent tokens compared to those that are distant. In this paper, we propose Neighboring Autoregressive Modeling (NAR), a novel paradigm that formulates autoregressive visual generation as a progressive outpainting procedure, following a near-to-far ``next-neighbor prediction" mechanism. Starting from an initial token, the remaining tokens are decoded in ascending order of their Manhattan distance from the initial token in the spatial-temporal space, progressively expanding the boundary of the decoded region. To enable parallel prediction of multiple adjacent tokens in the spatial-temporal space, we introduce a set of dimension-oriented decoding heads, each predicting the next token along a mutually orthogonal dimension. During inference, all tokens adjacent to the decoded tokens are processed in parallel, substantially reducing the model forward steps for generation. Experiments on ImageNet$256\times 256$ and UCF101 demonstrate that NAR achieves 2.4$\times$ and 8.6$\times$ higher throughput respectively, while obtaining superior FID/FVD scores for both image and video generation tasks compared to the PAR-4X approach. When evaluating on text-to-image generation benchmark GenEval, NAR with 0.8B parameters outperforms Chameleon-7B while using merely 0.4 of the training data. Code is available at https://github.com/ThisisBillhe/NAR.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 7 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Context-weighted Discrete Flow Matching

    cs.LG 2026-07 conditional novelty 7.0 of 10

    Reweighting discrete-flow-matching updates by local context—via a context-weighted sampler or a scaled cross-entropy loss—improves text and molecular generation, cutting generative perplexity on OpenWebText by up to 63%.

  2. Next-Dense-Stride Prediction for Multimodal Autoregressive Visual Modeling

    eess.IV 2026-07 conditional novelty 6.5 of 10

    Next-dense-stride prediction enables coarse-to-fine autoregressive image generation on a single-scale grid and unifies multi-contrast MRI translation, generation, and segmentation in one model.

  3. Progressive Checkerboards for Autoregressive Multiscale Image Generation

    cs.CV 2026-02 conditional novelty 6.0 of 10

    A balanced multiscale checkerboard sampling order for autoregressive image generation allows large scale-up factors without quality loss, because only the total number of serial steps matters.

  4. LaVieID: Local Autoregressive Diffusion Transformers for Identity-Preserving Video Creation

    cs.CV 2025-08 conditional novelty 6.0 of 10

    LaVieID improves identity-preserving text-to-video by routing local facial parts into early DiT blocks and autoregressively refining denoised video tokens in temporal chunks.

  5. SRDiffusion: Accelerate Video Diffusion Inference via Sketching-Rendering Cooperation

    cs.GR 2025-05 conditional novelty 6.0 of 10

    SRDiffusion accelerates video diffusion by switching from a large model to a smaller sibling model after early high-noise steps, using an adaptive threshold for the switch.

  6. Adaptive Visual Autoregressive Acceleration via Dual-Linkage Entropy Analysis

    cs.CV 2026-02 conditional novelty 5.0 of 10

    A training-free entropy-guided token-pruning framework accelerates VAR image generation up to 2.9× with negligible benchmark loss by activating pruning at an adaptive entropy-growth inflection point and adjusting rati...

  7. SridBench: Benchmark of Scientific Research Illustration Drawing of Image Generation Model

    cs.CV 2025-05 conditional novelty 5.0 of 10

    SridBench provides a large multi-discipline benchmark for scientific illustration generation and shows current image generation models, especially GPT-4o-image, remain far below human expert quality.

Pith tools