Pith. sign in

REVIEW 4 major objections 5 minor 91 references

ARCON: Advancing Auto-Regressive Continuation for Driving Videos

T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read ARCON claims that predicting semantic segmentation tokens before RGB tokens in an autoregressive large vision model makes long driving-video continuation more stable and consistent.

desk verdict A genuinely new interleaving idea with real FVD gains, but the headline comparison is weakened by test-set temperature selection and a circular consistency metric; still worth refereeing. read the letter →

arxiv 2412.03758 v3 pith:MJ2S6FNJ submitted 2024-12-04 cs.CV

Ruibo Ming , Jingwei Wu , Zhewei Huang , Zhuoxuan Ju , Jianming HU , Lihui Peng , Shuchang Zhou This is my paper · ORCID
classification cs.CV
keywords auto-regressivevideogenerationcontinuationsemantictokenslargevisionmodelworldautonomousdrivingdiscretetokenizertexturestitching
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper sets out to show that an auto-regressive large vision model can generate long, temporally stable driving videos if it is asked to predict a semantic segmentation map before predicting each RGB frame. The proposed ARCON scheme encodes both RGB frames and semantic maps into the same discrete token vocabulary, then interleaves the two token types so that the model continues the scene structure first and translates that structure into pixels. On BDD100K and nuScenes, adding semantic tokens lowers FVD from 91.6 to 73.6 and from 84.2 to 57.6 respectively, and slows the tendency of long rollouts to freeze into near-stationary frames. A separate flow-based texture-stitching step transfers texture from high-resolution input frames to the low-resolution generated tokens, improving visual quality during decoding.

What carries the argument

The load-bearing mechanism is the interleaved token sequence: semantic tokens from a Uniformer segmentation map and RGB tokens from the same frame are both encoded by the same MAGVIT-v2 tokenizer, and the LVM is trained to predict first the semantic tokens and then the RGB tokens of each future frame. This arrangement decomposes continuation into structure prediction plus structure-to-pixel translation, and it makes the model's next-token objective explicitly aware of high-level scene layout. The flow-based feature warping decoder is supporting machinery that borrows texture from reference frames during decoding rather than improving the tokenizer itself.

What would settle it

Swap the semantic modality for a different structural signal (e.g., depth maps or optical flow) or shuffle the semantic class labels during training and re-measure FVD and optical-flow magnitude on nuScenes; if the long-horizon stability persists, the claimed role of semantic structure is not confirmed.

Watch

Extended reading notes

Core claim

ARCON's central claim is that semantic tokens are a cheap and effective scaffold for auto-regressive video continuation. Instead of predicting only RGB tokens, the model first generates the discrete tokens of a semantic segmentation map for the next frame, then generates that frame's RGB tokens; the two token streams share one MAGVIT-v2 tokenizer and one LLaMA-style transformer. The paper reports that this interleaving reduces degeneration into repeated frames, improves temporal consistency, and produces generated semantic maps that align closely with the generated RGB frames, reaching 77.4% re-segmentation accuracy on nuScenes. The method is a training and inference scheme plus a decoder-side texture transfer, not a new tokenizer or backbone.

Load-bearing premise

The load-bearing premise is that semantic segmentation maps produced by Uniformer and tokenized by MAGVIT-v2 faithfully capture the structure that matters for continuation, so the interleaving benefit is not an artifact of this particular pseudo-label pipeline.

Editorial extensions

If this is right

  • Any auxiliary modality that is cheap to tokenize and structurally informative could be inserted in the same interleaved pattern, without retraining the tokenizer.
  • Because the same token vocabulary is used for both modalities, the scheme adds no new codebook or embedding parameters beyond the semantic input stream.
  • The FVD gains on nuScenes without fine-tuning indicate that the structural scaffold transfers across driving datasets, not just within the training distribution.
  • The texture-stitching decoder improves FVD on both in-distribution and out-of-distribution clips, so it is a general decode-time enhancement for token-based generators.
  • The strong RGB-semantic consistency implies the generated semantic maps could serve as a free structural signal for downstream modules such as planning or anomaly detection.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A direct test the paper leaves open is whether the benefit is specific to semantics or generic to any compact structural modality; depth, optical flow, or lane maps could be swapped in and compared under the same protocol.
  • The 77.4% re-segmentation accuracy is measured with the same Uniformer that produced the pseudo-labels, so a stricter evaluation would use a different segmenter or human-annotated maps to rule out label-copying.
  • For very long rollouts the reference frame used by texture stitching recedes into the past, so the method may need periodic re-anchoring to recent high-quality frames to keep texture transfer effective.
  • If the interleaving works by giving the model an explicit 'what happens next' prediction, it could be combined with text or action-conditioned tokens to make driving world models controllable, a step this paper does not attempt.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes ARCON, an autoregressive large vision model for driving-video continuation. The main methodological idea is to interleave semantic tokens (obtained by running a pre-trained Uniformer segmenter on RGB frames and encoding the resulting maps with the MAGVIT-v2 tokenizer) with RGB tokens during both training and inference, so that the model first predicts semantic structure and then translates it into pixels. A secondary component is a flow-based feature-warping decoder that transfers texture from high-resolution input frames into the decoded low-resolution generated frames. Experiments on BDD100K and nuScenes report FVD improvements for the semantic-interleaved model over an RGB-only variant, reduced optical-flow magnitude decay, high semantic/RGB consistency, and qualitative long-video generation. The paper also compares against several driving-world-model baselines on nuScenes without fine-tuning.

Significance. If the central claim is correct, ARCON provides a practical and conceptually clean way to reduce degeneration in long autoregressive video generation by decomposing the task into semantic continuation and modality translation. The use of external metrics (FVD, RAFT optical-flow magnitude) for the main comparison is a strength, as is the explicit ablation of the interleaving scheme in Table 4 and the flow-warping decoder in Table 3. The paper is, however, primarily an empirical systems paper: the key evidence for Contribution 2 rests on a small number of FVD point estimates whose evaluation protocol is incompletely specified and whose temperature selection is asymmetric between the compared conditions. These issues are fixable, but until they are addressed the quantitative support for the headline claim is not conclusive.

major comments (4)
  1. [Table 4, §4.5] The headline comparison between 'w/o sem' and the semantic-interleaved model is not a best-vs-best comparison as reported. Table 4 gives FVD values of 91.6 vs. 73.6 on BDD100K and 84.2 vs. 57.6 on nuScenes for 'w/o sem' versus the baseline, and then shows an inference-temperature sweep for t = 0.2, 0.5, 0.7, 1.0 whose t = 0.7 row exactly matches the baseline. No analogous temperature sweep is reported for 'w/o sem'. Since t = 0.7 was selected using FVD computed on the same BDD100K test set and nuScenes validation set on which the final numbers are reported, the apparent benefit of semantic tokens could partly be an artifact of asymmetric hyperparameter selection. Please report a temperature sweep for the 'w/o sem' condition, or otherwise justify why t = 0.7 is the appropriate comparison point for both models.
  2. [§4.3, Table 2] The evaluation protocol for the main comparison table is underspecified. Table 2 states only that FVD is computed on the nuScenes validation set; it does not specify the number of generated frames per clip, the number of clips, the generation resolution, the conditioning frames, the sampling temperature, or the FVD implementation/version. Table 3 gives such details for its own ablation (400 samples, 16-frame clips at 224x224), but Table 4 and Table 2 do not state whether the same protocol applies. Without this information the comparison with external baselines cannot be reproduced, and the internal 'w/o sem' versus baseline comparison may depend on clip length. Please state the exact protocol for every FVD/FID table and, ideally, report variance over multiple seeds or bootstrap intervals, since all numbers are point estimates.
  3. [Figure 5, §4.2] The reported 77.4% semantic/RGB consistency is computed by re-segmenting generated RGB frames with the same Uniformer model that produced the training pseudo-labels. This makes the consistency sub-claim partially circular: the evaluator is the same function that defined the supervision signal, so high agreement may reflect the model reproducing the pseudo-label distribution rather than genuine structural alignment. I am not asking to remove the figure, but the claim should be corroborated with an independent segmenter or a different evaluation protocol (e.g., human ratings or a second segmentation model), and the circularity should be acknowledged in the text.
  4. [§3.1–3.2] The paper assumes that semantic maps encoded by the RGB-trained MAGVIT-v2 tokenizer faithfully preserve the high-level structure needed for continuation, but this is not validated. Section 3.2 says the same tokenizer is used for both modalities without specifying how a semantic map (a single-channel label array) is formatted before encoding (e.g., colorized RGB, repeated channels, or some other projection). Table 1's codebook-coverage statistics suggest the tokenizer does allocate codes to semantic inputs, but they do not show that decoded semantic maps are semantically accurate. Please describe the preprocessing of semantic maps and report reconstruction quality of semantic tokens (e.g., mIoU between original and re-encoded semantic maps), since this is a load-bearing assumption for interpreting the interleaving benefit as a semantic-structure effect.
minor comments (5)
  1. [§3.1 vs. §4.1] There is an internal inconsistency in the number of tokens per frame: Section 3.1 says each 112x112x3 frame is converted into 784 1D tokens, while Section 4.1 says frames are encoded to 392 tokens per image. With a 14x14 spatial grid and two factorized codebooks, 392 is the plausible count, and it also matches the context-length arithmetic: 16,384 tokens would fit about 41 frames at 392 tokens per frame, not 20 frames. Please correct the 784 figure and the related 'no more than 20 images' statement.
  2. [§4.4] The paragraph beginning 'As exhibited in Tab. 2...' is duplicated verbatim from Section 4.3. Remove the duplicate or replace it with a discussion specific to the qualitative results.
  3. [Table 4] The row label 'semantic segmentation' is confusing because it heads both the 'w/o sem' and 'baseline' rows; consider renaming the block 'Semantic interleaving' and labeling the rows 'RGB-only' and 'ARCON (semantic + RGB)'.
  4. [§4.1] The paper states that a 20B model is trained, but it is not clear which quantitative results use the 7B model and which use the 20B model. Please state the model size for each table and figure, since the probing experiments in Section 4.2 explicitly concern the 7B model.
  5. [Figure 4] The caption reports optical-flow mean magnitude but does not state whether the values are averaged over all pixels, frames, or clips, nor whether the RAFT flows are computed at the generation resolution or a downsampled resolution. Adding these details would make the figure interpretable.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular derivation: ARCON's semantic-token benefit rests on external FVD and optical-flow measurements; the noted evaluation-design concerns are not reductions by construction.

full rationale

The paper's derivation chain is self-contained. Semantic tokens are produced by a fixed external Uniformer segmenter and encoded with the open-source MAGVIT-v2 tokenizer, and the LVM is trained with ordinary next-token prediction. The central quantitative support for Contribution 2 is the FVD improvement on the external nuScenes validation set and the RAFT-based optical-flow magnitude measurement, both of which are independent of the model's own fitted parameters. The w/o-sem condition is the same model prompted to generate RGB-only tokens, so the comparison is an inference-mode ablation rather than a fitted parameter being renamed as a prediction. The paper does select inference temperature t=0.7 from Table 4 on the same test sets, and it does not report a temperature sweep for the w/o-sem condition; this is a test-set selection concern that can weaken the strength of the comparison, but it is not a reduction-by-construction and no equation or definition equates the output to the input. Similarly, the 77.4% semantic/RGB consistency figure is computed with the same Uniformer model that produced the training pseudo-labels, which limits that sub-metric as independent evidence, but the load-bearing FVD claim does not depend on it. Self-citations such as [26], [28], and [42] are used as related-work support or as a baseline and are not load-bearing. No uniqueness theorem, ansatz, or prior result from the same authors is invoked to force the central choice. Therefore no significant circularity is present.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The method is empirical: it depends on the pseudo-labeling pipeline (Uniformer), on the RGB-trained MAGVIT-v2 tokenizer being usable for semantic maps, on a chosen interleaving schedule, and on a searched sampling temperature. No new physical entities are introduced, so the invented-entities list is empty.

free parameters (3)
  • Inference sampling temperature t = 0.7
    Table 4 sweeps t=0.2, 0.5, 0.7, 1.0 and the best FVD values occur at t=0.7, which is used for the headline results. This is a validation-set search over a parameter that strongly affects FVD.
  • Semantic/RGB interleaving schedule = one semantic map per RGB frame; 50% of training samples are interleaved
    The paper alternates semantic tokens before RGB tokens for each frame and trains half the data with this format. No ablation varies the ratio, position, or frequency of semantic tokens, yet the claimed benefit depends on this exact schedule.
  • Training and evaluation frame rates = 3 Hz training sampling; 0.6 Hz evaluation
    The test-time frame rate is five times slower than training and strongly affects FVD and optical-flow-based motion statistics. This choice is made by the authors and is not compared against alternatives.
assumptions (4)
  • domain assumption MAGVIT-v2 tokenizer trained on RGB images can encode semantic segmentation maps into discrete tokens with sufficient fidelity.
    Section 3.1: 'RGB images and semantic maps are encoded into discrete tokens using the same tokenizer.' No reconstruction or fidelity check for semantic maps is reported.
  • domain assumption Uniformer semantic segmentation pseudo-labels are a correct and sufficient high-level structural prior for driving scenes.
    Section 3.2 uses Uniformer to extract semantic maps and treats them as the auxiliary modality to be predicted. Errors in the segmenter become training targets and also the reference for the consistency metric in Fig. 5.
  • domain assumption Cross-entropy next-token prediction on discrete visual tokens is a suitable objective for video continuation quality.
    Section 3.1: 'train the model to minimize the cross-entropy loss for predicting the next token.' The paper assumes this objective aligns with temporal consistency and visual quality; validation is only indirect through FVD/FID.
  • domain assumption FVD computed on short clips is comparable across methods even when frame rate, context length, and generation protocol differ.
    Table 2 compares FVD across many driving world models without specifying each method's conditions; the ablation section defines 16-frame 224x224 clips, but the main comparison protocol is not fully stated.

how reviews work

0 comments
Cite this review

Pith. "Pith review of ARCON: Advancing Auto-Regressive Continuation for Driving Videos." pith.science (2026). https://pith.science/paper/MJ2S6FNJ

@misc{pith2026241203758,
  author       = {Pith},
  title        = {Pith review of: ARCON: Advancing Auto-Regressive Continuation for Driving Videos},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/MJ2S6FNJ}},
  note         = {Machine review of arXiv:2412.03758}
}
read the original abstract

Recent advancements in auto-regressive large language models (LLMs) have led to their application in video generation. This paper explores the use of Large Vision Models (LVMs) for video continuation, a task essential for building world models and predicting future frames. We introduce ARCON, a scheme that alternates between generating semantic and RGB tokens, allowing the LVM to explicitly learn high-level structural video information. We find high consistency in the RGB images and semantic maps generated without special design. Moreover, we employ an optical flow-based texture stitching method to enhance visual quality. Experiments in autonomous driving scenarios show that our model can consistently generate long videos.

Figures

Figures reproduced from arXiv: 2412.03758 by the authors.

Figure 1
Figure 1. Auto-regressively generated minute-level video using ARCON. We show a sample video clip from the BDD100K dataset. We auto-regressively generate 45 frames given the first 3 frames at 0.6Hz. The ego-car moves forward in a short period and changes lanes to the right in preparation for a right turn. After the right turn, it continues to move forward. This example demonstrates that our model can generate reasonable first… view at source ↗
Figure 2
Figure 2. The structure of our ARCON model. left: We use Uniformer [33] to estimate the semantic maps. RGB images and semantic maps are encoded into discrete tokens using the same tokenizer [85]. right: We use an auto-regressive model to alternately predict RGB tokens and semantic tokens. During image decoding, the original frame can provide texture guidance for the generated results. modeling. Notable works leveraging auto-r… view at source ↗
Figure 3
Figure 3. Flow-based feature warping in decoder. During the decoding of generated tokens, some auxiliary features can be transferred from reference tokens using a flow-based warping. The input to the right-side decoder is additionally concatenated with a warped feature. We can opt for higher-resolution reference frames to provide larger feature maps, and the feature maps of the gener￾ated frames are aligned with them through … view at source ↗
Figures from the paper (6 more)
Figure 4
Figure 4. Figure 4: Optical flow vector magnitude decay. We generate 150 15-frame clips on the nuScenes validation set and compute the optical flow mean magnitude with a pre-trained RAFT model [57] between adjacent frames. A lower value indicates less motion, i.e., a more stationary video…
Figure 5
Figure 5. Figure 5: Consistency between generated semantic maps and RGB images. We use the same Uniformer [33] model used in the pipeline to perform semantic segmentation on the frame sequence generated by our ARCON model. We confirm there is a high de￾gree of correspondence when the two …
Figure 6
Figure 6. Figure 6: Video continuation samples. The first example demonstrates that our model can make autonomous decisions about the ego car’s driving action by the driving action of the car in front of it and that the car in front of it will still appear in the picture after making a tu…
Figure 7
Figure 7. Figure 7: The influence of semantic tokens. We choose a challenging nighttime scenario to highlight the importance of semantic segmentation, as it is less affected by the lighting conditions in the video. Semantic tokens assist the model in regenerating the black vehicle ahead a…
Figure 8
Figure 8. Figure 8: Generation across multiple timelines. The leftmost arrows indicate the driving directions of the green car ahead and the ego car, respectively. 4.3. Quantitative results We evaluate our ARCON model’s capability on video con￾tinuation and compare with related video gene…
Figure 9
Figure 9. Figure 9: Video continuation. As an optical flow-based method, DMVFN [26] struggles to generate objects or scenes that do not appear in historical frames. Meanwhile, CogVideoX [81] tends to produce motion blur in areas with significant motion. In contrast, our ARCON model genera…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

91 extracted references · 32 canonical work pages

  1. [1]

    4m-21: An any-to-any vision model for tens of tasks and modalities

    Roman Bachmann, O ˘guzhan Fatih Kar, David Mizrahi, Ali Garjani, Mingfei Gao, David Griffiths, Jiaming Hu, Afshin Dehghan, and Amir Zamir. 4m-21: An any-to-any vision model for tens of tasks and modalities. In NeurIPS, 2024. 1, 3

    2024

  2. [2]

    Sequential modeling enables scalable learn- ing for large vision models

    Yutong Bai, Xinyang Geng, Karttikeya Mangalam, Amir Bar, Alan L Yuille, Trevor Darrell, Jitendra Malik, and Alexei A Efros. Sequential modeling enables scalable learn- ing for large vision models. In CVPR, 2024. 1, 3, 4, 6

    2024

  3. [3]

    Video pretraining (vpt): Learning to act by watching unlabeled online videos

    Bowen Baker, Ilge Akkaya, Peter Zhokov, Joost Huizinga, Jie Tang, Adrien Ecoffet, Brandon Houghton, Raul Sampe- dro, and Jeff Clune. Video pretraining (vpt): Learning to act by watching unlabeled online videos. In NeurIPS, 2022. 2

    2022

  4. [4]

    Beit: Bert pre-training of image transformers

    Hangbo Bao, Li Dong, Songhao Piao, and Furu Wei. Beit: Bert pre-training of image transformers. In ICLR, 2022. 2

    2022

  5. [5]

    Video generation models as world simulators

    Tim Brooks, Bill Peebles, Connor Holmes, Will DePue, Yufei Guo, Li Jing, David Schnurr, Joe Taylor, Troy Luh- man, Eric Luhman, Clarence Ng, Ricky Wang, and Aditya Ramesh. Video generation models as world simulators

  6. [6]

    Language models are few-shot learners

    Tom Brown, Benjamin Mann, Nick Ryder, Melanie Sub- biah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakan- tan, Pranav Shyam, Girish Sastry, Amanda Askell, Sand- hini Agarwal, Ariel Herbert-V oss, Gretchen Krueger, Tom Henighan, Rewon Child, Aditya Ramesh, Daniel Ziegler, Jeffrey Wu, Clemens Winter, Chris Hesse, Mark Chen, Eric Sigler, Mateusz Litwin, S...

    1901

  7. [7]

    nuscenes: A multi- modal dataset for autonomous driving

    Holger Caesar, Varun Bankiti, Alex H Lang, Sourabh V ora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Gi- ancarlo Baldan, and Oscar Beijbom. nuscenes: A multi- modal dataset for autonomous driving. In CVPR, 2020. 5, 6, 7, 8

    2020

  8. [8]

    Quo vadis, action recognition? a new model and the kinetics dataset

    Joao Carreira and Andrew Zisserman. Quo vadis, action recognition? a new model and the kinetics dataset. In CVPR,

Show all 91 references
  1. [9]

    A short note on the kinetics-700 human action dataset

    Joao Carreira, Eric Noland, Chloe Hillier, and Andrew Zis- serman. A short note on the kinetics-700 human action dataset. arXiv preprint arXiv:1907.06987, 2019. 5, 8

    1907 arXiv

  2. [10]

    Maskgit: Masked generative image transformer

    Huiwen Chang, Han Zhang, Lu Jiang, Ce Liu, and William T Freeman. Maskgit: Masked generative image transformer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11315–11325, 2022. 3

    2022

  3. [11]

    Generative pre- training from pixels

    Mark Chen, Alec Radford, Rewon Child, Jeffrey Wu, Hee- woo Jun, David Luan, and Ilya Sutskever. Generative pre- training from pixels. In ICML, 2020. 2

    2020

  4. [12]

    An image is worth 16x16 words: Transformers for image recognition at scale

    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Syl- vain Gelly, Jakob Uszkoreit, and Neil Houlsby. An image is worth 16x16 words: Transformers for image recognition ...

    2021

  5. [13]

    Taming transformers for high-resolution image synthesis

    Patrick Esser, Robin Rombach, and Bjorn Ommer. Taming transformers for high-resolution image synthesis. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 12873–12883, 2021. 3

    2021

  6. [14]

    Taming transformers for high-resolution image synthesis

    Patrick Esser, Robin Rombach, and Bjorn Ommer. Taming transformers for high-resolution image synthesis. In CVPR,

  7. [15]

    Restructuring vector quantization with the rotation trick

    Christopher Fifty, Ronald G Junkins, Dennis Duan, Aniketh Iger, Jerry W Liu, Ehsan Amid, Sebastian Thrun, and Christopher R´e. Restructuring vector quantization with the rotation trick. arXiv preprint arXiv:2410.06424, 2024. 8

    2024 arXiv

  8. [16]

    Vista: A generalizable driving world model with high fidelity and versatile controllability

    Shenyuan Gao, Jiazhi Yang, Li Chen, Kashyap Chitta, Yihang Qiu, Andreas Geiger, Jun Zhang, and Hongyang Li. Vista: A generalizable driving world model with high fidelity and versatile controllability. arXiv preprint arXiv:2405.17398, 2024. 6

    2024 arXiv

  9. [17]

    Simvp: Simpler yet better video prediction

    Zhangyang Gao, Cheng Tan, Lirong Wu, and Stan Z Li. Simvp: Simpler yet better video prediction. In CVPR, 2022. 1

    2022

  10. [18]

    Worldgpt: Empowering llm as multimodal world model

    Zhiqi Ge, Hongzhe Huang, Mingze Zhou, Juncheng Li, Guoming Wang, Siliang Tang, and Yueting Zhuang. Worldgpt: Empowering llm as multimodal world model. In ACMMM, 2024. 1

    2024

  11. [19]

    Imagebind: One embedding space to bind them all

    Rohit Girdhar, Alaaeldin El-Nouby, Zhuang Liu, Mannat Singh, Kalyan Vasudev Alwala, Armand Joulin, and Ishan Misra. Imagebind: One embedding space to bind them all. In CVPR, 2023. 1, 3

    2023

  12. [20]

    Photorealistic video generation with diffusion models

    Agrim Gupta, Lijun Yu, Kihyuk Sohn, Xiuye Gu, Meera Hahn, Li Fei-Fei, Irfan Essa, Lu Jiang, and Jos ´e Lezama. Photorealistic video generation with diffusion models. arXiv preprint arXiv:2312.06662, 2023. 3

    2023 arXiv

  13. [21]

    Recurrent world models facilitate policy evolution

    David Ha and J ¨urgen Schmidhuber. Recurrent world models facilitate policy evolution. NeurIPS, 2018. 1

    2018

  14. [22]

    Mastering diverse domains through world models

    Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, and Timothy Lillicrap. Mastering diverse domains through world models. arXiv preprint arXiv:2301.04104, 2023. 1

    2023 arXiv

  15. [23]

    Masked autoencoders are scalable vision learners

    Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Doll´ar, and Ross Girshick. Masked autoencoders are scalable vision learners. In CVPR, 2022. 2

    2022

  16. [24]

    Streamingt2v: Con- sistent, dynamic, and extendable long video generation from text

    Roberto Henschel, Levon Khachatryan, Daniil Hayrapetyan, Hayk Poghosyan, Vahram Tadevosyan, Zhangyang Wang, Shant Navasardyan, and Humphrey Shi. Streamingt2v: Con- sistent, dynamic, and extendable long video generation from text. arXiv preprint arXiv:2403.14773, 2024. 6

    2024 arXiv

  17. [25]

    Gaia-1: A generative world model for au- tonomous driving

    Anthony Hu, Lloyd Russell, Hudson Yeo, Zak Murez, George Fedoseev, Alex Kendall, Jamie Shotton, and Gian- luca Corrado. Gaia-1: A generative world model for au- tonomous driving. arXiv preprint arXiv:2309.17080, 2023. 1, 4

    2023 arXiv

  18. [26]

    A dynamic multi-scale voxel flow network for video prediction

    Xiaotao Hu, Zhewei Huang, Ailin Huang, Jun Xu, and Shuchang Zhou. A dynamic multi-scale voxel flow network for video prediction. In CVPR, pages 6121–6131, 2023. 8

    2023

  19. [27]

    Driving- world: Constructingworld model for autonomous driving via video gpt

    Xiaotao Hu, Wei Yin, Mingkai Jia, Junyuan Deng, Xiaoyang Guo, Qian Zhang, Xiaoxiao Long, and Ping Tan. Driving- world: Constructingworld model for autonomous driving via video gpt. arXiv preprint arXiv:2412.19505, 2024. 6 9

    2024 arXiv

  20. [28]

    Step-audio: Unified understanding and generation in intelligent speech interaction

    Ailin Huang, Boyong Wu, Bruce Wang, Chao Yan, Chen Hu, Chengli Feng, Fei Tian, Feiyu Shen, Jingbei Li, Min- grui Chen, et al. Step-audio: Unified understanding and generation in intelligent speech interaction. arXiv preprint arXiv:2502.11946, 2025. 4

    2025 arXiv

  21. [29]

    Subjectdrive: Scaling genera- tive data in autonomous driving via subject control

    Binyuan Huang, Yuqing Wen, Yucheng Zhao, Yaosi Hu, Yingfei Liu, Fan Jia, Weixin Mao, Tiancai Wang, Chi Zhang, Chang Wen Chen, et al. Subjectdrive: Scaling genera- tive data in autonomous driving via subject control. arXiv preprint arXiv:2403.19438, 2024. 6

    2024 arXiv

  22. [30]

    Bert: Pre-training of deep bidirectional trans- formers for language understanding

    Jacob Devlin Ming-Wei Chang Kenton and Lee Kristina Toutanova. Bert: Pre-training of deep bidirectional trans- formers for language understanding. In Proceedings of naacL-HLT. Minneapolis, Minnesota, 2019. 1

    2019

  23. [31]

    Drivegan: Towards a controllable high-quality neural simulation

    Seung Wook Kim, Jonah Philion, Antonio Torralba, and Sanja Fidler. Drivegan: Towards a controllable high-quality neural simulation. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 5820–5829, 2021. 6

    2021

  24. [32]

    Videopoet: A large language model for zero-shot video gen- eration

    Dan Kondratyuk, Lijun Yu, Xiuye Gu, Jos ´e Lezama, Jonathan Huang, Grant Schindler, Rachel Hornung, Vigh- nesh Birodkar, Jimmy Yan, Ming-Chang Chiu, et al. Videopoet: A large language model for zero-shot video gen- eration. arXiv preprint arXiv:2312.14125, 2023. 1, 3, 4

    2023 arXiv

  25. [33]

    Uniformer: Uni- fying convolution and self-attention for visual recognition

    Kunchang Li, Yali Wang, Junhao Zhang, Peng Gao, Guanglu Song, Yu Liu, Hongsheng Li, and Yu Qiao. Uniformer: Uni- fying convolution and self-attention for visual recognition. TPAMI, 45(10):12581–12600, 2023. 3, 4, 5

    2023

  26. [34]

    Drivingdif- fusion: Layout-guided multi-view driving scene video generation with latent diffusion model

    Xiaofan Li, Yifu Zhang, and Xiaoqing Ye. Drivingdif- fusion: Layout-guided multi-view driving scene video generation with latent diffusion model. arXiv preprint arXiv:2310.07771, 2023. 6

    2023 arXiv

  27. [35]

    World model on million-length video and language with ringattention

    Hao Liu, Wilson Yan, Matei Zaharia, and Pieter Abbeel. World model on million-length video and language with ringattention. arXiv preprint arXiv:2402.08268, 2024. 3

    2024 arXiv

  28. [36]

    Video frame synthesis using deep voxel flow

    Ziwei Liu, Raymond A Yeh, Xiaoou Tang, Yiming Liu, and Aseem Agarwala. Video frame synthesis using deep voxel flow. In ICCV, 2017. 2

    2017

  29. [37]

    Vdt: General-purpose video diffusion transformers via mask modeling

    Haoyu Lu, Guoxing Yang, Nanyi Fei, Yuqi Huo, Zhiwu Lu, Ping Luo, and Mingyu Ding. Vdt: General-purpose video diffusion transformers via mask modeling. In ICLR, 2024. 4

    2024

  30. [38]

    Wovogen: World volume-aware diffusion for con- trollable multi-camera driving scene generation

    Jiachen Lu, Ze Huang, Zeyu Yang, Jiahui Zhang, and Li Zhang. Wovogen: World volume-aware diffusion for con- trollable multi-camera driving scene generation. In Eu- ropean Conference on Computer Vision , pages 329–345. Springer, 2025. 6

    2025

  31. [39]

    Masa-sr: Matching acceleration and spatial adaptation for reference-based image super-resolution

    Liying Lu, Wenbo Li, Xin Tao, Jiangbo Lu, and Jiaya Jia. Masa-sr: Matching acceleration and spatial adaptation for reference-based image super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6368–6377, 2021. 4

    2021

  32. [40]

    Videofusion: Decomposed diffusion mod- els for high-quality video generation

    Zhengxiong Luo, Dayou Chen, Yingya Zhang, Yan Huang, Liang Wang, Yujun Shen, Deli Zhao, Jingren Zhou, and Tieniu Tan. Videofusion: Decomposed diffusion mod- els for high-quality video generation. arXiv preprint arXiv:2303.08320, 2023. 1

    2023 arXiv

  33. [41]

    Open-magvit2: An open-source project toward democratizing auto-regressive visual gener- ation

    Zhuoyan Luo, Fengyuan Shi, Yixiao Ge, Yujiu Yang, Limin Wang, and Ying Shan. Open-magvit2: An open-source project toward democratizing auto-regressive visual gener- ation. arXiv preprint arXiv:2409.04410, 2024. 4

    2024 arXiv

  34. [42]

    A survey on video prediction: From deterministic to generative approaches

    Ruibo Ming, Zhewei Huang, Zhuoxuan Ju, Jianming Hu, Li- hui Peng, and Shuchang Zhou. A survey on video prediction: From deterministic to generative approaches. arXiv preprint arXiv:2401.14718, 2024. 1, 8

    2024 arXiv

  35. [43]

    4m: Massively multimodal masked modeling

    David Mizrahi, Roman Bachmann, Oguzhan Kar, Teresa Yeo, Mingfei Gao, Afshin Dehghan, and Amir Zamir. 4m: Massively multimodal masked modeling. NeurIPS, 2024. 3

    2024

  36. [44]

    A review on deep learning techniques for video prediction

    Sergiu Oprea, Pablo Martinez-Gonzalez, Alberto Garcia- Garcia, John Alejandro Castro-Vargas, Sergio Orts- Escolano, Jose Garcia-Rodriguez, and Antonis Argyros. A review on deep learning techniques for video prediction. TPAMI, 44(6):2806–2826, 2020. 1

    2020

  37. [45]

    Training lan- guage models to follow instructions with human feedback

    Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Car- roll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. Training lan- guage models to follow instructions with human feedback. NeurIPS, 2022. 1

    2022

  38. [46]

    Scalable diffusion models with transformers

    William Peebles and Saining Xie. Scalable diffusion models with transformers. In ICCV, pages 4195–4205, 2023. 3

    2023

  39. [47]

    Movie gen: A cast of media foundation models

    Adam Polyak, Amit Zohar, Andrew Brown, Andros Tjandra, Animesh Sinha, Ann Lee, Apoorv Vyas, Bowen Shi, Chih- Yao Ma, Ching-Yao Chuang, et al. Movie gen: A cast of media foundation models. arXiv preprint arXiv:2410.13720,

    arXiv

  40. [48]

    Improving language understanding by generative pre-training

    Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. Improving language understanding by generative pre-training. 2018. 1

    2018

  41. [49]

    Zero-shot text-to-image generation

    Aditya Ramesh, Mikhail Pavlov, Gabriel Goh, Scott Gray, Chelsea V oss, Alec Radford, Mark Chen, and Ilya Sutskever. Zero-shot text-to-image generation. In ICML, 2021. 3

    2021

  42. [50]

    Gen- erating diverse high-fidelity images with vq-vae-2

    Ali Razavi, Aaron Van den Oord, and Oriol Vinyals. Gen- erating diverse high-fidelity images with vq-vae-2. NeurIPS,

  43. [51]

    High-resolution image syn- thesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj¨orn Ommer. High-resolution image syn- thesis with latent diffusion models. In CVPR, 2022. 1

    2022

  44. [52]

    Autoregressive model beats diffusion: Llama for scalable image generation

    Peize Sun, Yi Jiang, Shoufa Chen, Shilong Zhang, Bingyue Peng, Ping Luo, and Zehuan Yuan. Autoregressive model beats diffusion: Llama for scalable image generation. arXiv preprint arXiv:2406.06525, 2024. 1, 4

    2024 arXiv

  45. [53]

    Emu: Generative pretraining in multimodality

    Quan Sun, Qiying Yu, Yufeng Cui, Fan Zhang, Xiaosong Zhang, Yueze Wang, Hongcheng Gao, Jingjing Liu, Tiejun Huang, and Xinlong Wang. Emu: Generative pretraining in multimodality. In ICLR, 2023. 2, 3

    2023

  46. [54]

    Generative multimodal models are in-context learners

    Quan Sun, Yufeng Cui, Xiaosong Zhang, Fan Zhang, Qiy- ing Yu, Yueze Wang, Yongming Rao, Jingjing Liu, Tiejun Huang, and Xinlong Wang. Generative multimodal models are in-context learners. In CVPR, 2024. 2, 3

    2024

  47. [55]

    Hart: Efficient visual generation with hybrid au- toregressive transformer

    Haotian Tang, Yecheng Wu, Shang Yang, Enze Xie, Junsong Chen, Junyu Chen, Zhuoyang Zhang, Han Cai, Yao Lu, and Song Han. Hart: Efficient visual generation with hybrid au- toregressive transformer. arXiv preprint arXiv:2410.10812,

    arXiv

  48. [56]

    Chameleon: Mixed-modal early-fusion foundation models

    Chameleon Team. Chameleon: Mixed-modal early-fusion foundation models. arXiv preprint arXiv:2405.09818, 2024. 3 10

    2024 arXiv

  49. [57]

    Raft: Recurrent all-pairs field transforms for optical flow

    Zachary Teed and Jia Deng. Raft: Recurrent all-pairs field transforms for optical flow. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23– 28, 2020, Proceedings, Part II 16, pages 402–419. Springer,

    2020

  50. [58]

    Visual autoregressive modeling: Scalable im- age generation via next-scale prediction

    Keyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng, and Li- wei Wang. Visual autoregressive modeling: Scalable im- age generation via next-scale prediction. arXiv preprint arXiv:2404.02905, 2024. 1

    2024 arXiv

  51. [59]

    Llama: Open and efficient foundation language models

    Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth´ee Lacroix, Baptiste Rozi`ere, Naman Goyal, Eric Hambro, Faisal Azhar, et al. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971, 2023. 4

    2023 arXiv

  52. [60]

    To- wards accurate generative models of video: A new metric & challenges

    Thomas Unterthiner, Sjoerd Van Steenkiste, Karol Kurach, Raphael Marinier, Marcin Michalski, and Sylvain Gelly. To- wards accurate generative models of video: A new metric & challenges. arXiv preprint arXiv:1812.01717, 2018. 7, 8

    2018 arXiv

  53. [61]

    Diffusion models are real-time game engines

    Dani Valevski, Yaniv Leviathan, Moab Arar, and Shlomi Fruchter. Diffusion models are real-time game engines. arXiv preprint arXiv:2408.14837, 2024. 1, 8

    2024 arXiv

  54. [62]

    Neural discrete representation learning

    Aaron Van Den Oord, Oriol Vinyals, et al. Neural discrete representation learning. NeurIPS, 2017. 1, 2, 3

    2017

  55. [63]

    Attention is all you need

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko- reit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. Attention is all you need. NeurIPS, 2017. 1

    2017

  56. [64]

    Phenaki: Variable length video generation from open domain textual descriptions

    Ruben Villegas, Mohammad Babaeizadeh, Pieter-Jan Kin- dermans, Hernan Moraldo, Han Zhang, Mohammad Taghi Saffar, Santiago Castro, Julius Kunze, and Dumitru Erhan. Phenaki: Variable length video generation from open domain textual descriptions. In ICLR, 2022. 3

    2022

  57. [65]

    Images speak in images: A generalist painter for in-context visual learning

    Xinlong Wang, Wen Wang, Yue Cao, Chunhua Shen, and Tiejun Huang. Images speak in images: A generalist painter for in-context visual learning. In CVPR, 2023. 3

    2023

  58. [66]

    Seggpt: Towards seg- menting everything in context

    Xinlong Wang, Xiaosong Zhang, Yue Cao, Wen Wang, Chunhua Shen, and Tiejun Huang. Seggpt: Towards seg- menting everything in context. In ICCV, 2023. 3

    2023

  59. [67]

    Drivedreamer: Towards real-world- driven world models for autonomous driving

    Xiaofeng Wang, Zheng Zhu, Guan Huang, Xinze Chen, Jia- gang Zhu, and Jiwen Lu. Drivedreamer: Towards real-world- driven world models for autonomous driving. arXiv preprint arXiv:2309.09777, 2023. 6

    2023 arXiv

  60. [68]

    Emu3: Next-token prediction is all you need

    Xinlong Wang, Xiaosong Zhang, Zhengxiong Luo, Quan Sun, Yufeng Cui, Jinsheng Wang, Fan Zhang, Yueze Wang, Zhen Li, Qiying Yu, et al. Emu3: Next-token prediction is all you need. arXiv preprint arXiv:2409.18869, 2024. 2, 3

    2024 arXiv

  61. [69]

    Internvideo: General video foundation models via generative and discriminative learning

    Yi Wang, Kunchang Li, Yizhuo Li, Yinan He, Bingkun Huang, Zhiyu Zhao, Hongjie Zhang, Jilan Xu, Yi Liu, Zun Wang, et al. Internvideo: General video foundation models via generative and discriminative learning. arXiv preprint arXiv:2212.03191, 2022. 3

    2022 arXiv

  62. [70]

    Driving into the future: Multiview visual forecasting and planning with world model for au- tonomous driving

    Yuqi Wang, Jiawei He, Lue Fan, Hongxin Li, Yuntao Chen, and Zhaoxiang Zhang. Driving into the future: Multiview visual forecasting and planning with world model for au- tonomous driving. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pa...

    2024

  63. [71]

    Internvideo2: Scaling video foundation mod- els for multimodal video understanding

    Yi Wang, Kunchang Li, Xinhao Li, Jiashuo Yu, Yinan He, Guo Chen, Baoqi Pei, Rongkun Zheng, Jilan Xu, Zun Wang, et al. Internvideo2: Scaling video foundation mod- els for multimodal video understanding. arXiv preprint arXiv:2403.15377, 2024. 3

    2024 arXiv

  64. [72]

    Loong: Generating minute-level long videos with autoregressive lan- guage models

    Yuqing Wang, Tianwei Xiong, Daquan Zhou, Zhijie Lin, Yang Zhao, Bingyi Kang, Jiashi Feng, and Xihui Liu. Loong: Generating minute-level long videos with autoregressive lan- guage models. arXiv preprint arXiv:2410.02757, 2024. 3

    2024 arXiv

  65. [73]

    Panacea: Panoramic and controllable video generation for autonomous driving

    Yuqing Wen, Yucheng Zhao, Yingfei Liu, Fan Jia, Yanhui Wang, Chong Luo, Chi Zhang, Tiancai Wang, Xiaoyan Sun, and Xiangyu Zhang. Panacea: Panoramic and controllable video generation for autonomous driving. In CVPR, 2024. 6

    2024

  66. [74]

    Motionrnn: A flexible model for video prediction with spacetime-varying motions

    Haixu Wu, Zhiyu Yao, Jianmin Wang, and Mingsheng Long. Motionrnn: A flexible model for video prediction with spacetime-varying motions. In CVPR, 2021. 1

    2021

  67. [75]

    Tune-a-video: One-shot tuning of image diffusion models for text-to-video generation

    Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Stan Weixian Lei, Yuchao Gu, Yufei Shi, Wynne Hsu, Ying Shan, Xiaohu Qie, and Mike Zheng Shou. Tune-a-video: One-shot tuning of image diffusion models for text-to-video generation. In ICCV, 2023. 1

    2023

  68. [76]

    Simmim: A simple framework for masked image modeling

    Zhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin, Jianmin Bao, Zhuliang Yao, Qi Dai, and Han Hu. Simmim: A simple framework for masked image modeling. In CVPR, pages 9653–9663, 2022. 2

    2022

  69. [77]

    A survey on video diffusion models

    Zhen Xing, Qijun Feng, Haoran Chen, Qi Dai, Han Hu, Hang Xu, Zuxuan Wu, and Yu-Gang Jiang. A survey on video diffusion models. ACM Computing Surveys, 2023. 1

    2023

  70. [78]

    Videogpt: Video generation using vq-vae and trans- formers

    Wilson Yan, Yunzhi Zhang, Pieter Abbeel, and Aravind Srinivas. Videogpt: Video generation using vq-vae and trans- formers. arXiv preprint arXiv:2104.10157, 2021. 3

    2021 arXiv

  71. [79]

    Generalized predictive model for autonomous driving

    Jiazhi Yang, Shenyuan Gao, Yihang Qiu, Li Chen, Tianyu Li, Bo Dai, Kashyap Chitta, Penghao Wu, Jia Zeng, Ping Luo, et al. Generalized predictive model for autonomous driving. In CVPR, 2024. 6

    2024

  72. [80]

    Zerosmooth: Training-free diffuser adapta- tion for high frame rate video generation

    Shaoshu Yang, Yong Zhang, Xiaodong Cun, Ying Shan, and Ran He. Zerosmooth: Training-free diffuser adapta- tion for high frame rate video generation. arXiv preprint arXiv:2406.00908, 2024. 8

    2024 arXiv

  73. [81]

    Cogvideox: Text-to-video diffusion models with an expert transformer

    Zhuoyi Yang, Jiayan Teng, Wendi Zheng, Ming Ding, Shiyu Huang, Jiazheng Xu, Yuanming Yang, Wenyi Hong, Xiao- han Zhang, Guanyu Feng, et al. Cogvideox: Text-to-video diffusion models with an expert transformer. arXiv preprint arXiv:2408.06072, 2024. 6, 8

    2024 arXiv

  74. [82]

    Car: Controllable autoregressive modeling for visual generation

    Ziyu Yao, Jialin Li, Yifeng Zhou, Yong Liu, Xi Jiang, Chengjie Wang, Feng Zheng, Yuexian Zou, and Lei Li. Car: Controllable autoregressive modeling for visual generation. arXiv preprint arXiv:2410.04671, 2024. 3, 4

    2024 arXiv

  75. [83]

    Bdd100k: A diverse driving dataset for heterogeneous multitask learning

    Fisher Yu, Haofeng Chen, Xin Wang, Wenqi Xian, Yingying Chen, Fangchen Liu, Vashisht Madhavan, and Trevor Dar- rell. Bdd100k: A diverse driving dataset for heterogeneous multitask learning. In CVPR, 2020. 5, 6, 8

    2020

  76. [84]

    Magvit: Masked generative video transformer

    Lijun Yu, Yong Cheng, Kihyuk Sohn, Jos ´e Lezama, Han Zhang, Huiwen Chang, Alexander G Hauptmann, Ming- Hsuan Yang, Yuan Hao, Irfan Essa, et al. Magvit: Masked generative video transformer. In CVPR, 2023. 1, 3

    2023

  77. [85]

    Language model beats diffusion - tokenizer is key to visual generation

    Lijun Yu, Jose Lezama, Nitesh Bharadwaj Gundavarapu, Luca Versari, Kihyuk Sohn, David Minnen, Yong Cheng, Agrim Gupta, Xiuye Gu, Alexander G Hauptmann, Boqing 11 Gong, Ming-Hsuan Yang, Irfan Essa, David A Ross, and Lu Jiang. Language model beats diffusion - tokenizer is key to...

    2024

  78. [86]

    An image is worth 32 tokens for reconstruction and generation

    Qihang Yu, Mark Weber, Xueqing Deng, Xiaohui Shen, Daniel Cremers, and Liang-Chieh Chen. An image is worth 32 tokens for reconstruction and generation. In NeurIPS,

  79. [87]

    Drivedreamer-2: Llm-enhanced world models for diverse driving video generation

    Guosheng Zhao, Xiaofeng Wang, Zheng Zhu, Xinze Chen, Guan Huang, Xiaoyi Bao, and Xingang Wang. Drivedreamer-2: Llm-enhanced world models for diverse driving video generation. arXiv preprint arXiv:2403.06845,

    arXiv

  80. [88]

    Image and video tokenization with binary spherical quantization

    Yue Zhao, Yuanjun Xiong, and Philipp Kr ¨ahenb¨uhl. Image and video tokenization with binary spherical quantization. arXiv preprint arXiv:2406.07548, 2024. 8

    2024 arXiv

  81. [89]

    Movq: Modulating quantized vectors for high- fidelity image generation

    Chuanxia Zheng, Tung-Long Vuong, Jianfei Cai, and Dinh Phung. Movq: Modulating quantized vectors for high- fidelity image generation. NeurIPS, 2022. 3

    2022

  82. [90]

    Crossnet: An end-to-end reference-based super reso- lution network using cross-scale warping

    Haitian Zheng, Mengqi Ji, Haoqian Wang, Yebin Liu, and Lu Fang. Crossnet: An end-to-end reference-based super reso- lution network using cross-scale warping. In ECCV, 2018. 2, 4

    2018

  83. [91]

    Unicode: Learning a unified codebook for multimodal large language models

    Sipeng Zheng, Bohan Zhou, Yicheng Feng, Ye Wang, and Zongqing Lu. Unicode: Learning a unified codebook for multimodal large language models. In ECCV, 2024. 3 12

    2024

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.