REVIEW 2 cited by
Vision Transformers: State of the Art and Research Challenges
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Transformers have achieved great success in natural language processing. Due to the powerful capability of self-attention mechanism in transformers, researchers develop the vision transformers for a variety of computer vision tasks, such as image recognition, object detection, image segmentation, pose estimation, and 3D reconstruction. This paper presents a comprehensive overview of the literature on different architecture designs and training tricks (including self-supervised learning) for vision transformers. Our goal is to provide a systematic review with the open research opportunities.
Forward citations
Cited by 2 Pith papers
-
NAE: Normalizing AutoEncoder
A conditional surrogate loss that always picks the gradient estimate aligned with the reconstruction loss improves flow autoencoder training and reaches state-of-the-art generative performance on molecules, tabular da...
-
OT-Transformer: A Continuous-time Transformer Architecture with Optimal Transport Regularization
OT-Transformer replaces a discrete transformer stack with a single ODE and adds a kinetic energy penalty, reporting accuracy gains on four benchmarks.
Discussion (0). Continue with ORCID to comment.