QLAM extends state-space models with quantum superposition in the hidden state for linear-time long-sequence modeling and reports consistent gains over RNN and transformer baselines on sequential image tasks.
hub Canonical reference
Attention is all you need
Canonical reference. 89% of citing Pith papers cite this work as background.
88
Pith papers citing it
Background
89% of classified citations
hub tools
citation-role summary
background 8
method 1
citation-polarity summary
claims ledger
- background characteristics inherent in power load time series. Data-driven approaches based on artificial intelligence have become mainstream in recent years. Early methods centered on recurrent neural networks (RNNs) and convolutional neural networks (CNNs), which are adept at capturing temporal de- pendencies and inter-variable relationships [5]. With the advent of the Transformer architecture [6], attention-based models have advanced rapidly for time series forecasting, giving rise to numerous variants
- background However, these models still face challenges: their ability to explicitly model local interactions remains limited, and their interpretability is relatively weak. These drawbacks motivate our approach, which leverages physically grounded quantum walk dynamics to provide both richer local structural model- ing and improved interpretability. Formally, the self-attention mechanism in the Transformer framework [20] is defined as Attention (Q, K, V) = softmax (QKT √ d ) V(2) WhereQ, K, V∈R n×dare the
- background Generating accurate, human-like motion requires ac- counting for variability in emotion and semantic emphasis, two aspects that remain underexplored. Computational efficiency is an additional requirement for real-time robotics applications. Model architectures have evolved from recurrent networks such as long short-term memory (LSTM) [16] to attention-based transformers [17]. Adversarial and diffusion-based methods have also been proposed to improve motion realism and diver- sity [2], [14], [18]
- background Neural Machine Translation (NMT) has emerged as a pow- erful end-to-end approach for automated translation, employ- ing a single neural network to directly model the probability of a target sentence given a source sentence [1]. In recent years, NMT models have significantly improved translation quality, accompanied by a substantial expansion in model scale. Since Transformer introduced [2], the parameter count of NMT models has grown exponentially. For instance, M2M-100 (12 billion parameters) [
- background after GEMM completion while the output tiles still reside in on- chip memory (L1/L2 caches or registers), we avoid costly global memory traffic. However, conventional normalization layers operate along the feature dimension, which often misaligns with the physical data layout of GEMM outputs. To address this, we proposesBlockNorm, a normalization approach inspired by GroupNorm [71] which is originally designed to apply normalization within individual channels of a feature map. In our version of
- background bias parameters(γ, β)from conditional inputs, then modulates intermediate features viaγ⊙x+βto achieve lightweight conditional feature selection [7]. We observe that this channel- level modulation effectively adjusts feature weights with low overhead and good trainability. In contrast, attention-based cross-modal fusion typically relies on spatial weights or token- level interactions [9], [15]-[17], which increase computa- tional/parameter overhead and may complicate optimization in reinforcement
co-cited works
representative citing papers
CTQWformer fuses continuous-time quantum walks into a graph transformer and recurrent module to outperform standard GNNs and graph kernels on classification benchmarks.
CAIS delivers 1.38x end-to-end LLM training speedup over NVLS and 1.61x over T3 by making in-switch computing aware of computation memory requirements instead of treating communication as an isolated phase.
Cascaded discrete diffusion generates CAD command sequences with absorbing transitions and parameters with Gaussian, scale-invariant, and prior-preserving kernels, outperforming autoregressive and continuous diffusion baselines on the DeepCAD dataset.
Tempus delivers 607 GOPS at 10.677 W using fixed 16 AIE cores on Versal AI Edge, with 211.2x better platform-aware utility than spatial SOTA ARIES and zero URAM/DSP utilization.
Temporal autocorrelation reintroduces spectral bias in KANs for time series forecasting, which DCT preprocessing can mitigate.
Latent space probing on CogVideoX achieves 97.29% F1 for adult content detection on a new 11k-clip dataset with 4-6ms overhead.
BiSplat-WRF applies 2D planar Gaussians rendered on angular domains plus a bilinear spatial transformer to capture electromagnetic interactions, outperforming prior NeRF and GS methods on SSIM for wireless radiance field reconstruction.
DEMUX achieves state-of-the-art multi-tab website fingerprinting accuracy by preserving boundary signals, modeling at multiple scales, and associating dispersed traffic fragments with a new three-component architecture.
STFER uses LVLM-generated identity-consistent semantic text to drive visual token filtering and expert routing for improved any-time person re-identification under clothing changes and modality shifts.
CDPR integrates polarization priors into a diffusion-based monocular depth estimator via shared latent space and adaptive gating, outperforming RGB-only methods in challenging scenes.
Creates the BGTD benchmark and mmTraffic architecture to enable explainable multimodal interpretation of encrypted network traffic using LLMs.
SHIELD reduces eDRAM refresh energy by 35% for LLM inference on edge NPUs by isolating sign/exponent from mantissa bits, disabling refresh on transient QO mantissas, and relaxing it on persistent KV mantissas while keeping accuracy intact.
LiftFormer transforms monocular depth prediction into depth-oriented geometric and edge-aware subspace representations via lifting and frame theory, achieving state-of-the-art results on standard datasets.
HealthPoint represents clinical events as points in a 4D space (content, time, modality, case) and applies low-rank relational attention to achieve state-of-the-art mortality prediction from multi-level incomplete multimodal EHRs.
CBEN provides paired optical-radar images with cloud occlusion, revealing 23-33 point AP drops in clear-sky trained models and 17-29 point relative gains when models are trained on cloudy data.
D³ETOR combines debate-enhanced pseudo labeling from SAM with frequency-aware progressive debiasing in FADeNet to achieve state-of-the-art weakly-supervised camouflaged object detection using scribbles.
ExDoS uses expert-guided dual-focus distillation between source semantic graphs and bytecode control-flow graphs plus a dual-attention network to improve smart contract vulnerability detection, reporting 3-6% F1 gains over baselines.
GT-NSGDm achieves the optimal non-asymptotic convergence rate O(1/T^{(p-1)/(3p-2)}) for decentralized nonconvex stochastic optimization under zero-mean heavy-tailed noise with p-th moment.
UniT unifies online and offline 3D geometry perception via a Group Autoregressive Transformer that processes observation groups with anchor-free point map prediction and a scale-adaptive loss.
MAQIU adds a memorization module and recall mechanism to update query intent dynamically in chat-based image retrieval, cutting FLOPs by 86.4% versus ChatIR while improving results.
CSI-JEPA learns temporal-spectral representations from unlabeled CSI via masked prediction and achieves up to 10.64 percentage points accuracy gain and 98% label savings on seven real-world Wi-Fi sensing tasks.
LoKA enables practical FP8 use in numerically sensitive large recommendation models via online profiling of activations, reusable model modifications for stability, and dynamic kernel dispatching.
EKD trains lightweight NMT students progressively from a chain of teachers with rising capacity, achieving BLEU scores within 0.08 of the largest teacher on IWSLT-14.
citing papers explorer
-
Stage Light is Sequence$^2$: Multi-Light Control via Imitation Learning
SeqLight maps music to multi-light HSV control via SkipBART for global color prediction followed by hybrid imitation learning in a goal-conditioned MDP to decompose colors across lights.
-
Modality-Aware Contrastive and Uncertainty-Regularized Emotion Recognition
MCUR improves multimodal emotion recognition across heterogeneous modality setups by combining modality-combination contrastive learning with sample-wise uncertainty regularization, yielding F1 gains of 2.2-4.37% on MOSI, MOSEI, and IEMOCAP.