Pith. sign in

REVIEW 3 major objections 5 minor 29 references

Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimization

T0 review · 3 major / 5 minor · reviewed 2026-08-10 · deepseek-v4-flash

Pith's one-line read A single adaptive entropy update can separate known from unknown classes during multimodal test-time adaptation.

desk verdict Useful first benchmark and method for multimodal open-set TTA, with a solid empirical story and one real soft spot: the fixed entropy threshold that the whole sign-flipping mechanism leans on. read the letter →

arxiv 2501.13924 v1 pith:3O2GWOJU submitted 2025-01-23 cs.CV cs.AIcs.LG

classification cs.CVcs.AIcs.LG
keywords multimodalopen-settest-timeadaptationentropydifferenceunknown-classdetectionadaptiveoptimizationmodalitypredictiondiscrepancyactionrecognition3Dsemanticsegmentation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Multimodal open-set test-time adaptation asks a pre-trained model, with no source data or target labels, to keep working when the target domain shifts and also contains classes the model has never seen. The paper claims that in this setting the single most informative quantity is the entropy gap between known and unknown samples: the larger the gap, the better unknown classes are detected. Existing test-time methods that minimize entropy for every sample shrink this gap, so the paper proposes Adaptive Entropy-aware Optimization (AEO), which automatically minimizes entropy for samples below a threshold and maximizes it for samples above, while separately encouraging modalities to disagree on likely-unknown samples. On a new benchmark spanning action recognition and 3D semantic segmentation with five modalities, AEO is reported to improve unknown-class detection substantially over both unimodal and multimodal TTA baselines, and to hold up in long-term and continually shifting settings. If the paper is right, multimodal open-set adaptation reduces to a simple online rule keyed to prediction entropy, with no need for target labels, source data, or domain-specific calibration.

What carries the argument

The load-bearing object is the adaptive sample weight $W_{\text{ada}} = \tanh(\beta (H(\hat{p})-\alpha))$, where $H(\hat{p})$ is prediction entropy normalized to $[0,1]$ and $\alpha,\beta$ are fixed hyperparameters. Applied as a multiplier to the entropy loss (UAE) and to a cross-modal prediction-discrepancy loss (AMP), this one expression turns the update into an automatic sign switch: entropy is minimized when $H(\hat{p})<\alpha$ and maximized when $H(\hat{p})>\alpha$, with ambiguous samples near the threshold receiving near-zero weight. A negative-entropy diversity term is added to prevent collapsed predictions. This mechanism is what the paper claims converts the observed entropy-difference correlation into an actionable online update rule.

What would settle it

One decisive test would be to construct a target domain where unknown samples are initially very confident (entropy below $\alpha=0.8$): AEO's Tanh sign would then treat them as known and minimize their entropy, so AUROC and FPR95 should worsen relative to the source model in one adaptation pass.

Watch

Extended reading notes

Core claim

The paper's central claim is that MM-OSTTA performance strongly correlates with the difference between average prediction entropy of unknown and known samples in the target domain, and that the right test-time objective is to amplify this difference rather than minimize entropy globally. AEO does this with an adaptive weight based on normalized entropy: samples with entropy above a fixed threshold are treated as unknown and pushed toward higher entropy; samples below the threshold are treated as known and pushed toward lower entropy; samples near the threshold are down-weighted because their status is ambiguous. A second term adapts the prediction discrepancy across modalities, encouraging diverse predictions for unknown samples and consistent predictions for known ones. The paper reports that this combination separates the score distributions of known and unknown classes during online adaptation, leading to large gains in unknown-class detection, and that the gains persist in long-term and continual settings where other TTA baselines degrade.

Load-bearing premise

The method assumes that a fixed entropy cutoff (chosen before seeing target data) separates unknown from known samples in every target domain and every modality; if a domain's unknowns have entropy below that cutoff, the sign of the update reverses and the separation collapses.

Editorial extensions

If this is right

  • If the entropy-gap claim is correct, any future multimodal TTA method should be evaluated not only on accuracy but on whether it widens the known-unknown entropy gap, since that gap is the paper's proposed driver of unknown-class detection.
  • AEO's reported robustness across video, audio, optical flow, LiDAR and camera suggests the same update rule transfers across tasks as different as action recognition and 3D semantic segmentation.
  • In long-term and continual settings, where repeated adaptation usually accumulates error, the paper reports that AEO continues to improve (for example, its H-score increases after ten rounds on HAC), which directly addresses deployment scenarios where domains drift indefinitely.
  • The paper's result implies that open-set handling does not require a separate OOD detector trained with auxiliary outliers; an entropy-based adaptive update at test time is claimed to be sufficient.
  • Baselines that filter low-confidence samples or minimize entropy globally are claimed to be insufficient for MM-OSTTA, because they leave the entropy gap unchanged or shrink it.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The fixed threshold $\alpha=0.8$ is the part most likely to need per-domain tuning; a natural extension the paper does not test is estimating the threshold from the running statistics of the target batch.
  • Because the paper shows a correlation between entropy gap and FPR95, one cheap diagnostic for deployed systems would be to monitor the entropy gap online as a proxy for open-set detection health, without labels.
  • The M-modal loss formulas in the appendix suggest AEO extends beyond three modalities, but the paper only reports experiments with up to three modality streams; testing four or more fused sensors is an open step.
  • If the entropy gap is indeed causal, then a complementary test would be to fix the gap artificially (for example, by reweighting the loss to a target gap value) and check that FPR95 tracks it; the paper does not run this intervention.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper introduces Adaptive Entropy-aware Optimization (AEO) for multimodal open-set test-time adaptation (MM-OSTTA), a new task setting in which a source-trained multimodal model must adapt online to a target stream that contains both domain-shifted known-class samples and novel (unknown) classes. AEO is motivated by an observed correlation between the average entropy difference of known vs. unknown samples and unknown-detection performance (FPR95). It consists of two losses: Unknown-aware Adaptive Entropy Optimization (UAE), which weights each sample by Tanh(β(H(p)−α)) and maximizes/minimizes entropy accordingly, and Adaptive Modality Prediction Discrepancy Optimization (AMP), which adaptively enforces cross-modal consistency for known samples and discrepancy for unknowns. The paper builds a benchmark from EPIC-Kitchens, HAC, Kinetics-100-C, and nuScenes, covering action recognition and 3D semantic segmentation across five modalities, and reports consistent improvements over TTA and open-set TTA baselines, including long-term and continual adaptation settings.

Significance. If the claimed mechanism holds, AEO is a practically valuable contribution: it is the first explicit MM-OSTTA framework, uses a simple online update rule, and shows consistent gains in known-class accuracy and unknown-class detection across multiple tasks and modalities. The paper ships code, includes ablations for each loss term, sensitivity analyses for hyperparameters, and tests across architectures and pre-training strategies. The main reservations concern the fixed threshold α that governs the sign of the update, the oracle-balanced batching protocol, and the unquantified correlation claim; these limit the currently supported strength of the central claim but are addressable with additional experiments and analysis.

major comments (3)
  1. [Sec. 3.2, Eqs. (3)-(4), Appendix B.2, Fig. 5] The sign of Wada = Tanh(β(H(p) − α)) flips at the fixed threshold α = 0.8; the intended entropy amplification for unknown samples requires H(p_unknown) > α during adaptation. The paper fixes α before seeing any target data and provides sensitivity analysis only on HAC (Fig. 5). Several Source rows in Tables 1–3 have FPR95 above 90 (e.g., D1→D2 in Table 1, Gaussian(v)+Gaussian(a) in Table 3), and Appendix C.13.4 acknowledges that initial score distributions of known and unknown samples are often closely aligned. The paper does not report, for any target domain or modality combination, the fraction of unknown samples whose normalized entropy lies above α before or during adaptation. If this fraction is not close to 1, the UAE update minimizes rather than maximizes entropy for a substantial part of the unknown stream, which is the opposite of the claimed mechanism. The central claim that one fixed update rule amplifies the known/unknown entropy gap across all benchmark conditions is therefore not established; the authors should either calibrate α per domain/modality or provide per-domain evidence that the unknown entropy distribution stays above α online.
  2. [Appendix B.2 and Table 10] The evaluation protocol constructs mini-batches with equal numbers of known and unknown samples. This requires oracle knowledge of the known/unknown status of each incoming sample, which contradicts the paper's stated setting of an unlabeled target stream (Sec. 2). Table 10 varies the unknown ratio from 20% to 80%, but it still assumes the ratio is known so that the batches can be constructed. In a truly unlabeled online stream, the model cannot balance batches in this way, and the natural ratio may be highly skewed or change over time. The reported gains are thus demonstrated under a favorable batching protocol. The authors should explicitly describe this protocol in the main text, justify it as a standard evaluation choice, and additionally evaluate AEO on a natural (unbalanced) stream where batches are drawn without using any known/unknown labels.
  3. [Sec. 3.1 and Fig. 2] The central motivating observation—that the entropy difference between known and unknown samples 'strongly correlates' with MM-OSTTA performance—is supported only by a visual scatter plot with no correlation coefficient, number of points, or statistical test. Since this correlation is the design principle of the AEO framework, the paper should report a quantitative correlation analysis (e.g., Pearson or Spearman with confidence intervals) over the domain-shift scenarios shown. In addition, because the entropy used in the analysis and the MSP score used to compute FPR95 are both functions of the same softmax distribution, the authors should clarify how the reported correlation is not a near-tautological consequence of using two closely related quantities.
minor comments (5)
  1. [Sec. 4.1, Eq. (9)] The H-score uses (1 − FPR95) in a harmonic mean with accuracy and AUROC; a brief explanation of why this particular aggregate is chosen, and how it behaves when FPR95 is near 1, would improve readability.
  2. [Appendix B.2] The hyperparameters α = 0.8 and β = 4.0 are used throughout the main experiments but appear only in the appendix; consider stating them in the main text or in a hyperparameter table.
  3. [Tables 1–3 and Appendix C.9] The main results are single-run numbers; three-seed statistics are provided for only one HAC setting in the appendix. Reporting mean and standard deviation in the main tables, or at least stating that single runs are shown, would improve reproducibility and make the magnitude of the gains easier to interpret.
  4. [Throughout] There are several typographical errors and awkward phrasings (e.g., 'uncertainy' in Sec. 3.3, 'adaptaion' in the Table 11 caption, 'enhence' in Sec. 3.1); a careful proofreading pass is recommended.
  5. [Sec. 4.2] Phrases such as 'improving the Source baseline H-score by 22.07%' mix absolute percentage-point gains with relative improvements; please specify which quantity is meant (e.g., 'by 22.07 points' or 'by 64.7% relatively').

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the entropy-difference motivation is empirical, the optimized loss is not identical to the evaluation metric, and the self-citations are not load-bearing.

full rationale

The paper's core motivating observation (Sec. 3.1) is an empirical correlation between the entropy difference of known and unknown samples and FPR95, computed with oracle labels on a pre-trained model. This is not a circular definition: MM-OSTTA performance is measured by FPR95/AUROC/Acc/H-score, which depend on the MSP score in Eq. (2), not on the entropy-gap quantity itself. The proposed losses in Eqs. (3)-(8) deliberately optimize entropy separation, but the reported evaluation metrics are external to the training objective; no evaluation term is a component of LAEO. The detection rule uses MSP, not entropy, so the method's output is not identical to its training signal by construction. The fixed-threshold alpha robustness concern (sign reversal when unknown-sample entropy falls below alpha) is a legitimate correctness risk, but it concerns whether the heuristic works, not whether the derivation is circular. Self-citations (e.g., the HAC dataset and SimMMDG pretraining from Dong et al. 2023) are used as experimental assets or ablations, not as load-bearing justification of the method's principle, and no uniqueness theorem or ansatz is imported from prior work by the same authors. The paper contains no step where a fitted parameter is renamed as a prediction, and no claim reduces equationally to its own inputs. Therefore the analysis is self-contained against the stated benchmark and merits a circularity score of 0.

Assumptions & free parameters 4 free parameters · 5 assumptions · 0 invented entities

The method rests on entropy as a discriminative signal, on equal known/unknown batch construction, on fixed hyperparameters, and on generalization of the EPIC-Kitchens correlation to other tasks. These are the main free assumptions the reader pays for beyond the pre-trained model.

free parameters (4)
  • alpha = 0.8
    Entropy threshold in Eq. (3) that decides whether a sample is treated as known or unknown; chosen globally and fixed for all datasets.
  • beta = 4.0
    Scaling hyperparameter in the Tanh weight in Eq. (3); set to 4.0 in Appendix B.2.
  • gamma1 = 0.1
    Weight on the AMP losses in Eq. (8); set to 0.1.
  • gamma2 = 0.1
    Weight on the diversity loss LDiv in Eq. (8); set to 0.1.
assumptions (5)
  • domain assumption Unknown test samples have higher prediction entropy than known samples after adaptation.
    This is the operating assumption behind Eq. (3), where the sign of Wada decides whether to minimize or maximize entropy.
  • ad hoc to paper A single global threshold alpha=0.8 separates known from unknown samples across all target domains and modalities.
    Alpha is fixed in Appendix B.2 and not calibrated per domain, yet the weighting scheme in Eq. (3) depends on it.
  • domain assumption Target mini-batches contain both known and unknown samples in a balanced 50/50 proportion during evaluation.
    Appendix B.2 states mini-batches are constructed with equal numbers of known and unknown samples, which is a favorable and possibly unrealistic setup.
  • domain assumption The entropy-difference versus FPR95 correlation observed on EPIC-Kitchens transfers to HAC, Kinetics-100-C, and nuScenes.
    Fig. 2 only shows EPIC-Kitchens scatter, but the method is applied to all datasets under the same mechanism.
  • domain assumption Updating only the last layer of each modality encoder plus the classifier is sufficient for MM-OSTTA.
    Appendix B.2 restricts parameter updates to the last layers, following prior TTA practice; the paper does not justify this restriction for open-set multimodal data.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimization." pith.science (2026). https://pith.science/paper/3O2GWOJU

@misc{pith2026250113924,
  author       = {Pith},
  title        = {Pith review of: Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimization},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/3O2GWOJU}},
  note         = {Machine review of arXiv:2501.13924}
}
read the original abstract

Test-time adaptation (TTA) has demonstrated significant potential in addressing distribution shifts between training and testing data. Open-set test-time adaptation (OSTTA) aims to adapt a source pre-trained model online to an unlabeled target domain that contains unknown classes. This task becomes more challenging when multiple modalities are involved. Existing methods have primarily focused on unimodal OSTTA, often filtering out low-confidence samples without addressing the complexities of multimodal data. In this work, we present Adaptive Entropy-aware Optimization (AEO), a novel framework specifically designed to tackle Multimodal Open-set Test-time Adaptation (MM-OSTTA) for the first time. Our analysis shows that the entropy difference between known and unknown samples in the target domain strongly correlates with MM-OSTTA performance. To leverage this, we propose two key components: Unknown-aware Adaptive Entropy Optimization (UAE) and Adaptive Modality Prediction Discrepancy Optimization (AMP). These components enhance the ability of model to distinguish unknown class samples during online adaptation by amplifying the entropy difference between known and unknown samples. To thoroughly evaluate our proposed methods in the MM-OSTTA setting, we establish a new benchmark derived from existing datasets. This benchmark includes two downstream tasks and incorporates five modalities. Extensive experiments across various domain shift situations demonstrate the efficacy and versatility of the AEO framework. Additionally, we highlight the strong performance of AEO in long-term and continual MM-OSTTA settings, both of which are challenging and highly relevant to real-world applications. Our source code is available at https://github.com/donghao51/AEO.

Figures

Figures reproduced from arXiv: 2501.13924 by the authors.

Figure 1
Figure 1. (a) Tent minimizes the entropy of all samples, making it difficult to separate the prediction [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. The entropy difference between known and unknown samples is positively correlated with the MM-OSTTA performance. Tent minimizes the entropy of all samples, regardless of whether they are known or unknown, thereby failing to increase entropy differences and leading to poorer perfor￾mances. In contrast, our AEO amplifies entropy differences via adaptive optimization, significantly improving unknown detection. Differen… view at source ↗
Figure 3
Figure 3. Training with AMP further ampli￾fies the entropy difference between known and unknown samples, leading to improved performances. To achieve this, we define the adaptive modality pre￾diction discrepancy loss as: LAdaDis = −(Dis(ˆp 1 , pˆ 2 )) · Wada, (6) where Wada is the adaptive weight from Eq. (3) and LAdaDis emphasizes samples with either very high or low H(ˆp). Dis(·) measures the prediction discrep￾ancy between… view at source ↗
Figures from the paper (12 more)
Figure 4
Figure 4. Figure 4: AEO continuously opti￾mizes entropy difference between known and unknown samples, re￾sulting in a substantial reduction of FPR95 after 10 adaptation epochs. Long-term MM-OSTTA. Models deployed in real-world sce￾narios continuously encounter test samples over extended p…
Figure 6
Figure 6. Figure 6: Prediction score distributions of different baseline methods on the EPIC-Kitchens dataset [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]
Figure 7
Figure 7. Figure 7: Model prediction entropy for known and unknown samples during online adaptation. [PITH_FULL_IMAGE:figures/full_fig_p010_7.png]
Figure 8
Figure 8. Figure 8: Illustrations of datasets used in our benchmark. We include three action recognition datasets [PITH_FULL_IMAGE:figures/full_fig_p016_8.png]
Figure 9
Figure 9. Figure 9: Visualization of various visual corruption types on the constructed Kinetics-100-C bench [PITH_FULL_IMAGE:figures/full_fig_p017_9.png]
Figure 10
Figure 10. Figure 10: Mel spectrogram visualization of the raw audio and the corresponding audio corruption [PITH_FULL_IMAGE:figures/full_fig_p017_10.png]
Figure 11
Figure 11. Figure 11: Detailed results on all 36 possible combinations of corruptions. Our AEO achieves the [PITH_FULL_IMAGE:figures/full_fig_p018_11.png]
Figure 12
Figure 12. Figure 12: Sensitivity to loss hyperparameters [PITH_FULL_IMAGE:figures/full_fig_p020_12.png]
Figure 13
Figure 13. Figure 13: Prediction score distributions of different methods on the EPIC-Kitchens dataset before [PITH_FULL_IMAGE:figures/full_fig_p021_13.png]
Figure 14
Figure 14. Figure 14: Model prediction entropy for known and unknown samples during online adaptation. [PITH_FULL_IMAGE:figures/full_fig_p022_14.png]
Figure 15
Figure 15. Figure 15: Experiments using three random seeds on HAC dataset using video and audio (A [PITH_FULL_IMAGE:figures/full_fig_p022_15.png]
Figure 2
Figure 2. Figure 2: Sensitivity to overlapping score distributions. In the challenging open-set setting, the initial score distributions of known and unknown samples are often closely aligned and difficult to distinguish, as 25 [PITH_FULL_IMAGE:figures/full_fig_p025_2.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

29 extracted references · 20 canonical work pages

  1. [2]

    Sensitivity to overlapping score distributions. In the challenging open-set setting, the initial score distributions of known and unknown samples are often closely aligned and difficult to distinguish, as 25 Published as a conference paper at ICLR 2025 shown in Fig. 6 (a). In such cases, SAR and EATA could potentially minimize the entropy of unknown sampl...

  2. [5]

    18 Published as a conference paper at ICLR 2025 Source Tent SAR OSTTA UniEnt READ AEO (ours) H-score 37.30 16.90 16.11 28.14 45.38 59.1160.56 Table 13: Average H-score on all 36 possible combinations of corruptions. Kinetics-100-C Acc↑ FPR95↓ AUROC↑ H-score↑ Source 61.06 73.09 68.82 43.51 UniEnt 66.87 59.55 80.31 56.37 READ 68.65 52.52 82.31 62.44 AEO (Ou...

  3. [7]

    Dpu: Dynamic prototype updating for multimodal out-of-distribution detection

    Shawn Li, Huixian Gong, Hao Dong, Tiankai Yang, Zhengzhong Tu, and Yue Zhao. Dpu: Dynamic prototype updating for multimodal out-of-distribution detection. arXiv preprint arXiv:2411.08227,

  4. [8]

    Sgdr: Stochastic gradient descent with warm restarts

    Ilya Loshchilov and Frank Hutter. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983,

  5. [10]

    Entropic open-set active learning

    12 Published as a conference paper at ICLR 2025 Bardia Safaei, VS Vibashan, Celso M de Melo, and Vishal M Patel. Entropic open-set active learning. In AAAI,

  6. [13]

    Robust TTA methods (Niu et al., 2022; Zhou et al.,

    update specific model parameters using incoming test samples based on unsupervised objectives such as entropy minimization and pseudo-labels. Robust TTA methods (Niu et al., 2022; Zhou et al.,

  7. [14]

    and action recognition (Yang et al., 2024), often involving multiple modalities. A.2 O PEN -SET TEST-TIME ADAPTATION Open-set test-time adaptation (OSTTA) addresses situations where the target domain includes classes absent in the source domain, presenting greater challenges due to the risk of incorrect adaptation to unknown class samples, which can cause...

  8. [15]

    Similarly, Kim et al

    proposes a self-supervised alignment method combined with adversarial alignment for multimodal DA. Similarly, Kim et al. (2021) employ cross-modal contrastive learning to align representations across both modalities and domains. Besides, Zhang et al. (2022) introduce an audio- adaptive encoder and an audio-infused recognizer to mitigate domain shifts. RNA...

Show all 29 references
  1. [16]

    presents a universal framework for multimodal domain generalization by separating features within each modal- ity into modality-specific and modality-shared components, while applying constraints to encourage meaningful representation learning. Building on SimMMDG, MOOSA (Dong...

  2. [17]

    Additionally, Du et al

    uses external OOD samples from other datasets during training to improve discrimination between ID and OOD samples. Additionally, Du et al. (2022) propose synthesizing virtual outliers for training-time regularization. While most existing OOD methods are designed for unimodal ...

  3. [18]

    During open-set TTA, we construct mini-batches with equal numbers of known and unknown samples

    and SimMMDG (Dong et al., 2023), to evaluate TTA performance on different models. During open-set TTA, we construct mini-batches with equal numbers of known and unknown samples. We use a batch size of 64 and the Adam optimizer with a learning rate of 2e-5 for all experiments. ...

  4. [19]

    for the LiDAR stream. We adopt the fusion framework proposed in PMF (Zhuang et al., 2021), modifying it by adding an additional segmentation head to the combined features from the camera and LiDAR streams. For optimization, we use SGD with Nesterov (Loshchilov & Hutter,

  5. [20]

    EPIC-Kitchens is a large-scale egocentric dataset collected from 32 participants in their native kitchen environments

    EPIC-Kitchens (Damen et al., 2018). EPIC-Kitchens is a large-scale egocentric dataset collected from 32 participants in their native kitchen environments. The participants recorded all their daily kitchen activities, with annotated start and end times for each action. We use a...

  6. [21]

    following the ideas in Hendrycks & Dietterich (2019) and Yang et al. (2024). We apply six different types of corruptions (Gaussian, Defocus, Frost, Brightness, Pixelate, and JPEG) on videos and six others (Gaussian, Wind, Traffic, Thunder, Rain, and Crowd) on audios. We random...

  7. [23]

    Our AEO achieves the best performance on 31 out of 36 combinations and obtains the highest average H-score, demonstrating its robustness under diverse corruption scenarios. C.3 R OBUSTNESS UNDER MIXED CORRUPTIONS FOR OPEN -SET DATA By default, the corruptions applied to the op...

  8. [24]

    C.5 I NFLUENCE OF LDiv TO THE PERFORMANCES We investigate the impact ofLDiv in Eq

    Our AEO demonstrates low sensitivity to the choice of score functions, achieving comparable performance across different metrics. C.5 I NFLUENCE OF LDiv TO THE PERFORMANCES We investigate the impact ofLDiv in Eq. (7) to the performances, a negative entropy loss term widely use...

  9. [25]

    As shown in Tab

    to promote diversity in predictions. As shown in Tab. 16, removingLDiv results in performance on the EPIC-Kitchens dataset remaining comparable to the original, while significantly reducing performance on the HAC and Kinetics-100-C datasets. This demonstrates the critical role...

  10. [26]

    14 (b), (e), and (h))

    minimizes the entropy of all samples, further narrowing the gap between known and unknown samples (Fig. 14 (b), (e), and (h)). In contrast, the entropy values generated by 20 Published as a conference paper at ICLR 2025 (g) D2 → D3 (No TTA) (h) D2 → D3 (Tent) (i) D2 → D3 (Ours...

  11. [27]

    perform well and exceed the Source baseline, other TTA methods fail to achieve robust perfor- mance, underscoring the complexities of multimodal open-set adaptation. In contrast, our method demonstrates strong robustness across all modality combinations, significantly improvin...

  12. [28]

    (2024) and Gao et al

    C.13.3 C OMPARISON WITH OPEN -SET METHODS Safaei et al. (2024) and Gao et al. (2024) also utilized the entropy difference between known and unknown samples in open-set settings. However, our work goes beyond merely leveraging this difference. In Sec. 3.1, we provide a deeper a...

  13. [2016]

    Benchmarking neural network robustness to common corruptions and perturbations

    11 Published as a conference paper at ICLR 2025 Dan Hendrycks and Thomas Dietterich. Benchmarking neural network robustness to common corruptions and perturbations. arXiv preprint arXiv:1903.12261,

  14. [2017]

    A short note about kinetics-600

    Joao Carreira, Eric Noland, Andras Banki-Horvath, Chloe Hillier, and Andrew Zisserman. A short note about kinetics-600. arXiv preprint arXiv:1808.01340,

  15. [2018]

    Extremely simple activation shaping for out-of-distribution detection

    Andrija Djurisic, Nebojsa Bozanic, Arjun Ashok, and Rosanne Liu. Extremely simple activation shaping for out-of-distribution detection. arXiv preprint arXiv:2209.09858,

  16. [2019]

    Sharpness-aware minimization for efficiently improving generalization

    Pierre Foret, Ariel Kleiner, Hossein Mobahi, and Behnam Neyshabur. Sharpness-aware minimization for efficiently improving generalization. arXiv preprint arXiv:2010.01412,

  17. [2020]

    Recall and refine: A simple but effective source-free open-set domain adaptation framework

    Ismail Nejjar, Hao Dong, and Olga Fink. Recall and refine: A simple but effective source-free open-set domain adaptation framework. arXiv preprint arXiv:2411.12558,

  18. [2021]

    13 Published as a conference paper at ICLR 2025 A R ELATED WORK A.1 T EST-TIME ADAPTATION Test-time Adaptation (TTA) seeks to adapt a pre-trained model on the source domain online, address- ing distribution shifts without requiring access to either source data or target labels...

  19. [2022]

    Superfusion: Multilevel lidar-camera fusion for long-range hd map generation

    Hao Dong, Xianjing Zhang, Jintao Xu, Rui Ai, Weihao Gu, Huimin Lu, Juho Kannala, and Xieyuanli Chen. Superfusion: Multilevel lidar-camera fusion for long-range hd map generation. arXiv preprint arXiv:2211.15656,

  20. [2023]

    Unified entropy optimization for open-set test-time adaptation

    Zhengqing Gao, Xu-Yao Zhang, and Cheng-Lin Liu. Unified entropy optimization for open-set test-time adaptation. arXiv preprint arXiv:2404.06065,

  21. [2024]

    Stamp: Outlier-aware test-time adaptation with stable memory replay

    Yongcan Yu, Lijun Sheng, Ran He, and Jian Liang. Stamp: Outlier-aware test-time adaptation with stable memory replay. arXiv preprint arXiv:2407.15773,

Pith tools

Reviewed August 10, 2026 · model on record in the stance chip above.