REVIEW 2 major objections 5 minor 2 cited by
On the Difficulty of Constructing a Robust and Publicly-Detectable Watermark
T0 review · 2 major / 5 minor · reviewed 2026-08-08 · deepseek-v4-flash
Pith's one-line read A robust, unforgeable, publicly-detectable image watermark is provably possible by composing signatures, post-hoc watermarks, and collision-resistant embeddings; the paper shows current embeddings fail the needed collision resistance.
desk verdict The framework and empirical evaluation are worth a look, but the central composition theorem is not proven as written. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the robust embedding function of Definition B.1: an embedding model with correctness (transformed copies compare as similar) and collision resistance (no white-box adversary can make an arbitrary image compare as similar to a signed image). Around it, the paper wraps a post-hoc watermarking scheme, which acts as a high-capacity communication channel hidden in the image, and a cryptographic signature scheme, which makes the embedded payload unforgeable. The composition's central identity is the payload equation $c \geq \delta + n$: the watermark capacity must fit the signature plus the embedding. The detection predicate is the conjunction of signature verification and embedding comparison, so the scheme inherits robustness from both primitives and security from their individual guarantees.
What would settle it
Run the paper's own white-box PGD collision attack against any candidate robust embedding: if an adversary can, within an $\ell_\infty$ budget of $4/255$ (or any imperceptible bound), make two visually different images compare as similar with non-negligible probability, the collision-resistance premise behind unforgeability fails. The paper already reports this collapse for the SSCD model (ROC AUC drops from 0.986 to 0.057); a model that keeps near-perfect ROC AUC under the same attack would remove the stated barrier and make the construction deployable.
Extended reading notes
Core claim
The paper's central claim is that a robust, unforgeable, and publicly-detectable watermarking scheme exists, and it proves this by construction (Theorem 5.1). Starting from a robust embedding function $(\mathrm{Embed}, \mathrm{Compare})$, a post-hoc watermarking scheme $(\mathrm{Encode}, \mathrm{Decode})$, and a cryptographic signature scheme $(\mathrm{Sign}, \mathrm{Verify})$, the watermark embeds the image $x$ as $e = \mathrm{Embed}(x)$, signs $e$ to obtain $\sigma$, and produces $\mathrm{Encode}(x, \sigma \| e)$. To detect, one decodes $\sigma' \| e'$, checks $\mathrm{Verify}(pk, e', \sigma')$, and checks $\mathrm{Compare}(\mathrm{Embed}(x'), e')$. The theorem states that if the embedding and watermark share transformation robustness and the watermark capacity satisfies $c \geq \delta + n$, the composed scheme is a $(\mathcal{T}_{\mathrm{REF}} \cap \mathcal{T}_{\mathrm{PGWS}},\ \epsilon_{\mathrm{REF}}+\epsilon_{\mathrm{PGWS}}+\mathrm{negl}(\lambda))$-publicly-detectable watermark, robust to the transformations common to both primitives and unforgeable unless either the signature is forged or the embedding collides. Empirically, the paper finds the embedding half of this condition currently fails: all evaluated models, including the best ones, are broken by standard white-box PGD attacks, so the theorem is a blueprint whose load-bearing primitive does not yet exist.
Load-bearing premise
The load-bearing premise is that a robust embedding function exists whose similarity comparisons cannot be fooled by a white-box adversary, meaning no one without the secret key can slightly modify an image so its embedding matches a signed embedding of a different image; the paper's own experiments show every evaluated model violates this today.
Editorial extensions
If this is right
- If a collision-resistant robust embedding is ever built, the paper's construction immediately yields a watermark that is unforgeable, robust to transformations shared by the embedding and the watermark, and verifiable by anyone with the public key.
- The same composition applies to any high-entropy data supporting post-hoc watermarking and robust embeddings, such as audio and video.
- With current models the embedding primitive fails the required collision-resistance, so the practical bottleneck is adversarial robustness rather than signature size or watermark capacity.
- A valid instantiation would inherit the imperceptibility of the underlying post-hoc watermark, including its PSNR and SSIM values.
Reading between the lines
- An implication the authors leave implicit is that any deep-learning component in a public detector faces the same white-box attack surface, so alternative public watermark designs must either solve embedding collision resistance or avoid differentiable components entirely.
- The paper's observed correlation between embedding accuracy and attack resistance suggests a concrete research target: track collision resistance under fixed PGD attacks as a standard benchmark, since adversarial robustness may arrive with better perception rather than dedicated defenses.
- The same construction could serve as an adversarially robust perceptual hash, giving progress on collision-resistant embeddings applications in content moderation and copy detection beyond watermarking.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper asks whether an image watermark can simultaneously be robust to natural transformations, unforgeable, and publicly detectable. It introduces formal definitions for robust embedding functions, post-hoc watermarking schemes, and robust publicly-detectable watermarking schemes; describes a warmup LSB-based scheme; and states a composition theorem (Theorem 5.1) claiming that any secure robust embedding, post-hoc watermark, and signature scheme, with suitable parameters, yield a robust, unforgeable, and publicly-detectable watermark. The paper then empirically evaluates several state-of-the-art image embedding models under white-box PGD attacks and reports that none of them currently satisfies the required collision-resistance property, concluding that the construction is theoretically possible but not yet practically deployable.
Significance. If the composition theorem were established, the paper would provide a clean modular reduction: robustness from a robust embedding and post-hoc watermark, unforgeability from collision resistance and signatures, and public detectability from a public verification procedure. The empirical study is a useful negative result, quantifying how quickly current embeddings such as SSCD and DINOv2 degrade under small ℓ∞ and ℓ1 perturbations, and the paper is explicit that the required primitive does not yet exist. The paper does not fit parameters to obtain its claim; the theorem is conditional on stated primitives, and the self-citation to Fairoze et al. is contextual rather than load-bearing. The central existence claim is, however, currently not proven because the reduction in Supplement B.2 has a load-bearing gap; this makes the significance conditional on a repair.
major comments (2)
- [Supplement B.2, Claim 2] The reduction A_REF is not a valid adversary for Definition B.1. Definition B.1 fixes a challenge x and requires the adversary to output x* such that Compare(Embed(x), Embed(x*)) = true and x* ∉ Γ(x). The constructed A_REF ignores its input x, runs A_RPWS(pk) to obtain x*, and submits (e, e*) with e = Embed(x*) and e* decoded from x*. This pair is a collision between x* and the source of e*—typically one of A_RPWS's watermark queries—not between x* and the challenge x; nothing forces A_RPWS to interact with x. The same gap affects A_SIG: if A_RPWS reuses a legitimately signed embedding e_i from an oracle query, then (e*, σ*) is not a valid signature forgery. The assertion that at least one of A_SIG or A_REF will succeed therefore requires a multi-query hybrid that tracks whether the forged embedding was signed during a watermark query, and no such hybrid is supplied. Until Definition B.1 is strengthened to pair-finding collision resistance and the reduction is reworked, Theorem 5.1 is not proven.
- [Supplement B.2, Claim 1] The correctness argument concludes that Detect(pk, T(Watermark(sk,x))) succeeds whenever SIG.Verify and REF.Compare succeed, but the hypotheses do not imply the required Compare condition. For T ∈ T_REF ∩ T_PGWS, the verification requires REF.Compare(Embed(T(Encode(x, σ∥e))), e) = true. REF correctness only guarantees Compare(Embed(x), Embed(T'(x))) = true for each T' ∈ T_REF, and the condition 'PGWS.Encode ∈ T_REF' is not formally defined; in any case, membership of Encode in T_REF does not imply that the composition T∘Encode(x,·) is in T_REF unless T_REF is closed under composition. The proof needs an explicit closure condition or a different correctness argument before the stated ε_REF + ε_PGWS + negl(λ) bound can be accepted.
minor comments (5)
- [Supplement B.2, end of Claim 1] The displayed equation '1 − (ε_REF + ε_PGWS + negl(λ)) =: 1 − ε_PGWS' appears to define the final error probability as ε_PGWS, which is inconsistent; it should introduce a new parameter such as ε_RPWS.
- [Definition B.3] The private unforgeability property contains a malformed line ', Decode ← Generate(1λ, c,T)' that is missing the Encode algorithm, and the heading contains the typo 'Unforegability'; these should be corrected.
- [Theorem 5.1] The condition 'PGWS.Encode ∈ T_REF' is ambiguous because T_REF is a set of transformations while Encode is an algorithm with an additional message input; the paper should specify that for every message m, the map x ↦ Encode(x,m) is a transformation in T_REF.
- [Section 4, Theorem 4.2] The claimed collision resistance of the floor hash is asserted for 'natural images' without a formal distribution or definition of visual similarity; if this warmup scheme is intended as a formal result, the image class and the transformation set Γ should be made precise.
- [Section 6.2] The text refers to Figure 5 for ℓ1 results, but Figure 5 appears only in Supplement C; the main-text reference should point to the supplement explicitly or the figure should be moved into the main text.
Circularity Check
No significant circularity: Theorem 5.1 is a transparent conditional composition of independently stated primitives; the only self-citation is contextual, and the paper explicitly tables deployment on a currently-unavailable collision-resistant embedding.
full rationale
The claimed derivation chain in Theorem 5.1 is a conditional composition: it assumes a (T_REF, m, n, epsilon_REF)-robust embedding function, a (T_PGWS, c, epsilon_PGWS)-post-hoc watermarking scheme, and a (delta, lambda)-signature scheme with c >= delta + n and PGWS.Encode in T_REF, and then defines Watermark/Detect by embedding the image, signing the embedding, and encoding signature and embedding through the post-hoc watermark. Unforgeability is argued by reduction to signature unforgeability and robust-embedding collision resistance; no parameter is fitted from data and then renamed as a prediction, and no derived quantity is inserted into the definitions by construction. The only self-citation, Fairoze et al. 2023, is referenced as the text-domain analogue and is not load-bearing for the image construction or its proof. The paper also states a clear practical limitation rather than hiding it: Section 6.2 reports that all evaluated embedding models fail the required collision-resistance property, e.g., SSCD's ROC AUC drops to 0.057 under a small L_infinity attack, so the theorem is explicitly conditional on a primitive that does not yet exist. Separately, the Supplement B.2 reduction for A_REF does not appear to bind the challenge x to the adversary's output, which is a proof-soundness concern about Claim 2 rather than a circularity of the construction; the scheme is still a genuine composition of stated assumptions, not an equation that reduces to its own inputs. Overall, no circular step of any of the enumerated kinds is present.
Assumptions & free parameters
assumptions (4)
- standard math Existence of (delta, lambda)-cryptographic signature schemes (e.g., RSA, ECDSA)
- ad hoc to paper Existence of a (T_REF, m, n, epsilon_REF)-robust embedding function satisfying correctness and collision resistance per Definition B.1
- ad hoc to paper Existence of a (T_PGWS, c, epsilon_PGWS)-post-hoc watermarking scheme with capacity c >= delta + n and such that Encode is in T_REF
- ad hoc to paper The floor-hash in the warmup scheme is collision-resistant for natural images (Section 4)
Cite this review
Pith. "Pith review of On the Difficulty of Constructing a Robust and Publicly-Detectable Watermark." pith.science (2026). https://pith.science/paper/VIWVKJ5O
@misc{pith2026250204901,
author = {Pith},
title = {Pith review of: On the Difficulty of Constructing a Robust and Publicly-Detectable Watermark},
year = {2026},
howpublished = {\url{https://pith.science/paper/VIWVKJ5O}},
note = {Machine review of arXiv:2502.04901}
}
read the original abstract
This work investigates the theoretical boundaries of creating publicly-detectable schemes to enable the provenance of watermarked imagery. Metadata-based approaches like C2PA provide unforgeability and public-detectability. ML techniques offer robust retrieval and watermarking. However, no existing scheme combines robustness, unforgeability, and public-detectability. In this work, we formally define such a scheme and establish its existence. Although theoretically possible, we find that at present, it is intractable to build certain components of our scheme without a leap in deep learning capabilities. We analyze these limitations and propose research directions that need to be addressed before we can practically realize robust and publicly-verifiable provenance.
Figures
Figures from the paper (11 more)
Forward citations
Cited by 2 Pith papers
-
First-Place Solution to NeurIPS 2024 Invisible Watermark Removal Challenge
A competition-winning pipeline removes 95.7% of StegaStamp and TreeRing watermarks on the NeurIPS 2024 benchmark by combining VAE fine-tuning, diffusion purification, and translation tricks.
-
README: Robust Error-Aware Digital Signature Framework via Deep Watermarking Model
By cropping an image and adding a learned error-painting correction module, an off-the-shelf 64-bit watermarking model is claimed to carry 2048-bit signatures with 86.3% zero-bit-error image rate under JPEG compression.
Reference graph
Works this paper leans on
-
[1]
Generate(1λ, m, n,T ) → (Embed, Compare). Generate takes the input size m, output size n, and the security parameter λ, outputting the robust embedding function in time poly(λ)
-
[2]
Embed(x) → e. The function Embed : {0, 1}m → {0, 1}n takes an arbitrary object x and maps it to a discrete point in the embedding space e
-
[3]
Compare(x, y) → b. The function Compare : {0, 1}n × {0, 1}n → {0, 1} takes two embed- dings x and y and outputs a single bit b such that b is true when x and y are similar, and false otherwise. A valid robust embedding function must satisfy the following two properties: 22
-
[4]
Output x′. Detect. Given a public key pk and candidate watermarked object x′,
-
[5]
Output b1 ∧ b2. Claim 1. The above scheme is correct if the underlying signature scheme and post-generation watermarking scheme are both correct. Proof. Observe that this RPWS is robust to the intersection of the input transformation sets, i.e., TRPWS = TREF ∩ TPGWS—any transformation applied to the image that is not in this set will result in either inco...
-
[6]
Correctness. For all x and transformations T ∈ T, Pr Compare(Embed(x), Embed(T (x))) = true : Embed, Compare ← Generate(1λ, m, n,T ) ≥ 1 − ϵ
-
[7]
Collision-resistance. For any choice of x, it must be that Pr Compare(Embed(x), Embed(x∗)) = true ∧ x∗ ̸∈ Γ(x) : Embed, Compare ← Generate(1λ, m, n,T ) x∗ ← AEmbed(·)(m, n,T , x) ≤ ϵ. Definition B.2 (Cryptographic signature scheme). A (δ, λ)-cryptographic signature scheme SIG is a 3-tuple ( Generate, Sign, Verify) defined as follows:
-
[8]
Generate(1λ) → (sk, pk). Takes in the target security bits number λ and outputs a fresh secret key sk and public key pk pair in time poly(λ)
Show all 38 references
-
[9]
Given the secret key sk and a object to signx, Sign computes σ ∈ {0, 1}δ: a signature of sk on x
Sign(sk, x) → σ. Given the secret key sk and a object to signx, Sign computes σ ∈ {0, 1}δ: a signature of sk on x
-
[10]
Given a public key pk, object x, and signature σ, Verify checks if σ is a valid signature of the corresponding secret key of pk on x and encodes the result into one bit b
Verify(pk, x, σ) → b. Given a public key pk, object x, and signature σ, Verify checks if σ is a valid signature of the corresponding secret key of pk on x and encodes the result into one bit b. It returns either true or false depending on if verification succeeded or not. A va...
-
[11]
It holds that for all x, Pr Verify(pk, x,Sign(sk, x)) = true : (sk, pk) ← Generate(1λ) ≥ 1 − negl(λ)
Correctness. It holds that for all x, Pr Verify(pk, x,Sign(sk, x)) = true : (sk, pk) ← Generate(1λ) ≥ 1 − negl(λ)
-
[12]
Let X denote the set of oracle queries that the adversary makes to Sign(sk, ·)
Unforgeability. Let X denote the set of oracle queries that the adversary makes to Sign(sk, ·). It holds that for all x, Pr Verify(pk, x∗, σ∗) = true ∧ x∗ ̸∈ X : (sk, pk) ← Generate(1λ) (x∗, σ∗) ← ASign(sk,·)(pk) ≤ negl(λ). Definition B.3 (Post-hoc watermarking sch...
-
[13]
Takes in the target security bits number λ, the capacity size in bits c, and the set of possible transformations T and outputs the encode and decode algorithms in time poly(λ)
Generate(1λ, c,T ) → (Encode, Decode). Takes in the target security bits number λ, the capacity size in bits c, and the set of possible transformations T and outputs the encode and decode algorithms in time poly(λ)
-
[14]
Given a message m such that m ∈ {0, 1}c and target object x, Encode plants m a watermark in x producing x′
Encode(x, m) → x′. Given a message m such that m ∈ {0, 1}c and target object x, Encode plants m a watermark in x producing x′. 23
-
[15]
Given a potentially watermarked object x∗, Decode recovers m ∈ {0, 1}c if it exists
Decode(x∗) → m. Given a potentially watermarked object x∗, Decode recovers m ∈ {0, 1}c if it exists. Let X and M be the set of all valid objects and messages respectively. A valid PGWS must satisfy correctness with optional private unforgeability:
-
[16]
For all choices of x, m, and T , Pr Decode(T (Encode(x, m))) = m : Encode, Decode ← Generate(1λ, c,T ) ≥ 1 − ϵ
Correctness. For all choices of x, m, and T , Pr Decode(T (Encode(x, m))) = m : Encode, Decode ← Generate(1λ, c,T ) ≥ 1 − ϵ
-
[17]
Let X be the list of object queries that A makes to the decoding oracle and let Γ(X) be the set containing all neighboring query objects
Private Unforegability. Let X be the list of object queries that A makes to the decoding oracle and let Γ(X) be the set containing all neighboring query objects. It must be that for all x, m, and A, Pr Decode(x∗, m) = m ∧ x∗ ̸∈ Γ(X) : , Decode ← Generate(1λ, c,T ) x∗ ← A...
-
[18]
Takes in the security parameter λ and outputs a fresh secret key sk and public key pk pair
Generate(1λ) → (sk, pk). Takes in the security parameter λ and outputs a fresh secret key sk and public key pk pair
-
[19]
Given a secret key sk and target object x, Watermark plants a watermark in x under sk producing x′
Watermark(sk, x) → x′. Given a secret key sk and target object x, Watermark plants a watermark in x under sk producing x′
-
[20]
Given a potentially watermarked object x∗, Detect checks if there is valid watermark under the corresponding secret key to pk
Detect(pk, x∗) → b. Given a potentially watermarked object x∗, Detect checks if there is valid watermark under the corresponding secret key to pk. It outputs true or false as a single bit depending on if verification succeeds or not. A valid RPWS must satisfy the following properties:
-
[21]
It holds that for all x, Pr Detect(pk, T(Watermark(sk, x))) = true : (sk, pk) ← Generate(1λ) ≥ 1 − ϵ
Correctness. It holds that for all x, Pr Detect(pk, T(Watermark(sk, x))) = true : (sk, pk) ← Generate(1λ) ≥ 1 − ϵ
-
[22]
Let X denote the set of oracle queries that the adversary makes to Watermark(sk, ·)
Unforegability. Let X denote the set of oracle queries that the adversary makes to Watermark(sk, ·). It holds that for all x, Pr Detect(pk, x∗) = true ∧ x∗ ̸∈ Γ(X) : (sk, pk) ← Generate(1λ) (x∗) ← AWatermark(sk,·)(pk) ≤ ϵ. 24 B.2 Constructing a Robust and Publicly-...
-
[23]
Compute the robust embedding e = REF.Embed(x)
-
[24]
Sign the embedding σ ← SIG.Sign(sk, e)
-
[25]
Plant σ and e into x: x′ ← PGWS.Encode(x, σ∥ e)
-
[27]
Compute the aggregated hash e = REF.Embed(x′)
-
[28]
Decode the embedded payload if it exists σ′ ∥ e′ ← PGWS.Decode(x′)
-
[29]
Attempt signature verification b1 ← SIG.Verify(pk, e′, σ′)
-
[30]
Attempt closeness verification b2 ← REF.Compare(e, e′)
-
[32]
Run ARPWS(pk) to obtain x∗ such that with high probabilityRPWS.Detect(pk, x∗) = true
-
[33]
Compute σ∗ ∥ e∗ ← PGWS.Decode(x∗)
-
[34]
Similarly, we construct AREF that breaks the collision-resistance of the underlying robust embedding function as follows: Construction of AREF
Return ( e∗, σ∗) as a forgery. Similarly, we construct AREF that breaks the collision-resistance of the underlying robust embedding function as follows: Construction of AREF. On input x, T :
-
[35]
Run ARPWS(pk) to obtain x∗ such that with high probability Detect(pk, x∗) = true
-
[36]
Compute the output of REF.Embed: e ← REF.Embed(x∗)
-
[37]
Decode the payload σ∗ ∥ e∗ ← Decode(x∗)
-
[38]
cropped and affine-transformed
Submit ( e, e∗) as a collision. We know that with high probability,Detect(pk, x∗) = SIG.Verify(pk, e∗, σ∗) ∧ REF.Compare(e, e∗) = true implying that either Verify or Compare has been forged such that x∗ ̸∈ Γ(x). It is easy to see that at least one of ASIG or AREF will succeed:...
2019
-
[2003]
Their techniques formed the backbone of Shazam [Wang, 2006]
developed a highly effective audio fingerprint for identifying music. Their techniques formed the backbone of Shazam [Wang, 2006]. Feature extraction. We highlight key works that are relevant to this paper. We refer the reader to the DINOv2 paper [Oquab et al., 2023] for a mor...
2006
-
[2019]
granularity
developed Multigrain: a network architecture designed to produce compact descrip- tors for image classification and object retrieval downstream tasks. It crucially leverages different levels of image “granularity” to learn generalized features. Bootstrap Your Own Latents (BYOL...
2020
Reviewed August 8, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.