Pith. sign in

REVIEW 2 major objections 4 minor 124 references

The mathematical landscape of partial information decomposition: A comprehensive review of properties and measures

T0 review · 2 major / 4 minor · reviewed 2026-08-02 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Partial information decomposition has many competing definitions; this paper claims to map every measure to every proposed axiom with proofs or counterexamples, and to chart which axioms can coexist.

desk verdict The PID map is genuinely useful but the central completeness claim is over-promised: several Table 5 entries rest on 'empirical tests' rather than proof/counterexample, and Theorem 2 silently uses (S0). read the letter →

arxiv 2603.06678 v2 pith:NCZOQI2P submitted 2026-03-03 cs.IT math.IT

Alberto Liardi , Keenan J. A. Down , George Blackburne , Matteo Neri , Pedro A. M. Mediano This is my paper · ORCID
classification cs.ITmath.IT MSC 94A1594A1762B10
keywords partialinformationdecompositionredundancysynergyuniqueaxiomaticpropertiesincompatibilitytheoremslatticetheory
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Partial information decomposition (PID) tries to split the mutual information between several sources and a target into redundancy, unique information, and synergy. Since its introduction, at least nineteen competing definitions and a long list of proposed axioms have appeared, and nobody knew for certain which measure satisfies which property, or even which properties can be true at the same time. This paper attempts to close that gap: it gathers the definitions in a common language, and for every measure–property pair that was not already settled it provides a proof or a counterexample in the appendix. It also assembles the web of implications and no-go theorems, adds several new ones, and uses an automatic theorem prover to find the largest sets of mutually compatible axioms. If the table is right, the field gets a single reference: a researcher can look up any measure's axiomatic profile, and any future measure can be tested against the known constraints.

What carries the argument

The load-bearing machinery is the measure–property table (Table 5): each of the nineteen redundancy measures is defined in a standard notation, and every property is verified or refuted for each measure. The proofs and counterexamples live in the appendix; the table itself supports the hierarchically clustered taxonomy of measures and the hypergraph of implications and incompatibilities. Around the table, the paper places an automatic theorem prover encoding of the axioms, which checks compatibility of property combinations and identifies maximal coherent sets. The underlying objects — the redundancy lattice and the Möbius-inversion step that yields the PID atoms — are the shared skeleton th

What would settle it

Search small probability distributions with exact arithmetic for each of the four empirically tested entries — Target Monotonicity for the information-geometric measure, Strong Symmetry for the dependency-constraint measure, Local Positivity for the maximum-entropy-star measure, Additivity for the causal-tensor measure — and check whether the claimed satisfiability or violation holds; separately, check whether Theorem 2's conclusion (Identity) follows from (Self-Redundancy, Target Chain rule, Target Equality) without Weak Symmetry, since the given proof silently uses it.

Watch

Extended reading notes

Core claim

The paper's central claim is that it supplies the first systematic, verified classification of PID measures by their axioms: for every measure in the literature and every property — symmetry, monotonicity, target chain rule, identity, Blackwell property, additivity, continuity, and the rest — the paper states whether the property holds, and for every combination not previously settled it gives either a proof or an explicit counterexample. On this basis it derives new relationships among the axioms, most notably that Self-Redundancy (a single source's redundancy equals its mutual information), Target Chain rule (the chain rule for redundancy in the target), and Target Equality (adding the tar

Load-bearing premise

The load-bearing premise is that every entry of the verification table is correct, including the few justified only by 'empirical tests' rather than proofs or counterexamples — and, separately, that Theorem 2's proof, which silently uses Weak Symmetry, is valid as stated.

Editorial extensions

If this is right

  • A practitioner can look up any measure's axiomatic profile in one table, rather than tracing original papers.
  • The new incompatibility result (Self-Redundancy, Equivalence-class Invariance, Local Positivity, Target Equality, Target Chain rule) shows that even without the controversial Independent-Identity axiom, target chain rule and target equality cannot be combined with local positivity.
  • The implication (Self-Redundancy, Target Chain rule, Target Equality) ⇒ Identity means any measure that satisfies the chain rule and target equality will also satisfy the contested Identity property.
  • The maximal compatible sets give future measure designers explicit targets: 20 properties are achievable by giving up either Strong Local Positivity or Equivalence-class Invariance; keeping both caps the set at 17.
  • The theorem prover turns the web of axioms into a computable constraint system, so a newly proposed measure can be automatically checked against all known implications and incompatibilities.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the table is correct, the practical lesson is that PID choice is a matter of axiomatic commitment, not a single best measure; the paper's clustering suggests only about a quarter of the axioms distinguish the existing measures, so the real design choices are few.
  • Since no existing measure attains the maximal 20-property set, the framework poses a concrete open problem: construct a measure satisfying all 20 (by dropping Strong Local Positivity and accepting negative atoms), or prove it impossible.
  • The equivalence (Weak Monotonicity + Target Equality) ⇔ Strong Monotonicity implies the axiom catalog can be slimmed, potentially changing how future measures are presented and compared.
  • The encoding of the property web as a computable constraint system means the entire body of PID compatibility knowledge becomes executable, which may accelerate testing of both new measures and new axioms.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 4 minor

Summary. This paper is a systematic review and original-research resource for Partial Information Decomposition (PID). It standardizes notation for 19 PID measures and 20 properties, presents a property–measure classification table (Table 5), compiles a theorem web relating properties (Tables 3–4, Fig. 2), and uses the Z3 SMT solver to verify compatibility claims. The core promise, stated in §1.1 and §3.1, is that every entry in Table 5 not already known in the literature is accompanied by a proof or an explicit counterexample in the appendix. The paper also contributes new theorems (e.g., Theorems 2, 4, 6, 7, 10, 11) and corrects earlier claims in the literature.

Significance. If the completeness claim can be substantiated, this would be the standard reference map of the PID measure/property landscape: it organizes a dispersed literature, makes the property/measure satisfaction structure explicit, and provides machine-checked compatibility results via an open-source Z3 implementation. The inclusion of unpublished measures (I_RAV) and corrections to prior proofs (e.g., Lemma 3 of Ref. [41]) are useful scholarly contributions. However, the central verification claim is currently not met to the letter: a non-negligible set of Table 5 entries rests on "empirical tests" rather than proofs or located counterexamples, so a reader cannot independently certify those entries. The contribution is therefore significant but requires completion before it can serve as a trustworthy map.

major comments (2)
  1. [§3.1, Table 5, Appendix E.1] The promise that every non-known Table 5 entry has a proof or counterexample is not fulfilled. Appendix E.1 contains several entries justified only by "empirical tests" without specifying distributions or parameter values: I_IG "(TM) holds from empirical tests"; I_DEP "(S1) is violated as observed from empirical tests"; I_MES "(LP0) is violated... as seen from empirical tests" and "(TM) is violated as observed from empirical tests"; I_CT "(AD) does not hold as observed from empirical tests"; I_CCS "(TM),(TC),(S1) are violated as observed from empirical tests"; plus similar entries for I_SX, I_do, I_RAV, I_RDR, and a conditional example for I_RR. Numerical observation is not the promised proof/counterexample; if any of these entries is wrong, Table 5 is wrong. Either supply proofs/counterexamples or explicitly downgrade these to empirical claims and revise the §3.1 promise.
  2. [§C.2, Theorem 2] The proof of Theorem 2 (Eq. 49) passes from I∩(X1,X2;X1) to I∩(X2;X1). This requires permuting the sources (S0) together with (TE); the text attributes the step only to (TE). Since Theorem 2 is stated with hypotheses (SR),(TC),(TE) (Table 3), it is under-specified. Theorem 4 inherits this because it relies on Theorem 2. Add (S0) to the hypotheses or state explicitly that S0 is assumed throughout the implication table.
minor comments (4)
  1. [§C.2, Proposition 6] The proof uses (TM) to justify I∩(X1,X2;f(X1,X2)) ≤ I∩(X1,X2;X1,X2), but the (TM) defined by Eq. (32) only concerns adding a target variable, not replacing the target by a deterministic coarsening f(X1,X2). As written, the proof does not follow from the stated axiom; either supply a correct proof or add the needed target-coarsening version of TM.
  2. [§C.2, Theorem 12] The closing remark that Theorem 12 "can also be derived by combining Theo. 1 and Theo. 11" is misleading: that derivation would require (EI), which is not among the hypotheses of Theorem 12. The direct citation to Ref. [19] is sufficient.
  3. [Appendix A] The intended distinction between multivariate and multiple arguments via comma versus semicolon is not visible in the typeset text: "I(X1, X2, X3;Y)" and "I(X1, X2, X3;Y)" appear identical. Please fix the notation so the two quantities are distinguishable.
  4. [Table 5] The footnote apparatus is incomplete: only the I_IG/(TM) entry carries the asterisk for "supported by empirical simulations," yet several other entries in Appendix E.1 also rely on empirical tests. Either flag all such entries or remove the special status of the I_IG entry.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the central table/theorem claims are derived from measure definitions and external results, not from the paper's own prior work.

full rationale

I walked the claimed derivation chain. The central contribution, Table 5, is a systematic catalogue of which PID properties hold for which measures. Its entries are justified either by direct calculation from the measures' definitions in Appendix D or by external references, e.g. 'I min ∩ (SR),(S0),(M0),(GP),(LP0) follow directly from the definition [10]' and 'I BROJA ∩ (BP),(TE), and (∗) are satisfied: see Ref. [38]'. These are independent support, not self-citations. The newly claimed theorems (Theo. 2, 4, 6, 7, 10, 11) are proved from the axiom definitions; none of the proofs invokes the authors' own prior results as load-bearing premises. Theorem 2's proof is suspect (the step labelled (TE) appears to need additional assumptions), but an unsupported or under-specified proof is a correctness issue, not a circular reduction. The 'empirical tests' entries in Appendix E.1 (e.g. 'I IG ∩: (TM) holds from empirical tests') weaken the promised proof/counterexample completeness claim, but they are not fitted parameters renamed as predictions and they do not make the result equivalent to an input by construction. The Z3 component checks consistency of axiom combinations and is an independent consistency check, not an input to the derivations. Self-citations ([45], [81], [85], [93], [107], [108], [106]) appear in contextual remarks and do not carry the load of Table 5 or the theorems. Therefore no circular step can be quoted with a specific reduction, and the appropriate score is 0.

Assumptions & free parameters 0 free parameters · 4 assumptions · 0 invented entities

No new physical or formal entities are postulated, and no free parameters are fitted. The paper organizes existing measures and properties; however it implicitly assumes that the PID lattice framework, the listed property formalizations, and Z3 encodings are correct, and that empirical checks can stand in for proofs in some cells.

assumptions (4)
  • domain assumption The Williams & Beer redundancy lattice and inclusion-exclusion principle are the correct decomposition structure for PID.
    The review confines its main results to lattice-based PID; alternative lattices and IEP rejection are discussed but not incorporated (Sec. 4.3).
  • domain assumption The 20 listed properties are a faithful and complete formalization of all properties proposed in the PID literature.
    The central table and theorem map inherit any mis-formalization; e.g., (EI) is formalized via the equivalence relation in Eq. (11).
  • standard math Z3 SMT solver is sound and complete for the encoded property-compatibility problems.
    Used in Sec. 3.2 to compute maximal compatible property sets; results depend on the correctness of the encoding.
  • ad hoc to paper Numerical 'empirical tests' can serve as sufficient evidence for a property holding or failing.
    Several Table 5 entries rely on empirical tests rather than mathematical proof, contradicting the paper's own completeness claim.

how reviews work

0 comments
Cite this review

Pith. "Pith review of The mathematical landscape of partial information decomposition: A comprehensive review of properties and measures." pith.science (2026). https://pith.science/paper/NCZOQI2P

@misc{pith2026260306678,
  author       = {Pith},
  title        = {Pith review of: The mathematical landscape of partial information decomposition: A comprehensive review of properties and measures},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/NCZOQI2P}},
  note         = {Machine review of arXiv:2603.06678}
}
read the original abstract

Partial Information Decomposition (PID) has become one of the most prominent information-theoretic frameworks for describing the structure and quality of information in complex systems. Despite its widespread utility, there exists no unique solution constraining precisely how a PID should be constructed, leading to a multiverse of different formalisms with different mathematical commitments. In this work, we provide a comprehensive overview of the mathematical landscape of PID. By integrating existing PID measures into a common language, we systematically examine all major approaches to the PID framework that have emerged so far, determining for each measure whether or not each known property holds. In addition, we derive a web of all known theorems mapping the relationships and incompatibilities between these properties, before also revealing some novel interdependency results. In doing so, we chart a brief history of the framework, promote a unified perspective for its discussions, and offer a path towards both theoretical refinement and informed empirical applications for the future of this powerful method.

Figures

Figures reproduced from arXiv: 2603.06678 by the authors.

Figure 1
Figure 1. FIG. 1: Hierarchical organisation of PID measures induced by properties. a) [PITH_FULL_IMAGE:figures/full_fig_p013_1.png] view at source ↗
Figure 2
Figure 2. FIG. 2: Formal relationships among PID properties. a) [PITH_FULL_IMAGE:figures/full_fig_p014_2.png] view at source ↗
Figure 3
Figure 3. FIG. 3 [PITH_FULL_IMAGE:figures/full_fig_p021_3.png] view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: FIG. 4: Temporal timeline of the introduction of PID measures, properties, and their relationships. [PITH_FULL_IMAGE:figures/full_fig_p023_4.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

124 extracted references · 7 linked inside Pith

  1. [41]

    Explicit formula for partial information decomposition,

    A. Lyu, A. Clark, and N. Raviv, “Explicit formula for partial information decomposition,” in2024 IEEE International Symposium on Information Theory (ISIT), pp. 2329–2334, IEEE, 2024

    2024

  2. [1]

    A mathematical theory of communication,

    C. E. Shannon, “A mathematical theory of communication,”The Bell System Technical Journal, vol. 27, no. 3, pp. 379–423, 1948

    1948

  3. [2]

    Certain factors affecting telegraph speed 1,

    H. Nyquist, “Certain factors affecting telegraph speed 1,”Bell System Technical Journal, vol. 3, no. 2, pp. 324– 346, 1924

    1924

  4. [3]

    Transmission of information 1,

    R. V. Hartley, “Transmission of information 1,”Bell System technical journal, vol. 7, no. 3, pp. 535–563, 1928

    1928

  5. [4]

    Clausius,Ueber verschiedene f¨ ur die Anwendung bequeme Formen der Hauptgleichungen der mechanischen W¨ armetheorie: vorgetragen in der naturforsch

    R. Clausius,Ueber verschiedene f¨ ur die Anwendung bequeme Formen der Hauptgleichungen der mechanischen W¨ armetheorie: vorgetragen in der naturforsch. Gesellschaft den 24. April 1865. Verlag nicht ermittelbar, 1865

  6. [5]

    Weitere studien ¨ uber das w¨ armegleichgewicht unter gasmolek¨ ulen,

    L. Boltzmann, “Weitere studien ¨ uber das w¨ armegleichgewicht unter gasmolek¨ ulen,”Sitzungsberichte der Kaiserlichen Akademie der Wissenschaften in Wien, vol. 66, no. 2, pp. 275–370, 1872

  7. [6]

    Weitere studien ¨ uber das w¨ armegleichgewicht unter gasmolek¨ ulen,

    L. Boltzmann, “Weitere studien ¨ uber das w¨ armegleichgewicht unter gasmolek¨ ulen,” inKinetische Theorie II: Irreversible Prozesse Einf¨ uhrung und Originaltexte, pp. 115–225, Springer, 1970

    1970

  8. [7]

    Information theory and statistical mechanics,

    E. T. Jaynes, “Information theory and statistical mechanics,”Physical review, vol. 106, no. 4, p. 620, 1957

    1957

Show all 124 references
  1. [8]

    T. M. Cover and J. A. Thomas,Elements of Information Theory. John Wiley & Sons, 1999

    1999

  2. [9]

    Multivariate dependence beyond shannon information,

    R. G. James and J. P. Crutchfield, “Multivariate dependence beyond shannon information,”Entropy, vol. 19, no. 10, p. 531, 2017

    2017

  3. [10]

    Nonnegative decomposition of multivariate information,

    P. L. Williams and R. D. Beer, “Nonnegative decomposition of multivariate information,”arXiv preprint arXiv:1004.2515, 2010

    2010 arXiv

  4. [11]

    Disentangling high-order mechanisms and high-order behaviours in complex systems,

    F. E. Rosas, P. A. Mediano, A. I. Luppi, T. F. Varley, J. T. Lizier, S. Stramaglia, H. J. Jensen, and D. Mari- nazzo, “Disentangling high-order mechanisms and high-order behaviours in complex systems,”Nature Physics, vol. 18, no. 5, pp. 476–477, 2022

    2022

  5. [12]

    A synergistic core for human brain evolution and cognition,

    A. I. Luppi, P. A. Mediano, F. E. Rosas, N. Holland, T. D. Fryer, J. T. O’Brien, J. B. Rowe, D. K. Menon, D. Bor, and E. A. Stamatakis, “A synergistic core for human brain evolution and cognition,”BioRxiv, 2020

    2020

  6. [13]

    Synergistic and redundant information dynamics are modulated by alzheimer’s disease and cognitive impairment,

    K. J. Down, J. Huntley, P. A. Mediano, and D. Bor, “Synergistic and redundant information dynamics are modulated by alzheimer’s disease and cognitive impairment,”bioRxiv, pp. 2026–02, 2026

    2026

  7. [14]

    A taxonomy of neuroscientific strategies based on interaction orders,

    M. Neri, A. Brovelli, S. Castro, F. Fraisopi, M. Gatica, R. Herzog, P. A. Mediano, I. Mindlin, G. Petri, D. Bor,et al., “A taxonomy of neuroscientific strategies based on interaction orders,”European Journal of Neuroscience, vol. 61, no. 3, p. e16676, 2025

    2025

  8. [15]

    Higher- order and distributed synergistic functional interactions encode information gain in goal-directed learning,

    E. Combrisson, R. Basanisi, M. Neri, G. Auzias, G. Petri, D. Marinazzo, S. Panzeri, and A. Brovelli, “Higher- order and distributed synergistic functional interactions encode information gain in goal-directed learning,” Nature Communications, vol. 16, no. 1, p. 7179, 2025

    2025

  9. [16]

    Networks beyond pairwise interactions: Structure and dynamics,

    F. Battiston, G. Cencetti, I. Iacopini, V. Latora, M. Lucas, A. Patania, J.-G. Young, and G. Petri, “Networks beyond pairwise interactions: Structure and dynamics,”Physics reports, vol. 874, pp. 1–92, 2020

    2020

  10. [17]

    Synergistic signatures of group mechanisms in higher-order systems,

    T. Robiglio, M. Neri, D. Coppes, C. Agostinelli, F. Battiston, M. Lucas, and G. Petri, “Synergistic signatures of group mechanisms in higher-order systems,”Physical review letters, vol. 134, no. 13, p. 137401, 2025

    2025

  11. [18]

    Bivariate measure of redundant information,

    M. Harder, C. Salge, and D. Polani, “Bivariate measure of redundant information,”Physical Review E, vol. 87, no. 1, p. 012130, 2013. 59

    2013

  12. [19]

    Shared information—new insights and problems in de- composing information in complex systems,

    N. Bertschinger, J. Rauh, E. Olbrich, and J. Jost, “Shared information—new insights and problems in de- composing information in complex systems,” inProceedings of the European conference on complex systems 2012, pp. 251–269, Springer, 2013

    2012

  13. [20]

    Intersection information based on common randomness,

    V. Griffith, E. K. Chong, R. G. James, C. J. Ellison, and J. P. Crutchfield, “Intersection information based on common randomness,”Entropy, vol. 16, no. 4, pp. 1985–2000, 2014

    1985

  14. [21]

    Quantifying unique information,

    N. Bertschinger, J. Rauh, E. Olbrich, J. Jost, and N. Ay, “Quantifying unique information,”Entropy, vol. 16, no. 4, pp. 2161–2183, 2014

    2014

  15. [22]

    Quantifying synergistic mutual information,

    V. Griffith and C. Koch, “Quantifying synergistic mutual information,” inGuided self-organization: inception, pp. 159–190, Springer, 2014

    2014

  16. [23]

    Quantifying redundant information in predicting a target random variable,

    V. Griffith and T. Ho, “Quantifying redundant information in predicting a target random variable,”Entropy, vol. 17, no. 7, pp. 4644–4653, 2015

    2015

  17. [24]

    Exploration of synergistic and redundant information sharing in static and dynamical gaussian systems,

    A. B. Barrett, “Exploration of synergistic and redundant information sharing in static and dynamical gaussian systems,”Physical Review E, vol. 91, no. 5, p. 052802, 2015

    2015

  18. [25]

    Temporal information partitioning: Characterizing synergy, uniqueness, and redundancy in interacting environmental variables,

    A. E. Goodwell and P. Kumar, “Temporal information partitioning: Characterizing synergy, uniqueness, and redundancy in interacting environmental variables,”Water Resources Research, vol. 53, no. 7, pp. 5920–5942, 2017

    2017

  19. [26]

    Measuring multivariate redundant information with pointwise common change in surprisal,

    R. A. Ince, “Measuring multivariate redundant information with pointwise common change in surprisal,” Entropy, vol. 19, no. 7, p. 318, 2017

    2017

  20. [27]

    Unique information via dependency constraints,

    R. G. James, J. Emenheiser, and J. P. Crutchfield, “Unique information via dependency constraints,”Journal of Physics A: Mathematical and Theoretical, vol. 52, no. 1, p. 014002, 2018

    2018

  21. [28]

    Exact partial information decompositions for gaussian systems based on depen- dency constraints,

    J. W. Kay and R. A. Ince, “Exact partial information decompositions for gaussian systems based on depen- dency constraints,”Entropy, vol. 20, no. 4, p. 240, 2018

    2018

  22. [29]

    Unique information and secret key agreement,

    R. G. James, J. Emenheiser, and J. P. Crutchfield, “Unique information and secret key agreement,”Entropy, vol. 21, no. 1, p. 12, 2018

    2018

  23. [30]

    Pointwise partial information decomposition using the specificity and ambiguity lattices,

    C. Finn and J. T. Lizier, “Pointwise partial information decomposition using the specificity and ambiguity lattices,”Entropy, vol. 20, no. 4, p. 297, 2018

    2018

  24. [31]

    A measure of synergy, redundancy, and unique information using information geometry,

    X. Niu and C. J. Quinn, “A measure of synergy, redundancy, and unique information using information geometry,” in2019 IEEE International Symposium on Information Theory (ISIT), pp. 3127–3131, IEEE, 2019

    2019

  25. [32]

    A partial information decomposition for multivariate gaussian systems based on information geometry,

    J. W. Kay, “A partial information decomposition for multivariate gaussian systems based on information geometry,”Entropy, vol. 26, no. 7, p. 542, 2024

    2024

  26. [33]

    A partial information decomposition based on causal tensors,

    D. Sigtermans, “A partial information decomposition based on causal tensors,”arXiv preprint arXiv:2001.10481, 2020

    2001 arXiv

  27. [34]

    Towards a framework for observational causality from time series: when shannon meets turing,

    D. Sigtermans, “Towards a framework for observational causality from time series: when shannon meets turing,”Entropy, vol. 22, no. 4, p. 426, 2020

    2020

  28. [35]

    Introducing a differentiable measure of pointwise shared information,

    A. Makkeh, A. J. Gutknecht, and M. Wibral, “Introducing a differentiable measure of pointwise shared information,”Physical Review E, vol. 103, no. 3, p. 032149, 2021

    2021

  29. [36]

    A partial information decomposition for discrete and continuous variables,

    K. Schick-Poland, A. Makkeh, A. J. Gutknecht, P. Wollstadt, A. Sturm, and M. Wibral, “A partial information decomposition for discrete and continuous variables,”arXiv preprint arXiv:2106.12393, 2021. 60

    2021 arXiv

  30. [37]

    Partial in- formation decomposition for continuous variables based on shared exclusions: Analytical formulation and estimation,

    D. A. Ehrlich, K. Schick-Poland, A. Makkeh, F. Lanfermann, P. Wollstadt, and M. Wibral, “Partial in- formation decomposition for continuous variables based on shared exclusions: Analytical formulation and estimation,”Physical Review E, vol. 110, no. 1, p. 014115, 2024

    2024

  31. [38]

    A novel approach to the partial information decomposition,

    A. Kolchinsky, “A novel approach to the partial information decomposition,”Entropy, vol. 24, no. 3, p. 403, 2022

    2022

  32. [39]

    Partial information decomposition via deficiency for multivariate gaussians,

    P. Venkatesh and G. Schamberg, “Partial information decomposition via deficiency for multivariate gaussians,” in2022 IEEE International Symposium on Information Theory (ISIT), pp. 2892–2897, IEEE, 2022

    2022

  33. [40]

    Decomposing and tracing mutual information by quantifying reachable decision regions,

    T. Mages and C. Rohner, “Decomposing and tracing mutual information by quantifying reachable decision regions,”Entropy, vol. 25, no. 7, p. 1014, 2023

    2023

  34. [42]

    Reconsidering unique information: Towards a multivariate information decomposition,

    J. Rauh, N. Bertschinger, E. Olbrich, and J. Jost, “Reconsidering unique information: Towards a multivariate information decomposition,” in2014 IEEE International Symposium on Information Theory, pp. 2232–2236, IEEE, 2014

    2014

  35. [43]

    Z3: An efficient smt solver,

    L. De Moura and N. Bjørner, “Z3: An efficient smt solver,” inInternational conference on Tools and Algo- rithms for the Construction and Analysis of Systems, pp. 337–340, Springer, 2008

    2008

  36. [44]

    On the foundations of combinatorial theory: I. theory of m¨ obius functions,

    G.-C. Rota, “On the foundations of combinatorial theory: I. theory of m¨ obius functions,” inClassic Papers in Combinatorics, pp. 332–360, Springer, 1964

    1964

  37. [45]

    Fast m¨ obius transform: An algebraic approach to information decomposition,

    A. Jansma, P. A. Mediano, and F. E. Rosas, “Fast m¨ obius transform: An algebraic approach to information decomposition,”Physical Review Research, vol. 7, no. 3, p. 033049, 2025

    2025

  38. [46]

    Bits and pieces: Understanding information decomposition from part-whole relationships and formal logic,

    A. J. Gutknecht, M. Wibral, and A. Makkeh, “Bits and pieces: Understanding information decomposition from part-whole relationships and formal logic,”Proceedings of the Royal Society A, vol. 477, no. 2251, p. 20210110, 2021

    2021

  39. [47]

    Information processing and dynamics in minimally cognitive agents,

    R. D. Beer and P. L. Williams, “Information processing and dynamics in minimally cognitive agents,”Cognitive science, vol. 39, no. 1, pp. 1–38, 2015

    2015

  40. [48]

    Partial information decomposition as a unified approach to the specification of neural goal functions,

    M. Wibral, V. Priesemann, J. W. Kay, J. T. Lizier, and W. A. Phillips, “Partial information decomposition as a unified approach to the specification of neural goal functions,”Brain and cognition, vol. 112, pp. 25–38, 2017

    2017

  41. [49]

    The partial information decomposition of generative neural network models,

    T. M. Tax, P. A. Mediano, and M. Shanahan, “The partial information decomposition of generative neural network models,”Entropy, vol. 19, no. 9, p. 474, 2017

    2017

  42. [50]

    Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks,

    A. M. Proca, F. E. Rosas, A. I. Luppi, D. Bor, M. Crosby, and P. A. Mediano, “Synergistic information supports modality integration and flexible learning in neural networks solving multiple tasks,”PLOS Com- putational Biology, vol. 20, no. 6, p. e1012178, 2024

    2024

  43. [51]

    Partial entropy decomposition reveals higher-order information structures in human brain activity,

    T. F. Varley, M. Pope, M. Grazia, Joshua, and O. Sporns, “Partial entropy decomposition reveals higher-order information structures in human brain activity,”Proceedings of the National Academy of Sciences, vol. 120, no. 30, p. e2300888120, 2023

    2023

  44. [52]

    Multivariate information theory uncovers synergistic subsystems of the human cerebral cortex,

    T. F. Varley, M. Pope, J. Faskowitz, and O. Sporns, “Multivariate information theory uncovers synergistic subsystems of the human cerebral cortex,”Communications biology, vol. 6, no. 1, p. 451, 2023

    2023

  45. [53]

    Information decomposition and the informational architecture of the brain,

    A. I. Luppi, F. E. Rosas, P. A. Mediano, D. K. Menon, and E. A. Stamatakis, “Information decomposition and the informational architecture of the brain,”Trends in Cognitive Sciences, 2024. 61

    2024

  46. [54]

    High-order interdependencies in the aging brain,

    M. Gatica, R. Cofr´ e, P. A. Mediano, F. E. Rosas, P. Orio, I. Diez, S. P. Swinnen, and J. M. Cortes, “High-order interdependencies in the aging brain,”Brain connectivity, vol. 11, no. 9, pp. 734–744, 2021

    2021

  47. [55]

    High- order functional redundancy in ageing explained via alterations in the connectome in a whole-brain model,

    M. Gatica, F. E. Rosas, P. AM Mediano, I. Diez, S. P. Swinnen, P. Orio, R. Cofr´ e, and J. M. Cortes, “High- order functional redundancy in ageing explained via alterations in the connectome in a whole-brain model,” PLoS Computational Biology, vol. 18, no. 9, p. e1010431, 2022

    2022

  48. [56]

    An integrated computational approach for diversity- sensitive personalized medicine,

    C. Coronel-Oliveros, M. Gatica, R. Herzog, and M. Neri, “An integrated computational approach for diversity- sensitive personalized medicine,”Neuroscience, 2025

    2025

  49. [57]

    Beyond pairwise interactions: Charting higher-order models of brain function,

    A. Santoro, M. Neri, S. Poetto, D. Orsenigo, M. Diano, M. Gatica, and G. Petri, “Beyond pairwise interactions: Charting higher-order models of brain function,”bioRxiv, pp. 2025–06, 2025

    2025

  50. [58]

    Gene regulatory network inference from single-cell data using multivariate information measures,

    T. E. Chan, M. P. Stumpf, and A. C. Babtie, “Gene regulatory network inference from single-cell data using multivariate information measures,”Cell systems, vol. 5, no. 3, pp. 251–267, 2017

    2017

  51. [59]

    Evaluating methods of inferring gene regulatory networks highlights their lack of performance for single cell gene expression data,

    S. Chen and J. C. Mar, “Evaluating methods of inferring gene regulatory networks highlights their lack of performance for single cell gene expression data,”BMC bioinformatics, vol. 19, no. 1, pp. 1–21, 2018

    2018

  52. [60]

    Quantifying information modification in cellular automata using pointwise partial information decomposition,

    C. Finn and J. T. Lizier, “Quantifying information modification in cellular automata using pointwise partial information decomposition,” inArtificial Life Conference Proceedings, pp. 386–387, MIT Press One Rogers Street, Cambridge, MA 02142-1209, USA journals-info . . . , 2018

    2018

  53. [61]

    An information-theoretic approach to self-organisation: Emergence of complex interdependencies in coupled dynamical systems,

    F. Rosas, P. A. Mediano, M. Ugarte, and H. J. Jensen, “An information-theoretic approach to self-organisation: Emergence of complex interdependencies in coupled dynamical systems,”Entropy, vol. 20, no. 10, p. 793, 2018

    2018

  54. [62]

    Synergistic small worlds that drive technological sophistication,

    H. Rajpal and O. Guerrero, “Synergistic small worlds that drive technological sophistication,”PNAS nexus, vol. 4, no. 4, p. pgaf102, 2025

    2025

  55. [63]

    Pearl,Probabilistic reasoning in intelligent systems: networks of plausible inference

    J. Pearl,Probabilistic reasoning in intelligent systems: networks of plausible inference. Elsevier, 2014

    2014

  56. [64]

    The identity of information: How deterministic dependencies constrain information synergy and redundancy,

    D. Chicharro, G. Pica, and S. Panzeri, “The identity of information: How deterministic dependencies constrain information synergy and redundancy,”Entropy, vol. 20, no. 3, p. 169, 2018

    2018

  57. [65]

    Novel inconsistency results for partial infor- mation decomposition,

    P. H. Matthias, A. Makkeh, M. Wibral, and A. J. Gutknecht, “Novel inconsistency results for partial infor- mation decomposition,”arXiv preprint arXiv:2512.16662, 2025

    2025

  58. [66]

    Synergy, redundancy and common information,

    P. K. Banerjee and V. Griffith, “Synergy, redundancy and common information,”arXiv preprint arXiv:1509.03706, 2015

    2015 arXiv

  59. [67]

    On extractable shared information,

    J. Rauh, P. K. Banerjee, E. Olbrich, J. Jost, and N. Bertschinger, “On extractable shared information,” Entropy, vol. 19, no. 7, p. 328, 2017

    2017

  60. [68]

    Continuity and additivity properties of information decompositions,

    J. Rauh, P. K. Banerjee, E. Olbrich, G. Mont´ ufar, and J. Jost, “Continuity and additivity properties of information decompositions,”International Journal of Approximate Reasoning, vol. 161, p. 108979, 2023

    2023

  61. [69]

    Equivalent comparisons of experiments,

    D. Blackwell, “Equivalent comparisons of experiments,”The annals of mathematical statistics, pp. 265–272, 1953

    1953

  62. [70]

    Secret sharing and shared information,

    J. Rauh, “Secret sharing and shared information,”Entropy, vol. 19, no. 11, p. 601, 2017

    2017

  63. [71]

    From babel to boole: the logical organization of information decompositions,

    A. J. Gutknecht, A. Makkeh, and M. Wibral, “From babel to boole: the logical organization of information decompositions,”Proceedings of the Royal Society A, vol. 481, no. 2310, p. 20240174, 2025

    2025

  64. [72]

    Probability mass exclusions and the directed components of mutual information,

    C. Finn and J. T. Lizier, “Probability mass exclusions and the directed components of mutual information,” Entropy, vol. 20, no. 11, p. 826, 2018

    2018

  65. [73]

    An overview of reconstructability analysis,

    M. Zwick, “An overview of reconstructability analysis,”Kybernetes, vol. 33, no. 5/6, pp. 877–905, 2004. 62

    2004

  66. [74]

    Ross ashby’s information theory: a bit of history, some solutions to problems, and what we face today,

    K. Krippendorff, “Ross ashby’s information theory: a bit of history, some solutions to problems, and what we face today,”International journal of general systems, vol. 38, no. 2, pp. 189–212, 2009

    2009

  67. [75]

    Information geometry on hierarchy of probability distributions,

    S.-I. Amari, “Information geometry on hierarchy of probability distributions,”IEEE transactions on infor- mation theory, vol. 47, no. 5, pp. 1701–1711, 2001

    2001

  68. [76]

    Causal diagrams for empirical research,

    J. Pearl, “Causal diagrams for empirical research,”Biometrika, vol. 82, no. 4, pp. 669–688, 1995

    1995

  69. [77]

    Causal inference in statistics: An overview,

    J. Pearl, “Causal inference in statistics: An overview,”Statistics Surveys, vol. 3, pp. 96–146, 2009

    2009

  70. [78]

    The do-calculus revisited,

    J. Pearl, “The do-calculus revisited,” inProceedings of the Twenty-Eighth Conference on Uncertainty in Artificial Intelligence, pp. 3–11, 2012

    2012

  71. [79]

    “dit“: A Python package for discrete information theory,

    R. G. James, C. J. Ellison, and J. P. Crutchfield, ““dit“: A Python package for discrete information theory,” Journal of Open Source Software, vol. 3, no. 25, p. 738, 2018

    2018

  72. [80]

    Predictive information decomposition as a tool to quantify emergent dynamical behaviors in physiological networks,

    L. Faes, G. Mijatovic, L. Sparacino, and A. Porta, “Predictive information decomposition as a tool to quantify emergent dynamical behaviors in physiological networks,”IEEE Transactions on Biomedical Engineering, 2025

    2025

  73. [81]

    Null models for comparing information decomposition across complex systems,

    A. Liardi, F. E. Rosas, R. L. Carhart-Harris, G. Blackburne, D. Bor, and P. A. Mediano, “Null models for comparing information decomposition across complex systems,”PLOS Computational Biology, vol. 21, no. 11, p. e1013629, 2025

    2025

  74. [82]

    Unique informations and deficiencies,

    P. K. Banerjee, E. Olbrich, J. Jost, and J. Rauh, “Unique informations and deficiencies,” in2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton), pp. 32–38, IEEE, 2018

    2018

  75. [83]

    Multiscale computational models of complex biological systems,

    J. Walpole, J. A. Papin, and S. M. Peirce, “Multiscale computational models of complex biological systems,” Annual review of biomedical engineering, vol. 15, no. 1, pp. 137–154, 2013

    2013

  76. [84]

    Multi-scale modelling and simulation in systems biology,

    J. O. Dada and P. Mendes, “Multi-scale modelling and simulation in systems biology,”Integrative Biology, vol. 3, no. 2, pp. 86–96, 2011

    2011

  77. [85]

    Simple physical systems as a reference for multivariate information dynamics,

    A. Liardi, M. I. Sas, G. Blackburne, W. J. Knottenbelt, P. A. Mediano, and H. J. Jensen, “Simple physical systems as a reference for multivariate information dynamics,”arXiv preprint arXiv:2504.10372, 2025

    2025 arXiv

  78. [86]

    Information decomposition based on cooperative game theory,

    N. Ay, D. Polani, and N. Virgo, “Information decomposition based on cooperative game theory,”Kybernetika, vol. 56, no. 5, pp. 979–1014, 2021

    2021

  79. [87]

    An operational information decomposition via synergistic disclosure,

    F. E. Rosas, P. A. Mediano, B. Rassouli, and A. B. Barrett, “An operational information decomposition via synergistic disclosure,”Journal of Physics A: Mathematical and Theoretical, vol. 53, no. 48, p. 485001, 2020

    2020

  80. [88]

    A scalable synergy-first backbone decomposition of higher-order structures in complex systems,

    T. F. Varley, “A scalable synergy-first backbone decomposition of higher-order structures in complex systems,” npj Complexity, vol. 1, no. 1, p. 9, 2024

    2024

  81. [89]

    Synergy and redundancy in dual decompositions of mutual information gain and information loss,

    D. Chicharro and S. Panzeri, “Synergy and redundancy in dual decompositions of mutual information gain and information loss,”Entropy, vol. 19, no. 2, p. 71, 2017

    2017

  82. [90]

    Invariant components of synergy, redundancy, and unique information among three variables,

    G. Pica, E. Piasini, D. Chicharro, and S. Panzeri, “Invariant components of synergy, redundancy, and unique information among three variables,”Entropy, vol. 19, no. 9, p. 451, 2017

    2017

  83. [91]

    Hierarchical quantification of synergy in channels,

    P. Perrone and N. Ay, “Hierarchical quantification of synergy in channels,”Frontiers in Robotics and AI, vol. 2, p. 35, 2016

    2016

  84. [92]

    The whole is less than the sum of parts: Subsystem inconsistency in partial information decomposition,

    A. Lyu, A. Clark, and N. Raviv, “The whole is less than the sum of parts: Subsystem inconsistency in partial information decomposition,”arXiv preprint arXiv:2510.14864, 2025. 63

    2025

  85. [93]

    Toward a unified taxonomy of information dynamics via integrated information decomposition,

    P. A. Mediano, F. E. Rosas, A. I. Luppi, R. L. Carhart-Harris, D. Bor, A. K. Seth, and A. B. Barrett, “Toward a unified taxonomy of information dynamics via integrated information decomposition,”Proceedings of the National Academy of Sciences, vol. 122, no. 39, p. e2423297122, 2025

    2025

  86. [94]

    The partial entropy decomposition: Decomposing multivariate entropy and mutual information via pointwise common surprisal,

    R. A. Ince, “The partial entropy decomposition: Decomposing multivariate entropy and mutual information via pointwise common surprisal,”arXiv preprint arXiv:1702.01591, 2017

    2017 arXiv

  87. [95]

    Generalized decomposition of multivariate information,

    T. F. Varley, “Generalized decomposition of multivariate information,”Plos one, vol. 19, no. 2, p. e0297128, 2024

    2024

  88. [96]

    Quantifying synergistic information using intermediate stochastic variables,

    R. Quax, O. Har-Shemesh, and P. M. Sloot, “Quantifying synergistic information using intermediate stochastic variables,”Entropy, vol. 19, no. 2, p. 85, 2017

    2017

  89. [97]

    Information decomposition and synergy,

    E. Olbrich, N. Bertschinger, and J. Rauh, “Information decomposition and synergy,”Entropy, vol. 17, no. 5, pp. 3501–3517, 2015

    2015

  90. [98]

    Quantifying high-order interdependencies via multivariate extensions of the mutual information,

    F. E. Rosas, P. A. Mediano, M. Gastpar, and H. J. Jensen, “Quantifying high-order interdependencies via multivariate extensions of the mutual information,”Physical Review E, vol. 100, no. 3, p. 032305, 2019

    2019

  91. [99]

    Group redundancy measures reveal redundancy reduction in the auditory pathway,

    G. Chechik, A. Globerson, M. Anderson, E. Young, I. Nelken, and N. Tishby, “Group redundancy measures reveal redundancy reduction in the auditory pathway,”Advances in neural information processing systems, vol. 14, 2001

    2001

  92. [100]

    The co-information lattice,

    A. J. Bell, “The co-information lattice,” inProceedings of the fifth international workshop on independent component analysis and blind signal separation: ICA, vol. 2003, 2003

    2003

  93. [101]

    Discovering higher-order interactions through neural information decomposition,

    K. Reing, G. Ver Steeg, and A. Galstyan, “Discovering higher-order interactions through neural information decomposition,”Entropy, vol. 23, no. 1, p. 79, 2021

    2021

  94. [102]

    Network information and connected correlations,

    E. Schneidman, S. Still, M. J. Berry, and W. Bialek, “Network information and connected correlations,” Physical review letters, vol. 91, no. 23, p. 238701, 2003

    2003

  95. [103]

    Synergy, redundancy, and independence in population codes,

    E. Schneidman, W. Bialek, and M. J. Berry, “Synergy, redundancy, and independence in population codes,” Journal of Neuroscience, vol. 23, no. 37, pp. 11539–11553, 2003

    2003

  96. [104]

    Weak pairwise correlations imply strongly correlated network states in a neural population,

    E. Schneidman, M. J. Berry, R. Segev, and W. Bialek, “Weak pairwise correlations imply strongly correlated network states in a neural population,”Nature, vol. 440, no. 7087, pp. 1007–1012, 2006

    2006

  97. [105]

    Understanding interdependency through complex information sharing,

    F. Rosas, V. Ntranos, C. J. Ellison, S. Pollin, and M. Verhelst, “Understanding interdependency through complex information sharing,”Entropy, vol. 18, no. 2, p. 38, 2016

    2016

  98. [106]

    Shannon invariants: A scalable approach to information decomposition,

    A. J. Gutknecht, F. E. Rosas, D. A. Ehrlich, A. Makkeh, P. A. M. Mediano, and M. Wibral, “Shannon invariants: A scalable approach to information decomposition,”arXiv preprint arXiv:2504.15779, 2025

    2025 arXiv

  99. [107]

    A logarithmic decomposition and a signed measure space for entropy,

    K. J. A. Down and P. A. M. Mediano, “A logarithmic decomposition and a signed measure space for entropy,” IEEE Transactions on Information Theory, vol. 72, no. 1, pp. 17–41, 2026

    2026

  100. [108]

    Algebraic representations of entropy and fixed-sign information quantities,

    K. J. Down and P. A. Mediano, “Algebraic representations of entropy and fixed-sign information quantities,” Entropy, vol. 27, no. 2, p. 151, 2025

    2025

  101. [109]

    On a connection between information and group lattices,

    H. Li and E. K. Chong, “On a connection between information and group lattices,”Entropy, vol. 13, no. 3, pp. 683–708, 2011

    2011

  102. [110]

    The lattice theory of information,

    C. Shannon, “The lattice theory of information,”Transactions of the IRE professional Group on Information Theory, vol. 1, no. 1, pp. 105–107, 1953

    1953

  103. [111]

    Common information is far less than mutual information.,

    P. G´ acs, J. Korner,et al., “Common information is far less than mutual information.,”Problems of Control and Information Theory, vol. 2, pp. 149–162, 1973. 64

    1973

  104. [112]

    Agreeing to disagree,

    R. J. Aumann, “Agreeing to disagree,”Readings in Formal Epistemology, pp. 859–862, 2016

    2016

  105. [113]

    Torgersen,Comparison of statistical experiments, vol

    E. Torgersen,Comparison of statistical experiments, vol. 36. Cambridge University Press, 1991

    1991

  106. [114]

    Coarse-graining and the blackwell order,

    J. Rauh, P. K. Banerjee, E. Olbrich, J. Jost, N. Bertschinger, and D. Wolpert, “Coarse-graining and the blackwell order,”Entropy, vol. 19, no. 10, p. 527, 2017

    2017

  107. [115]

    Multivariate information transmission,

    W. McGill, “Multivariate information transmission,”Transactions of the IRE Professional Group on Infor- mation Theory, vol. 4, no. 4, pp. 93–111, 1954

    1954

  108. [116]

    A new outlook on shannon’s information measures,

    R. W. Yeung, “A new outlook on shannon’s information measures,”IEEE transactions on information theory, vol. 37, no. 3, pp. 466–474, 1991

    1991

  109. [117]

    A decomposition theorem for partially ordered sets,

    R. P. Dilworth, “A decomposition theorem for partially ordered sets,” inThe Dilworth Theorems: Selected Papers of Robert P. Dilworth, pp. 7–12, Springer, 1990

    1990

  110. [118]

    Multivariate granger causality and generalized variance,

    A. B. Barrett, L. Barnett, and A. K. Seth, “Multivariate granger causality and generalized variance,”Physical Review E, vol. 81, no. 4, p. 041907, 2010

    2010

  111. [119]

    The blackwell relation defines no lattice,

    N. Bertschinger and J. Rauh, “The blackwell relation defines no lattice,” in2014 IEEE International Sympo- sium on Information Theory, pp. 2479–2483, IEEE, 2014

    2014

  112. [120]

    Zero-error information and applications in cryptography,

    S. Wolf and J. Wultschleger, “Zero-error information and applications in cryptography,” inInformation Theory Workshop, pp. 1–6, IEEE, 2004

    2004

  113. [121]

    Zonohedra and zonotopes,

    D. Eppstein, “Zonohedra and zonotopes,” 1995

    1995

  114. [122]

    Pearl,Causality

    J. Pearl,Causality. Cambridge University Press, 2009

    2009

  115. [123]

    Properties of unique information,

    J. Rauh, M. Sch¨ unemann, and J. Jost, “Properties of unique information,”Kybernetika, vol. 57, no. 3, pp. 383–403, 2021

    2021

  116. [124]

    P. L. Williams,Information dynamics: Its theory and application to embodied cognitive systems. PhD thesis, Indiana University, 2011. 65

    2011

Pith tools

Reviewed August 2, 2026 · model on record in the stance chip above.