REVIEW 9 cited by
The Consciousness Prior
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
A new prior is proposed for learning representations of high-level concepts of the kind we manipulate with language. This prior can be combined with other priors in order to help disentangling abstract factors from each other. It is inspired by cognitive neuroscience theories of consciousness, seen as a bottleneck through which just a few elements, after having been selected by attention from a broader pool, are then broadcast and condition further processing, both in perception and decision-making. The set of recently selected elements one becomes aware of is seen as forming a low-dimensional conscious state. This conscious state is combining the few concepts constituting a conscious thought, i.e., what one is immediately conscious of at a particular moment. We claim that this architectural and information-processing constraint corresponds to assumptions about the joint distribution between high-level concepts. To the extent that these assumptions are generally true (and the form of natural language seems consistent with them), they can form a useful prior for representation learning. A low-dimensional thought or conscious state is analogous to a sentence: it involves only a few variables and yet can make a statement with very high probability of being true. This is consistent with a joint distribution (over high-level concepts) which has the form of a sparse factor graph, i.e., where the dependencies captured by each factor of the factor graph involve only very few variables while creating a strong dip in the overall energy function. The consciousness prior also makes it natural to map conscious states to natural language utterances or to express classical AI knowledge in a form similar to facts and rules, albeit capturing uncertainty as well as efficient search mechanisms implemented by attention mechanisms.
Forward citations
Cited by 9 Pith papers
-
Hidden APIs in Language Models: Discovering Reusable Causal Interfaces from Forked Futures
A Shared hidden-state interface beats Local, Mixture, and Distributed alternatives under held-out causal description length in Qwen2.5-1.5B and Llama-3-8B, with transplantation and mediation evidence of reuse.
-
Verbalizable Representations Form a Global Workspace in Language Models
Language models represent their current reasoning in a small, readable set of verbalizable vectors (the J-space) that functions like a global workspace.
-
EasyLens: A Training-Free Plug-and-Play Subtle-Lesion Representation Amplifier for Medical Vision-Language Models
Prior-minimal multi-agent RL agents develop indexical encoding, persistent self-state, and an echo-mismatch self-monitoring circuit that vanishes when the echo affordance is removed during training.
-
Can "consciousness" be observed from large language model (LLM) internal states? Dissecting LLM representations obtained from Theory of Mind test with Integrated Information Theory and Span Representation analysis
Applying IIT 3.0/4.0 Φ estimates to LLM hidden-state sequences from Theory of Mind tests finds no robust statistical evidence of 'consciousness' phenomena, with span representations usually explaining score difference...
-
Transformers Learn Faster with Semantic Focus
Input-dependent top-k sparse attention makes small transformers converge faster and generalize as well as full attention, while input-agnostic sparsity does not, and the effect is tied to reduced dispersion of attenti...
-
Dynamical Mechanisms for Coordinating Long-term Working Memory Based on the Precision of Spike-timing in Cortical Neurons
Cortical traveling waves may use precise spike timing and temporary STDP to form a second network that sustains long-term working memory for hours.
-
Semantic Communication meets System 2 ML: How Abstraction, Compositionality and Emergent Languages Shape Intelligence
The paper proposes a research vision in which 6G networks and AI agents communicate through semantic abstractions composed algebraically, guided by Kahneman's System 1 versus System 2 distinction.
-
Thoughtseeds as Latent Causes: A Dual-Process Computational Phenomenology of Focused-Attention Meditation
A three-layer active-inference simulation of focused-attention meditation reproduces expert–novice differences, yet the key differences are pre-specified in hand-set priors rather than derived.
-
Bhatt Conjectures: On Necessary-But-Not-Sufficient Benchmark Tautology for Human Like Reasoning
A position paper restates known AI evaluation criteria as 'tautological' definitions of reasoning and understanding, with proposed diagnostic tests but no empirical evidence.
Discussion (0). Continue with ORCID to comment.