REVIEW 8 cited by
EEG2TEXT: Open Vocabulary EEG-to-Text Decoding with EEG Pre-Training and Multi-View Transformer
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Deciphering the intricacies of the human brain has captivated curiosity for centuries. Recent strides in Brain-Computer Interface (BCI) technology, particularly using motor imagery, have restored motor functions such as reaching, grasping, and walking in paralyzed individuals. However, unraveling natural language from brain signals remains a formidable challenge. Electroencephalography (EEG) is a non-invasive technique used to record electrical activity in the brain by placing electrodes on the scalp. Previous studies of EEG-to-text decoding have achieved high accuracy on small closed vocabularies, but still fall short of high accuracy when dealing with large open vocabularies. We propose a novel method, EEG2TEXT, to improve the accuracy of open vocabulary EEG-to-text decoding. Specifically, EEG2TEXT leverages EEG pre-training to enhance the learning of semantics from EEG signals and proposes a multi-view transformer to model the EEG signal processing by different spatial regions of the brain. Experiments show that EEG2TEXT has superior performance, outperforming the state-of-the-art baseline methods by a large margin of up to 5% in absolute BLEU and ROUGE scores. EEG2TEXT shows great potential for a high-performance open-vocabulary brain-to-text system to facilitate communication.
Forward citations
Cited by 8 Pith papers
-
Joint Text-Audio Alignment for EEG-to-Text Decoding in Chinese Speech Production and Perception
Joint text-audio contrastive alignment plus CTC decoding yields state-of-the-art closed-set Chinese sentence identification from scalp EEG: 82.37% top-1 on reading-aloud and 41.43% on passive-listening EEG (101 candidates).
-
EEG2TEXT-CN: An Exploratory Study of Open-Vocabulary Chinese Text-EEG Alignment via Large Language Model and Contrastive Learning on ChineseEEG
A Chinese EEG-to-text system that aligns 128-channel EEG with per-character text embeddings achieves BLEU-1 6.38% on a held-out subject, claimed as the first open-vocabulary EEG-to-Chinese decoder.
-
DynaMind: Reconstructing Dynamic Visual Scenes from EEG by Aligning Temporal Dynamics and Multimodal Semantics to Guided Diffusion
DynaMind reconstructs videos from EEG by combining region-aware semantic mapping, a temporal blueprint, and dual-guidance diffusion, outperforming EEG2Video on SEED-DV in most comparisons.
-
WorldWeaver: Generating Long-Horizon Video Worlds via Rich Perception
WorldWeaver reduces temporal drift in long-horizon video generation by jointly modeling RGB and depth perceptual conditions with segmented noise scheduling.
-
Transformer-based EEG Decoding: A Survey
A survey that classifies Transformer-based EEG decoding models into backbone, hybrid, and customized categories and reviews their applications and limitations.
-
Neuro2Semantic: A Transfer Learning Framework for Semantic Reconstruction of Continuous Language from Human Intracranial EEG
A two-stage model aligns intracranial EEG signals with text embeddings and reconstructs the semantic content of perceived speech from as little as 30 minutes of neural data.
-
Foundation Models for Cross-Domain EEG Analysis Application: A Survey
A survey that organizes EEG foundation-model research into five output-modality categories: native EEG, text, vision, audio, and multimodal fusion, with a claim to be the first such comprehensive taxonomy.
-
Large Language Models for EEG: A Comprehensive Survey and Taxonomy
A taxonomy and review of studies applying large language models to EEG signals, organized into four domains and three adaptation strategies.
Discussion (0). Continue with ORCID to comment.