REVIEW 1 cited by
Teaching the Pre-trained Model to Generate Simple Texts for Text Simplification
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Randomly masking text spans in ordinary texts in the pre-training stage hardly allows models to acquire the ability to generate simple texts. It can hurt the performance of pre-trained models on text simplification tasks. In this paper, we propose a new continued pre-training strategy to teach the pre-trained model to generate simple texts. We continue pre-training BART, a representative model, to obtain SimpleBART. It consistently and significantly improves the results on lexical simplification, sentence simplification, and document-level simplification tasks over BART. At the end, we compare SimpleBART with several representative large language models (LLMs).
Forward citations
Cited by 1 Pith paper
-
Progressive Document-level Text Simplification via Large Language Models
A three-stage hierarchical LLM pipeline for document simplification outperforms direct ChatGPT prompts and earlier methods on Wiki-auto and Newsela, with caveats about self-evaluation.
Discussion (0). Continue with ORCID to comment.