A Survey of Non-English Parallel Corpora for Text Simplification
Author(s)
Ryan, Michael
Advisor(s)
Editor(s)
Collections
Supplementary to:
Permanent Link
Abstract
Recent advancements in high-quality, large-scale English resources have pushed the frontier of English Automatic Text Simplification (ATS) research. However, less work has been done on multilingual text simplification due to the lack of a diverse evaluation benchmark that covers complex-simple sentence pairs in many languages. This thesis performs a comprehensive survey of 27 resources in 12 distinct languages spanning over 1.7 million complex-simple sentence pairs. My experiments and analysis of these datasets with pre-trained multilingual language models reveal exciting performance improvements from multilingual training in non-English settings. I observe strong performance from Russian in zero-shot cross-lingual transfer to low-resource languages. I further show that few-shot prompting with BLOOM-176b achieves comparable quality to reference simplifications outperforming fine-tuned models in most languages.
Sponsor
Date
Extent
Resource Type
Text
Resource Subtype
Undergraduate Research Option Thesis