PoeLM: A meter-and rhyme-controllable language model for unsupervised poetry generation
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Standard
PoeLM: A meter-and rhyme-controllable language model for unsupervised poetry generation. / Ormazabal, Aitor; Agirrezabal, Manex; Artetxe, Mikel; Soroa, Aitor; Agirre, Eneko.
Findings of the Association for Computational Linguistics: EMNLP 2022. ed. / Yoav Goldberg; Zornitsa Kozareva; Yue Zhang . Abu Dhabi : Association for Computational Linguistics, 2022.Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - GEN
T1 - PoeLM: A meter-and rhyme-controllable language model for unsupervised poetry generation
AU - Ormazabal, Aitor
AU - Agirrezabal, Manex
AU - Artetxe, Mikel
AU - Soroa, Aitor
AU - Agirre, Eneko
PY - 2022
Y1 - 2022
N2 - Formal verse poetry imposes strict constraints on the meter and rhyme scheme of poems. Most prior work on generating this type of poetry uses existing poems for supervision, which are difficult to obtain for most languages and poetic forms. In this work, we propose an unsupervised approach to generate poems that follow any given meter and rhyme scheme, without requiring any poetic text for training. Our method works by splitting a regular, non-poetic corpus into phrases, prepending control codes that describe the length and end rhyme of each phrase, and training a transformer language model in the augmented corpus. The transformer learns to link the structure descriptor with the control codes to the number of lines, their length and their end rhyme. During inference, we build control codes for the desired meter and rhyme scheme, and condition our language model on them to generate formal verse poetry. Experiments in Spanish and Basque show that our approach is able to generate valid poems, which are often comparable in quality to those written by humans.
AB - Formal verse poetry imposes strict constraints on the meter and rhyme scheme of poems. Most prior work on generating this type of poetry uses existing poems for supervision, which are difficult to obtain for most languages and poetic forms. In this work, we propose an unsupervised approach to generate poems that follow any given meter and rhyme scheme, without requiring any poetic text for training. Our method works by splitting a regular, non-poetic corpus into phrases, prepending control codes that describe the length and end rhyme of each phrase, and training a transformer language model in the augmented corpus. The transformer learns to link the structure descriptor with the control codes to the number of lines, their length and their end rhyme. During inference, we build control codes for the desired meter and rhyme scheme, and condition our language model on them to generate formal verse poetry. Experiments in Spanish and Basque show that our approach is able to generate valid poems, which are often comparable in quality to those written by humans.
M3 - Article in proceedings
BT - Findings of the Association for Computational Linguistics: EMNLP 2022
A2 - Goldberg, Yoav
A2 - Kozareva, Zornitsa
A2 - Zhang , Yue
PB - Association for Computational Linguistics
CY - Abu Dhabi
ER -
ID: 374968438