반응형
Review
-
[Paper] ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text GenerationML engineer/Papers & CS generals 2023. 1. 5. 09:08
🕓 3 mins read https://arxiv.org/abs/2210.13304 ELMER: A Non-Autoregressive Pre-trained Language Model for Efficient and Effective Text Generation We study the text generation task under the approach of pre-trained language models (PLMs). Typically, an auto-regressive (AR) method is adopted for generating texts in a token-by-token manner. Despite many advantages of AR generation, it usually suffe..