voidism / Insert-Delete-TextStyleTransfer

Insert/Delete-based Text Style Transfer with non-autoregressive parallel decoding

This repository hosts a small project for Text Style Transfer. We used KERMIT: Generative Insertion-Based Modeling for Sequences, an insertion-based pretrained model and fine-tune it on text style transfer corpus. This model also learns to delete attribution words (as the method proposed in Transforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfer. Full training flow is shown below:

• Training Stage
• Testing Stage

Training scripts

• comming soon