In Seq$2$SeqTransformer network used for machine translation implement encoder and decoder yourself instead of using Pytorch transformer module. Use the encoder model for reversing sequences and decoder model for name generation. Combine two modules under custom transformer module and use that.