Google's Neural Translation Machine Project

Read the following article:

Wu$,$ Yonghui, et al$.(2016).$ Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation.$$

Then, describe the model architecture presented in figure $1$ with some real numbers:$$

REAL NUMBERS ARE TO BE USED TO DESCRIBE THE MODEL ARCHITECTURE

$1.$ left encoder network$$

$2.$ what are the GPUs layers about: explain inputs$/$outputs

$3.$ what is Encoder LSTM layer about$$

$4.$ middle attention module$$

$5.$ right decoder network$$

$6.$ explain Softmax with example

$7.$ what is Decoder LSTM layer about$$

You will need the following articles to help you with descriptions:

Bahdanau, Dzmitry & Cho, Kyunghyun & Bengio, Y$.(2014).$Neural Machine Translation by Jointly Learning to Align and Translate. ArXiv. $1409.$

Sutskever, Ilya & Vinyals, Oriol & Le$,$ Quoc. $(2014).$Sequence to Sequence Learning with Neural Networks. Advances in Neural Information Processing Systems.