Try

Different number of words.

Different number of hidden layers.

Layers with more hidden units or fewer hidden units.

The mse loss function instead of crossentropy.

The tanh activation $($an activation that was popular in the early days of neural

networks$)$ instead of relu.

Do these experiments on the MNIST, IMDB, and Reuters datasets.

Send the scientific report $($code snippets, plots, results, discussion$)$ to