Training Recurrent Networks by Evolino
Jürgen Schmidhuber, Daan Wierstra, Matteo Gagliolo, et al.
Evolino combines evolution of recurrent neural network hidden weights with linear output weight computation, enabling LSTM to solve tasks where gradient methods fail.