Adversarial Vulnerabilities of Human Decision-making
On 17 Feb, 2021 By admin 0 Comments
November, 2020
Abstract
Recurrent Neural Networks
BlackOut: Speeding up Recurrent Neural Network Language Models With Very Large Vocabularies
On 5 Mar, 2017 By admin 0 Comments
Shihao Ji, S. V. N. Vishwanathan, Nadathur Satish, Michael J. Anderson, Pradeep Dubey
Mar 2016
Abstract:
Regularizing RNNs by Stabilizing Activations
On 5 Mar, 2017 By admin 0 Comments
David Krueger, Roland Memisevic
Apr 2016
Abstract:
Tuning Recurrent Neural Networks with Reinforcement Learning
On 1 Dec, 2016 By admin 0 Comments
Natasha Jaques, Shixiang Gu, Richard E. Turner, Douglas Eck
November 2016
Abstract:
On Multiplicative Integration with Recurrent Neural Networks
On 20 Oct, 2016 By admin 0 Comments
Yuhuai Wu, Saizheng Zhang, Ying Zhang, Yoshua Bengio, Ruslan Salakhutdinov
(Submitted on 21 Jun 2016)
Abstract:
Path-Normalized Optimization of Recurrent Neural Networks with ReLU Activations
On 20 Oct, 2016 By admin 0 Comments
Behnam Neyshabur, Yuhuai Wu, Ruslan Salakhutdinov, Nathan Srebro
May, 2016
Abstract:
We investigate the parameter-space geometry of recurrent neural networks (RNNs), and develop an adaptation of path-SGD optimization method, attuned to this geometry, that can learn plain RNNs with ReLU activations. On several datasets that require capturing long-term dependency structure, we show that path-SGD can significantly improve trainability of ReLU RNNs compared to RNNs trained with SGD, even with various recently suggested initialization schemes.
Recurrent Batch Normalization
On 30 Mar, 2016 By admin 0 Comments
Algorithmic Music Generation with Recurrent Neural Networks
On 16 Jan, 2016 By admin 0 Comments
Generating Text with Recurrent Neural Networks
On 12 Dec, 2015 By admin 0 Comments
Generating Sequences With Recurrent Neural Networks
On 10 Sep, 2015 By admin 0 Comments