James Martens
James Martens
Research Scientist, DeepMind
Verified email at google.com - Homepage
Title
Cited by
Cited by
Year
On the importance of initialization and momentum in deep learning
I Sutskever, J Martens, G Dahl, G Hinton
International conference on machine learning, 1139-1147, 2013
29472013
Generating text with recurrent neural networks
I Sutskever, J Martens, GE Hinton
ICML, 2011
12242011
Deep learning via hessian-free optimization.
J Martens
ICML 27, 735-742, 2010
8112010
Learning recurrent neural networks with hessian-free optimization
J Martens, I Sutskever
Proceedings of the 28th international conference on machine learning (ICML …, 2011
6032011
Optimizing neural networks with kronecker-factored approximate curvature
J Martens, R Grosse
International conference on machine learning, 2408-2417, 2015
3482015
Adding gradient noise improves learning for very deep networks
A Neelakantan, L Vilnis, QV Le, I Sutskever, L Kaiser, K Kurach, J Martens
arXiv preprint arXiv:1511.06807, 2015
2802015
New insights and perspectives on the natural gradient method
J Martens
arXiv preprint arXiv:1412.1193, 2014
1762014
Training deep and recurrent networks with hessian-free optimization
J Martens, I Sutskever
Neural networks: Tricks of the trade, 479-535, 2012
1542012
The mechanics of n-player differentiable games
D Balduzzi, S Racaniere, J Martens, J Foerster, K Tuyls, T Graepel
arXiv preprint arXiv:1802.05642, 2018
1142018
A kronecker-factored approximate fisher matrix for convolution layers
R Grosse, J Martens
International Conference on Machine Learning, 573-582, 2016
1062016
On the representational efficiency of restricted boltzmann machines
J Martens, A Chattopadhya, T Pitassi, R Zemel
Advances in Neural Information Processing Systems, 2877-2885, 2013
592013
On the expressive efficiency of sum product networks
J Martens, V Medabalimi
arXiv preprint arXiv:1411.7717, 2014
472014
Adversarial robustness through local linearization
C Qin, J Martens, S Gowal, D Krishnan, K Dvijotham, A Fawzi, S De, ...
Advances in Neural Information Processing Systems, 13847-13856, 2019
422019
Estimating the hessian by back-propagating curvature
J Martens, I Sutskever, K Swersky
arXiv preprint arXiv:1206.6464, 2012
422012
Distributed second-order optimization using Kronecker-factored approximations
J Ba, R Grosse, J Martens
402016
Second-order optimization for neural networks
J Martens
University of Toronto (Canada), 2016
312016
Fast convergence of natural gradient descent for over-parameterized neural networks
G Zhang, J Martens, RB Grosse
Advances in Neural Information Processing Systems, 8082-8093, 2019
232019
Parallelizable sampling of markov random fields
J Martens, I Sutskever
Proceedings of the Thirteenth International Conference on Artificial …, 2010
212010
Which algorithmic choices matter at which batch sizes? insights from a noisy quadratic model
G Zhang, L Li, Z Nado, J Martens, S Sachdeva, G Dahl, C Shallue, ...
Advances in Neural Information Processing Systems, 8196-8207, 2019
192019
Learning the Linear Dynamical System with ASOS.
J Martens
ICML, 743-750, 2010
192010
The system can't perform the operation now. Try again later.
Articles 1–20