On the importance of initialization and momentum in deep learning
← Back to topic
Authors: Ilya Sutskever, James Martens, George Dahl, Geoffrey Hinton
Year: 2014
Journal: NeurIPS
DOI: 10.48550/arXiv.1206.6486
Publisher: https://arxiv.org/abs/1206.6486
Keywords: momentum, sgd
Abstract
We investigate the role of momentum and initialization in deep learning.
Cite this paper
bibtex
@misc{sgdmomentum2014,
title = {On the importance of initialization and momentum in deep learning},
author = {Ilya Sutskever, James Martens, George Dahl, Geoffrey Hinton},
year = {2014},
journal = {NeurIPS},
doi = {10.48550/arXiv.1206.6486},
url = {https://doi.org/10.48550/arXiv.1206.6486},
}