adam optimizer
2 episodes mention this concept
lexfridmanMay 8, 2020Ilya Sutskever on the Deep Learning Revolution, AI's Unity, and the Future of Intelligence
TechnologyDeep Learning RevolutionNeural NetworksBackpropagationHessian-free optimizer- lexfridmanOct 8, 2019
Optimizing Neural Network Training: Super Convergence, Learning Rates, and Academic Publishing Challenges
Technologylearning ratesuper convergenceneural networkshyper parameters
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside adam optimizer across episodes.
- neural networks
- generalization
- symbolic ai
- epochs
- deep learning
- supervised learning
- overparameterization
- regularization
- epsilon
- exploration (in rl)
- academic publishing
- spike-timing-dependent plasticity (stdp)
- backpropagation
- discriminative learning rates
- super convergence
- transformers
- imagenet benchmark
- convolutional neural networks (cnns)
- experimental science
- natural language processing (nlp)