local minima
2 episodes mention this concept
lexfridmanSep 27, 2016Foundations and Challenges of Deep Learning: Compositionality, Generalization, and Optimization
TechnologyCurse of dimensionalityCompositional modelsDistributed representationsDepth (neural networks)- lexfridman
Recurrent Neural Networks and the Fundamentals of Backpropagation for Steering Through Time
TechnologyRecurrent Neural Networks (RNNs)BackpropagationVanishing GradientsExploding Gradients
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside local minima across episodes.
- recurrent neural networks (rnns)
- saddle points
- stochastic gradient descent (sgd)
- long-term dependencies
- distributed representations
- convolutional neural networks (cnns)
- variational autoencoders (vaes)
- long-term dependency problem
- gradient descent
- generative adversarial networks (gans)
- high-dimensional optimization landscape
- curse of dimensionality
- loss function (objective function, cost function)
- attention mechanisms
- deep reinforcement learning
- skip connections
- vanilla neural networks
- extrapolation
- vanishing gradients
- compositional models