automatic differentiation
3 episodes mention this concept
lexfridmanSep 27, 2016Foundations of Deep Learning: Feedforward Neural Networks, Backpropagation, and Training Techniques
TechnologyFeedforward Neural NetworksInput VectorHidden LayersPre-activation- lexfridmanSep 27, 2016
Theano: A Symbolic Expression Compiler for Deep Learning and GPU Acceleration
TechnologyTheanoSymbolic expression compilerComputation graphAutomatic differentiation - lexfridmanSep 27, 2016
Demystifying Deep Learning: A Practical and Conceptual Dive into Torch and Automatic Differentiation
TechnologyMachine LearningDeep Learning LibrariesTorch (programming framework)Lua (programming language)
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside automatic differentiation across episodes.
- backpropagation
- directed acyclic graph (dag)
- model parallelism
- l2 regularization (weight decay)
- graph optimization
- tensorflow (for comparison)
- shared variables
- numerical stability
- theano
- pymc3 (probabilistic programming)
- input vector
- element-wise operations
- cross-entropy loss
- gradient descent
- softmax function
- max pooling
- long short-term memory (lstm)
- classification
- flow graph
- in-place operations