cross-entropy loss
2 episodes mention this concept
lexfridmanJun 29, 2023George Hotz on AI, Consciousness, the Future of Humanity, and the Biological vs. Silicon Stacks of Life
TechnologyWireheadingComputational complexity (P vs NP)Large Language Models (LLMs)Reinforcement Learning with Human Feedback (RLHF)
lexfridmanSep 27, 2016Theano: A Symbolic Expression Compiler for Deep Learning and GPU Acceleration
TechnologyTheanoSymbolic expression compilerComputation graphAutomatic differentiation
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside cross-entropy loss across episodes.
- in-place operations
- directed acyclic graph (dag)
- softmax function
- graph optimization
- virtual reality
- tensorflow (for comparison)
- shared variables
- digital fabrication (fab)
- numerical stability
- theano
- pymc3 (probabilistic programming)
- element-wise operations
- gradient descent
- model parallelism
- max pooling
- anthropocentrism
- silicon stack
- long short-term memory (lstm)
- refactoring code
- backpropagation