overparameterization
2 episodes mention this concept
lexfridmanApr 21, 2023Manolis Kellis on Human Irreplaceability, Evolutionary Layers, and AI as the Next Stage of Information Processing
ScienceAI AlignmentHuman IrreplaceabilityEvolutionary BaggageCognitive Layer- lexfridmanMay 8, 2020
Ilya Sutskever on the Deep Learning Revolution, AI's Unity, and the Future of Intelligence
TechnologyDeep Learning RevolutionNeural NetworksBackpropagationHessian-free optimizer
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside overparameterization across episodes.
- exploration (in rl)
- spike-timing-dependent plasticity (stdp)
- backpropagation
- neural networks
- transformers
- imagenet benchmark
- convolutional neural networks (cnns)
- natural language processing (nlp)
- cost function
- gradient descent
- recurrent neural networks (rnns)
- generative adversarial networks (gans)
- self-play
- reinforcement learning (rl)
- non-stationary world
- data augmentation
- deep learning revolution
- spiking neural networks
- cuda kernels
- hessian-free optimizer