backpropagation
23 episodes mention this concept
lexfridmanSep 20, 2021Jay McClelland on Neural Networks, the Emergence of Cognition, and the Mind-Brain Connection
NeuroscienceNeural Networks (artificial and biological)Cognitive PsychologyParallel Distributed Processing (PDP)Backpropagation- lexfridmanMay 8, 2020
Ilya Sutskever on the Deep Learning Revolution, AI's Unity, and the Future of Intelligence
TechnologyDeep Learning RevolutionNeural NetworksBackpropagationHessian-free optimizer - lexfridmanApr 27, 2020
The Turing Test: Can Machines Think? A Philosophical and Engineering Deep Dive into AI
PhilosophyTuring TestImitation GameArtificial Intelligence (AI)Machine Learning - lexfridmanFeb 29, 2020
John Hopfield on the Physics of Mind, Neurobiology, and the Future of AI
ScienceAssociative neural networksHopfield networksDeep learningEvolutionary biology - lexfridmanJan 10, 2020
Deep Learning: State of the Art in 2020, Key Advancements, Limitations, and Future Research
TechnologyDeep LearningNeural NetworksPerceptron (single-layer, multi-layer)Backpropagation - lexfridmanAug 31, 2019
Yann LeCun on Deep Learning's Foundations, AI Reasoning, and Ethical Alignment
TechnologyDeep LearningConvolutional Neural Networks (ConvNets)Value MisalignmentObjective Functions - lexfridmanApr 18, 2019
Ian Goodfellow on Generative Adversarial Networks, Deep Learning Limitations, and the Future of AI Cognition
TechnologyGenerative Adversarial Networks (GANs)Deep LearningRepresentation LearningMachine Learning - lexfridmanApr 3, 2019
Greg Brockman on OpenAI, AGI, and Shaping the Future of Intelligence
TechnologyArtificial General Intelligence (AGI)Deep LearningReinforcement LearningValue Alignment - lexfridmanJan 11, 2019
Deep Learning Basics: Foundations, Progress, and Future Challenges
TechnologyDeep LearningNeural NetworksOptimizationMachine Learning - lexfridmanApr 25, 2018
Ilya Sutskever on Deep Learning Foundations, Meta-Learning, and Self-Play for AGI
TechnologyDeep Learning PrinciplesGeneralization Theory (shortest program)Computational Intractability (program search)Backpropagation (circuit search) - lexfridmanSep 27, 2016
The Evolution, Architecture, and Impact of Convolutional Neural Networks in Computer Vision
TechnologyDeep LearningComputer VisionNeural NetworksConvolutional Neural Networks (CNNs) - lexfridmanSep 27, 2016
Theano: A Symbolic Expression Compiler for Deep Learning and GPU Acceleration
TechnologyTheanoSymbolic expression compilerComputation graphAutomatic differentiation - lexfridmanSep 27, 2016
Foundations of Deep Learning: Feedforward Neural Networks, Backpropagation, and Training Techniques
TechnologyFeedforward Neural NetworksInput VectorHidden LayersPre-activation - lexfridmanSep 27, 2016
Foundations of Unsupervised Deep Learning: Sparse Coding, Autoencoders, and Generative Models
TechnologyUnsupervised LearningSupervised LearningDeep LearningHierarchical Representations - lexfridman
Recurrent Neural Networks and the Fundamentals of Backpropagation for Steering Through Time
TechnologyRecurrent Neural Networks (RNNs)BackpropagationVanishing GradientsExploding Gradients - lexfridman
MIT 6.S094: Deep Learning for Self-Driving Cars - Foundations, Challenges, and Human-Centered AI
TechnologyDeep LearningSelf-Driving CarsArtificial Intelligence (AI)Reinforcement Learning - lexfridman
Deep Reinforcement Learning Fundamentals: From Perceptrons to Q-Learning for Motion Planning
TechnologyDeep Reinforcement Learning (DRL)Supervised LearningUnsupervised LearningSemi-supervised Learning - lexfridman
MIT 6.S094: Introduction to Deep Learning, Neural Networks, and Self-Driving Cars
TechnologyDeep LearningDeep Neural NetworksSelf-Driving CarsDeep Reinforcement Learning - lexfridman
Recurrent Neural Networks and the Fundamentals of Backpropagation for Steering Through Time
TechnologyRecurrent Neural Networks (RNNs)BackpropagationVanishing GradientsExploding Gradients - lexfridman
MIT AGI: Engineering Intelligence - Bridging Theory, Practice, and Societal Impact
TechnologyArtificial General Intelligence (AGI)Deep LearningReinforcement LearningComputational Cognitive Science - lexfridman
Reverse Engineering Human Intelligence for Advanced AI and AGI: A Cognitive Science Approach
ScienceArtificial General Intelligence (AGI)AI TechnologiesDeep LearningPattern Recognition - lexfridman
The Business and Philosophy of Machine Learning: Promise, Limitations, and the Quest for General Intelligence
TechnologyMachine LearningArtificial Intelligence (AI)Deep LearningSupervised Learning - lexfridman
Ray Kurzweil on the Future of Intelligence, AGI, Deep Learning, and the Hierarchical Neocortex
TechnologyArtificial General Intelligence (AGI)Deep LearningNeural NetworksLaw of Accelerating Returns
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside backpropagation across episodes.
- deep learning
- neural networks
- supervised learning
- convolutional neural networks (cnns)
- unsupervised learning
- reinforcement learning
- generative adversarial networks (gans)
- recurrent neural networks (rnns)
- artificial general intelligence (agi)
- turing test
- artificial intelligence (ai)
- gradient descent
- representation learning
- perceptron
- machine learning
- symbolic ai
- semi-supervised learning
- loss function
- pattern recognition
- natural language processing (nlp)