mixture of experts (moe)
3 episodes mention this concept
lexfridmanMar 23, 2026Jensen Huang on NVIDIA's Extreme Co-Design, AI Scaling Laws, and Manifesting the Future of Computing
TechnologyExtreme Co-designRack-scale designAmdahl's LawDistributed Computing- lexfridmanFeb 3, 2025
DeepSeek, OpenAI, and the Geopolitics of AI: A Technical Dive into Open Weights, Reasoning Models, and Efficiency
TechnologyMixture of Experts (MoE)Open WeightsChain of Thought ReasoningPre-training - lexfridmanOct 6, 2024
AI-Assisted Coding: The Cursor Team on Rethinking the Code Editor and the Future of Programming
TechnologyCode editorAI-assisted codingHuman-AI collaborationVS Code
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside mixture of experts (moe) across episodes.
- synthetic data
- fp32 (ieee-compatible)
- rack-scale design
- open weights
- autor-regressive prediction
- pre-training scaling law
- amdahl's law
- parameter efficiency
- transformer architecture
- dennard scaling
- floating point operations (flops)
- digital worker metaphor
- reward models
- reinforcement learning from human feedback (rlhf)
- ai megaclusters
- dense model
- neural network
- agentic scaling law
- multi-layer attention (mla)
- cuda layer