next token prediction
2 episodes mention this concept
lexfridmanFeb 3, 2025DeepSeek, OpenAI, and the Geopolitics of AI: A Technical Dive into Open Weights, Reasoning Models, and Efficiency
TechnologyMixture of Experts (MoE)Open WeightsChain of Thought ReasoningPre-training- lexfridmanJun 22, 2023
Marc Andreessen on the Future of AI, Search, Content, and Truth in the Digital Age
TechnologyAI assistantsNatural language interface10 Blue LinksSemantic web
Knowledge Graph
Related concepts — line thickness indicates connection strength. Click any node to explore.
Related concepts
Concepts that appear alongside next token prediction across episodes.
- neural network
- dense model
- reinforcement learning from human feedback (rlhf)
- ai megaclusters
- open weights
- 10 blue links
- autor-regressive prediction
- parameter efficiency
- transformer architecture
- hallucination (ai)
- de-biasing (ai)
- compressed representation
- floating point operations (flops)
- reward models
- jailbreak (llms)
- mixture of experts (moe)
- sentiment analysis
- synthetic data
- cuda layer
- self-play (ai)