model and data parallelism

1 episode mention this concept

Related concepts — line thickness indicates connection strength. Click any node to explore.

Related concepts

Concepts that appear alongside model and data parallelism across episodes.

• backpropagation
• neural networks
• graph representation
• convolutional neural networks (cnns)
• natural language processing (nlp)
• open domain conversation
• common sense reasoning
• generative adversarial networks (gans)
• recurrent neural networks (rnns)
• turing test
• perceptron (single-layer, multi-layer)
• self-play
• abstract syntax tree (ast) based summarization
• credit assignment problem
• reinforcement learning (rl) / deep reinforcement learning (drl)
• transformers (bert, xlnet, albert, gpt-2, megatron lm)
• eager execution
• algorithmic ethics (fairness, privacy, bias)
• multimodal/multitask learning
• alexa prize