Practice
Learn
← Quit
0 / 0 correct
LLMs & AI
Hard
1 of 10
Data, tensor and pipeline parallelism: which is accurate?
A
Pipeline parallelism replicates the model
B
They all split the batch
C
Data parallel splits batches; tensor parallel splits individual matrix operations across GPUs; pipeline parallel splits layers into stages
D
Tensor parallelism splits the dataset