How AI Models Scale Beyond a Single GPU Across LLM Workloads
IBM Technology · 9:04
Frontier models with over a trillion parameters (about 2 TB of weights) don't fit on the largest single GPU (about 288 GB). They are served with distributed inference, which layers several parallelism techniques to ha...