Pytorch并行计算：nn.parallel.replicate, scatter, gather, parallel_apply

import torch import torch.nn as nn import ipdb class DataParallelModel(nn.Module): def __init__(self): super().__init__() self.block1 = nn.Linear(10, 20) def forward(self, x): x = self.block1(x) retur

>>阅读原文<<