Split Single GPU - PyTorch Forums
discuss.pytorch.org › t › split-single-gpuMay 25, 2018 · Is there any way to split single GPU and use a single GPU as multiple GPUs? For example, we have 2 different ResNet18 model and we want to forward pass these two models in parallel just in one GPU (with enough memory, e.g., 12Gb). I mean that the forward pass of these two models runs in parallel and concurrent in just one GPU.
torch.split — PyTorch 1.10.1 documentation
pytorch.org › docs › stabletorch.split — PyTorch 1.10.0 documentation torch.split torch.split(tensor, split_size_or_sections, dim=0) [source] Splits the tensor into chunks. Each chunk is a view of the original tensor. If split_size_or_sections is an integer type, then tensor will be split into equally sized chunks (if possible).