torch.cuda.memory_usage

torch.cuda.memory_usage(device=None)

Returns the percent of time over the past sample period during which global (device) memory was being read or written. as given by nvidia-smi.

Parameters

device (torch.device or int, optional) – selected device. Returns statistic for the current device, given by current_device(), if device is None (default).

Warning: Each sample period may be between 1 second and 1/6 second, depending on the product being queried.