Setting `persistent_workers=True` when creating DataLoader removes a significant overhead at the start of each epoch and validation.
Setting `persistent_workers=True` when creating DataLoader removes a significant overhead at the start of each epoch and validation.