Why not employ asynchronous techniques in deep learning models?

AI & Data Science Deep Learning (Training & Inference) cuDNN
1

I executed nsight system for a PyTorch CNN (such as invoking a model like ResNet) and observed the absence of asynchronous usage in their code. Is this omission relevant to the model’s robustness?