ImportError: cannot import name 'is_compiling' from 'torch._dynamo'

After installing, pytorch and torchvision as described in here, I installed detectron2 as python -m pip install 'git+https://github.com/facebookresearch/detectron2.git'. All of this produced no errors. But only when I run the inference, the error appears. The full error msg is as follows

Traceback (most recent call last):
  File "/home/theia/Ash/repos/detectron2_on_kitti/inference.py", line 21, in <module>
    outputs = predictor(im)  # format is documented at https://detectron2.readthedocs.io/tutorials/models.html#model-output-format
  File "/home/theia/.local/lib/python3.8/site-packages/detectron2/engine/defaults.py", line 317, in __call__
    predictions = self.model([inputs])[0]
  File "/home/theia/anaconda3/envs/vision/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1480, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/theia/.local/lib/python3.8/site-packages/detectron2/modeling/meta_arch/rcnn.py", line 150, in forward
    return self.inference(batched_inputs)
  File "/home/theia/.local/lib/python3.8/site-packages/detectron2/modeling/meta_arch/rcnn.py", line 204, in inference
    features = self.backbone(images.tensor)
  File "/home/theia/anaconda3/envs/vision/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1480, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/theia/.local/lib/python3.8/site-packages/detectron2/modeling/backbone/fpn.py", line 139, in forward
    bottom_up_features = self.bottom_up(x)
  File "/home/theia/anaconda3/envs/vision/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1480, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/theia/.local/lib/python3.8/site-packages/detectron2/modeling/backbone/resnet.py", line 445, in forward
    x = self.stem(x)
  File "/home/theia/anaconda3/envs/vision/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1480, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/theia/.local/lib/python3.8/site-packages/detectron2/modeling/backbone/resnet.py", line 356, in forward
    x = self.conv1(x)
  File "/home/theia/anaconda3/envs/vision/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1480, in _call_impl
    return forward_call(*args, **kwargs)
  File "/home/theia/.local/lib/python3.8/site-packages/detectron2/layers/wrappers.py", line 118, in forward
    is_dynamo_compiling = check_if_dynamo_compiling()
  File "/home/theia/.local/lib/python3.8/site-packages/detectron2/layers/wrappers.py", line 43, in check_if_dynamo_compiling
    from torch._dynamo import is_compiling
ImportError: cannot import name 'is_compiling' from 'torch._dynamo' (/home/theia/anaconda3/envs/vision/lib/python3.8/site-packages/torch/_dynamo/__init__.py)

Process finished with exit code 1

Interestingly it appears only in my jetson agx orin using conda. In my laptop, if I install pytorch and torchvision in a conda environment, it doesnt come up