Issues with bazel build

When I run bazel build on a isaac on a Nvidia Jetson TX2 it promts me an error that memory is exhausted. Bazel build seems to download cuda10.2 and cudnn8, but cuda 10.2 and cudnn8 already exists on the machine. Is there anyway to make ISAAC use the cuda and cudnn available on the jetson? Instead of downloading and caching it.