Suppose I explicitly want to limit my kernels to 0.5 seconds and prefer buggy runaway GPU threads result in killing the whole process. How would I reduce the OS/Driver timeout?
Running the common Jetpack install of Ubuntu on Xavier.
Suppose I explicitly want to limit my kernels to 0.5 seconds and prefer buggy runaway GPU threads result in killing the whole process. How would I reduce the OS/Driver timeout?
Running the common Jetpack install of Ubuntu on Xavier.
hello cory.bloyd,
may I know what’s the use-case, or, which application you’re running with.
thanks
I’m working on a system composed of multiple processes written by multiple teams. Each step is explicitly small and no one expects to run a single kernel for as long as an entire second. But, bugs happen. If there is a runaway loop in a kernel, we’d rather not wait 5 seconds to start over.
hello cory.bloyd,
it’s related to CUDA scheduler. I’m afraid you cannot adjust timeout values, kernelExecTimeout
.
you may have implementation to terminate your process while there’s a failure,
thanks
Hi, cory.bloyd
Do you find a way to solve this problem?
If not, could you file a new topic with a source code to reproduce the long kernel execution time issue?
Thanks.