nv decoder panic

Hi:
The NV decoder Crashed when starts and stops about 100 times, My SDK version is R28.2.1

kernel panic log as follow, had any advise?
[13624.438696] falcon 15340000.vic: nvhost_ioctl_channel_submit: failed with err -12

[13624.447912] falcon 15340000.vic: nvhost_ioctl_channel_submit: failed with err -22

[13624.458730] nvdec 15480000.nvdec: nvhost_ioctl_channel_submit: failed with err -12

[13624.471562] nvdec 15480000.nvdec: nvhost_ioctl_channel_submit: failed with err -22

[13624.484249] nvdec 15480000.nvdec: nvhost_ioctl_channel_submit: failed with err -12

[13624.495465] nvdec 15480000.nvdec: nvhost_ioctl_channel_submit: failed with err -22

[13625.090081] pll_a_out0 = 49152000 Hz, aud_mclk = 12288000 Hz, codec rate = 48000 Hz
[13674.726556] pll_a_out0 = 49152000 Hz, aud_mclk = 12288000 Hz, codec rate = 48000 Hz
[13675.787715] pll_a_out0 = 49152000 Hz, aud_mclk = 12288000 Hz, codec rate = 48000 Hz
[13676.846507] pll_a_out0 = 49152000 Hz, aud_mclk = 12288000 Hz, codec rate = 48000 Hz
[13679.578493] pll_a_out0 = 49152000 Hz, aud_mclk = 12288000 Hz, codec rate = 48000 Hz
[13683.005810] pll_a_out0 = 49152000 Hz, aud_mclk = 12288000 Hz, codec rate = 48000 Hz
[13684.318668] falcon 15340000.vic: nvhost_ioctl_channel_submit: failed with err -12

[13684.327995] falcon 15340000.vic: nvhost_ioctl_channel_submit: failed with err -22

[13684.360995] falcon 15340000.vic: nvhost_ioctl_channel_submit: failed with err -12

[13684.370154] falcon 15340000.vic: nvhost_ioctl_channel_submit: failed with err -22

[13684.380241] falcon 154c0000.nvenc: nvhost_ioctl_channel_submit: failed with err -12

[13684.392556] falcon 154c0000.nvenc: nvhost_ioctl_channel_submit: failed with err -22

[13684.425206] nvdec 15480000.nvdec: nvhost_ioctl_channel_submit: failed with err -12

[13684.437289] nvdec 15480000.nvdec: nvhost_ioctl_channel_submit: failed with err -22

Hi,
We need to reproduce the issue on r28.2.1 first. Please share steps.

Hi luopinjing,

Is this still an issue or you have resolved the problem?

Thanks

Hi,
The issue is still exist.In my case, We have create eghit nv decoder instance for reciver H264 encode stream from eight usb camera. We will exist decoder tasks when taking picture. the decoder panic occured when decoder task exit.Can we just pause decoder when stream is off

Please share test code so that we can build, run and reproduce the issue.

Hi:
My code was running in my product, will not running normal left my special machine, may i share you the key code?

Hi,
If you have debugged and confirmed it is an issue in NVIDIA release, we need you to make a patch on existing samples. If you use tegra_multimedia_api, please make a patch on 00_video_decode.

We don’t suggest you give us your full code because we don’t have resource to check the code line by line. It is more efficient for both sides to give patch on existing samples.

Hi,
the issue still in my case, detail info as follow:

[ 3166.346298] rt5639 1-001c: addr=0x1d val=0x4040
[ 3167.958327] xhci-tegra 3530000.xhci: tegra_xhci_mbox_work mailbox command 5
[ 3167.965321] xhci-tegra 3530000.xhci: tegra_xhci_mbox_work ignore firmware MBOX_CMD_DEC_SSPI_CLOCK request
[ 3178.124456] gk20a 17000000.gp10b: railgate is disabled.
[ 3178.320000] CPU1: Booted secondary processor [4e0f0030]
[ 3178.348019] CPU2: Booted secondary processor [4e0f0030]
[ 3178.435520] gk20a 17000000.gp10b: railgate is disabled.
[ 3182.278225] xhci-tegra 3530000.xhci: tegra_xhci_mbox_work mailbox command 4
[ 3182.285206] xhci-tegra 3530000.xhci: tegra_xhci_mbox_work ignore firmware MBOX_CMD_INC_SSPI_CLOCK request
[ 3182.514037] usb 2-3.2: new SuperSpeed USB device number 64 using xhci-tegra
[ 3182.534763] usb 2-3.2: New USB device found, idVendor=4255, idProduct=0008
[ 3182.541661] usb 2-3.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3182.549249] usb 2-3.2: Product: Titan Simple Class
[ 3182.554124] usb 2-3.2: Manufacturer: Insta360
[ 3182.558539] usb 2-3.2: SerialNumber: 0001
[ 3182.563455] xhci-tegra 3530000.xhci: tegra_xhci_mbox_work mailbox command 6
[ 3182.634049] usb 2-2.3: new SuperSpeed USB device number 65 using xhci-tegra
[ 3182.654694] usb 2-2.3: New USB device found, idVendor=4255, idProduct=0003
[ 3182.661639] usb 2-2.3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3182.669115] usb 2-2.3: Product: Titan Simple Class
[ 3182.674010] usb 2-2.3: Manufacturer: Insta360
[ 3182.678512] usb 2-2.3: SerialNumber: 0001
[ 3182.738046] usb 2-3.3: new SuperSpeed USB device number 66 using xhci-tegra
[ 3182.758723] usb 2-3.3: New USB device found, idVendor=4255, idProduct=0007
[ 3182.765617] usb 2-3.3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3182.772983] usb 2-3.3: Product: Titan Simple Class
[ 3182.777841] usb 2-3.3: Manufacturer: Insta360
[ 3182.782252] usb 2-3.3: SerialNumber: 0001
[ 3182.842016] usb 2-2.4: new SuperSpeed USB device number 67 using xhci-tegra
[ 3182.862644] usb 2-2.4: New USB device found, idVendor=4255, idProduct=0002
[ 3182.869590] usb 2-2.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3182.877082] usb 2-2.4: Product: Titan Simple Class
[ 3182.882029] usb 2-2.4: Manufacturer: Insta360
[ 3182.886415] usb 2-2.4: SerialNumber: 0001
[ 3182.986073] usb 2-3.4: new SuperSpeed USB device number 68 using xhci-tegra
[ 3183.006688] usb 2-3.4: New USB device found, idVendor=4255, idProduct=0006
[ 3183.013632] usb 2-3.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3183.021172] usb 2-3.4: Product: Titan Simple Class
[ 3183.026079] usb 2-3.4: Manufacturer: Insta360
[ 3183.030549] usb 2-3.4: SerialNumber: 0001
[ 3183.106017] usb 2-2.1: new SuperSpeed USB device number 69 using xhci-tegra
[ 3183.126679] usb 2-2.1: New USB device found, idVendor=4255, idProduct=0005
[ 3183.133584] usb 2-2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3183.140958] usb 2-2.1: Product: Titan Simple Class
[ 3183.145785] usb 2-2.1: Manufacturer: Insta360
[ 3183.150172] usb 2-2.1: SerialNumber: 0001
[ 3183.242018] usb 2-3.1: new SuperSpeed USB device number 70 using xhci-tegra
[ 3183.262688] usb 2-3.1: New USB device found, idVendor=4255, idProduct=0001
[ 3183.269575] usb 2-3.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3183.276901] usb 2-3.1: Product: Titan Simple Class
[ 3183.281769] usb 2-3.1: Manufacturer: Insta360
[ 3183.286180] usb 2-3.1: SerialNumber: 0001
[ 3183.362024] usb 2-2.2: new SuperSpeed USB device number 71 using xhci-tegra
[ 3183.382689] usb 2-2.2: New USB device found, idVendor=4255, idProduct=0004
[ 3183.389583] usb 2-2.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 3183.397040] usb 2-2.2: Product: Titan Simple Class
[ 3183.401968] usb 2-2.2: Manufacturer: Insta360
[ 3183.406373] usb 2-2.2: SerialNumber: 0001
[ 3185.542344] pll_a_out0 = 49152000 Hz, aud_mclk = 12288000 Hz, codec rate = 48000 Hz
[ 3193.851170] ---- mlocks ----
[ 3193.854098] 19: locked by channel 10

[ 3193.859207] ---- syncpts ----
[ 3193.862242] id 4 (disp_d) min 18656 max 18656 refs 1 (previous client : )
[ 3193.869055] id 5 (disp_e) min 2 max 2 refs 1 (previous client : )
[ 3193.875169] id 7 (vblank1) min 191400 max 0 refs 1 (previous client : )
[ 3193.881803] id 18 (17000000.gp10b_507) min 47184 max 47186 refs 1 (previous client : )
[ 3193.889727] id 19 (17000000.gp10b_506) min 846 max 846 refs 1 (previous client : )
[ 3193.897304] id 21 (17000000.gp10b_505) min 4688 max 4688 refs 1 (previous client : 17000000.gp10b_505)
[ 3193.906613] id 23 (17000000.gp10b_504) min 18 max 18 refs 1 (previous client : 17000000.gp10b_504)
[ 3193.915579] id 25 (17000000.gp10b_502) min 74 max 74 refs 1 (previous client : )
[ 3193.922983] id 28 (17000000.gp10b_501) min 36500 max 36500 refs 1 (previous client : )
[ 3193.930904] id 31 (17000000.gp10b_498) min 354620 max 354620 refs 1 (previous client : 17000000.gp10b_498)
[ 3193.940557] id 32 (17000000.gp10b_497) min 212284 max 212284 refs 1 (previous client : 17000000.gp10b_497)
[ 3193.950211] id 33 (154c0000.nvenc_camerad_0) min 36514 max 36514 refs 1 (previous client : 15340000.vic_camerad_0)
[ 3193.960558] id 34 (15340000.vic_camerad_0) min 438192 max 438192 refs 1 (previous client : 15340000.vic_camerad_0)
[ 3193.970909] id 35 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3193.981428] id 36 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3193.991948] id 37 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3194.002465] id 38 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3194.012984] id 39 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3194.023503] id 40 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3194.034024] id 41 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3194.044545] id 42 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3194.055064] id 43 (15340000.vic_camerad_0) min 54771 max 54771 refs 1 (previous client : 15340000.vic_camerad_0)

[ 3194.067249] ---- channels ----
[ 3194.070322] 
               channel 1 - 15820000.se

[ 3194.076771] NvHost basic channel registers:
[ 3194.080964] CMDFIFO_STAT_0:  00002040
[ 3194.084635] CMDFIFO_RDATA_0: 04900948
[ 3194.088307] CMDP_OFFSET_0:   00000000
[ 3194.091975] CMDP_CLASS_0:    00000000
[ 3194.095645] CHANNELSTAT_0:   00000000
[ 3194.099316] The CDMA sync queue is empty.

[ 3194.104832] 
               channel 2 - 15830000.se

[ 3194.111280] NvHost basic channel registers:
[ 3194.115468] CMDFIFO_STAT_0:  00002040
[ 3194.119139] CMDFIFO_RDATA_0: 80008600
[ 3194.122811] CMDP_OFFSET_0:   00000000
[ 3194.126481] CMDP_CLASS_0:    00000000
[ 3194.130151] CHANNELSTAT_0:   00000000
[ 3194.133819] The CDMA sync queue is empty.

[ 3194.139318] 
               channel 3 - 15840000.se

[ 3194.145765] NvHost basic channel registers:
[ 3194.149954] CMDFIFO_STAT_0:  00002040
[ 3194.153625] CMDFIFO_RDATA_0: 00dd8101
[ 3194.157280] CMDP_OFFSET_0:   00000000
[ 3194.160949] CMDP_CLASS_0:    00000000
[ 3194.164618] CHANNELSTAT_0:   00000000
[ 3194.168284] The CDMA sync queue is empty.

[ 3194.173800] 
               ---- host general irq ----

[ 3194.180507] sync_intc0mask = 0x00000001
[ 3194.184349] sync_intmask = 0x50000003
[ 3194.188017] 
               ---- host syncpt irq mask ----

[ 3194.195068] 
               ---- host syncpt irq status ----

[ 3194.202293] syncpt_thresh_cpu0_int_status(0) = 0x00000000
[ 3194.207694] syncpt_thresh_cpu0_int_status(1) = 0x00000000
[ 3194.213095] syncpt_thresh_cpu0_int_status(2) = 0x00000000
[ 3194.218497] syncpt_thresh_cpu0_int_status(3) = 0x00000000
[ 3194.223897] syncpt_thresh_cpu0_int_status(4) = 0x00000000
[ 3194.229307] syncpt_thresh_cpu0_int_status(5) = 0x00000000
[ 3194.234709] syncpt_thresh_cpu0_int_status(6) = 0x00000000
[ 3194.240111] syncpt_thresh_cpu0_int_status(7) = 0x00000000
[ 3194.245513] syncpt_thresh_cpu0_int_status(8) = 0x00000000
[ 3194.250915] syncpt_thresh_cpu0_int_status(9) = 0x00000000
[ 3194.256316] syncpt_thresh_cpu0_int_status(10) = 0x00000000
[ 3194.261810] syncpt_thresh_cpu0_int_status(11) = 0x00000000
[ 3194.267297] syncpt_thresh_cpu0_int_status(12) = 0x00000000
[ 3194.272787] syncpt_thresh_cpu0_int_status(13) = 0x00000000
[ 3194.278279] syncpt_thresh_cpu0_int_status(14) = 0x00000000
[ 3194.283770] syncpt_thresh_cpu0_int_status(15) = 0x00000000
[ 3194.289257] syncpt_thresh_cpu0_int_status(16) = 0x00000000
[ 3194.294749] syncpt_thresh_cpu0_int_status(17) = 0x00000000
[ 3194.300239] 17000000.gp10b pbdma 0: 
[ 3194.303647] id: 7 (tsg), next_id: 7 (tsg) chan status: invalid
[ 3194.309666] PUT: 0000001f082c9d40 GET: 0000001f082c9d40 FETCH: 00000629 HEADER: 60400000

[ 3194.319241] 17000000.gp10b eng 0: 
[ 3194.322478] id: 7 (tsg), next_id: 7 (tsg), ctx status: save 
[ 3194.328136] faulted 
[ 3194.328841] busy 

[ 3194.332277] 17000000.gp10b eng 1: 
[ 3194.335509] id: 7 (tsg), next_id: 7 (tsg), ctx status: invalid 

[ 3194.344582] 497-17000000.gp10b, pid 20801, refs: 2: 
[ 3194.349381] channel status: not in use idle not busy
[ 3194.354533] RAMFC : TOP: 8000001f082c9d40 PUT: 0000001f082c9d40 GET: 0000001f082c9d40 FETCH: 0000001f082c9d40
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00002001 SEMAPHORE 0000001e 01770aa0 00000000 00000002

[ 3194.378008] 498-17000000.gp10b, pid 20800, refs: 2: 
[ 3194.382801] channel status:  in use idle not busy
[ 3194.387688] RAMFC : TOP: 8000001f081504a0 PUT: 0000001f081504a0 GET: 0000001f081504a0 FETCH: 0000001f081504a0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001f01 SEMAPHORE 0000001e 014a0aa0 00000000 00000002

[ 3194.411136] 499-17000000.gp10b, pid 1760, refs: 2: 
[ 3194.415845] channel status:  in use idle not busy
[ 3194.420729] RAMFC : TOP: 800000010065169c PUT: 000000010065169c GET: 000000010065169c FETCH: 000000010065169c
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3194.444182] 500-17000000.gp10b, pid 1760, refs: 2: 
[ 3194.448888] channel status:  in use idle not busy
[ 3194.453773] RAMFC : TOP: 8000000100530294 PUT: 0000000100530294 GET: 0000000100530294 FETCH: 0000000100530294
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3194.477226] 501-17000000.gp10b, pid 1760, refs: 2: 
[ 3194.481933] channel status:  in use idle not busy
[ 3194.486819] RAMFC : TOP: 8000001f0832af00 PUT: 0000001f0832af00 GET: 0000001f0832af00 FETCH: 0000001f0832af00
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001c01 SEMAPHORE 00000001 00017ffc 00011d46 00000004

[ 3194.510281] 502-17000000.gp10b, pid 1760, refs: 2: 
[ 3194.514990] channel status:  in use idle not busy
[ 3194.519875] RAMFC : TOP: 80000001003f7de0 PUT: 00000001003f7de0 GET: 00000001003f7de0 FETCH: 00000001003f7de0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001901 SEMAPHORE 00000001 0000fbe0 000034d2 00000004

[ 3194.543324] 503-17000000.gp10b, pid 1760, refs: 2: 
[ 3194.548029] channel status:  in use idle not busy
[ 3194.552912] RAMFC : TOP: 8000000100277c3c PUT: 0000000100277c3c GET: 0000000100277c3c FETCH: 0000000100277c3c
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000001 0000fbd0 00004778 00000004

[ 3194.576362] 504-17000000.gp10b, pid 1760, refs: 2: 
[ 3194.581069] channel status:  in use idle not busy
[ 3194.585953] RAMFC : TOP: 8000001f08000060 PUT: 0000001f08000060 GET: 0000001f08000060 FETCH: 0000001f08000060
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001701 SEMAPHORE 0000001e 01090aa0 00000000 00000002

[ 3194.609400] 505-17000000.gp10b, pid 1441, refs: 2: 
[ 3194.614112] channel status:  in use idle not busy
[ 3194.618999] RAMFC : TOP: 8000001f080142b0 PUT: 0000001f080142b0 GET: 0000001f080142b0 FETCH: 0000001f080142b0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001501 SEMAPHORE 0000001e 03950010 00000001 00001001

[ 3194.642467] 506-17000000.gp10b, pid 846, refs: 2: 
[ 3194.647086] channel status:  in use idle not busy
[ 3194.651972] RAMFC : TOP: 8000001f081427a8 PUT: 0000001f081427a8 GET: 0000001f081427a8 FETCH: 0000001f081427a8
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001301 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3194.675423] 507-17000000.gp10b, pid 846, refs: 4: 
[ 3194.680047] channel status:  in use pending busy
[ 3194.684845] RAMFC : TOP: 8000001f08038500 PUT: 0000001f08038500 GET: 0000001f08038500 FETCH: 0000001f08038500
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001201 SEMAPHORE 0000000d fc001000 04e004b0 01100002

[ 3194.708292] 508-17000000.gp10b, pid 850, refs: 2: 
[ 3194.712911] channel status:  in use idle not busy
[ 3194.717798] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3194.741247] 509-17000000.gp10b, pid 850, refs: 2: 
[ 3194.745868] channel status:  in use idle not busy
[ 3194.750753] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3194.774217] 510-17000000.gp10b, pid 850, refs: 2: 
[ 3194.778838] channel status:  in use idle not busy
[ 3194.783721] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3194.807170] 511-17000000.gp10b, pid 850, refs: 2: 
[ 3194.811787] channel status:  in use idle not busy
[ 3194.816670] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3194.840132] gk20a 17000000.gp10b: gk20a_fifo_handle_mmu_fault:  mmu fault on engine 0, engine subid 0 (gpc), client 12 (rast), addr 0x0000001e:0x04000000, type 2 (pte), info 0x00010c02,inst_ptr 0x1da751000
               
[ 3194.859842] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_os_r : 0
[ 3194.867242] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_cpuctl_r : 0x40
[ 3194.875246] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_idlestate_r : 0x1
[ 3194.883425] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_mailbox0_r : 0x3f
[ 3194.891609] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_mailbox1_r : 0x0
[ 3194.899709] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqstat_r : 0x0
[ 3194.907713] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqmode_r : 0x4
[ 3194.915716] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqmask_r : 0x8704
[ 3194.923981] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqdest_r : 0x0
[ 3194.931983] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_debug1_r : 0x40
[ 3194.939986] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_debuginfo_r : 0x0
[ 3194.948163] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(0) : 0x4
[ 3194.956948] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(1) : 0x0
[ 3194.965730] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(2) : 0x50009
[ 3194.974860] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(3) : 0x0
[ 3194.983643] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(4) : 0x3ffd20
[ 3194.992862] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(5) : 0x0
[ 3195.001651] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(6) : 0x0
[ 3195.010436] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(7) : 0x0
[ 3195.019217] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_engctl_r : 0x0
[ 3195.027134] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_curctx_r : 0x0
[ 3195.035049] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_nxtctx_r : 0x0
[ 3195.042967] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_IMB : 0xbadfbadf
[ 3195.051752] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_DMB : 0xbadfbadf
[ 3195.060537] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_CSW : 0xbadfbadf
[ 3195.069318] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_CTX : 0xbadfbadf
[ 3195.078101] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_EXCI : 0xbadfbadf
[ 3195.086970] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3195.095668] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3195.104365] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3195.113063] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3195.121759] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3195.130457] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3195.139153] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3195.147850] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3195.156553] gk20a 17000000.gp10b: gk20a_fifo_handle_mmu_fault: gr_status_r : 0x81
[ 3196.861856] gk20a 17000000.gp10b: Timeout detected @ __locked_fifo_preempt+0x50/0x21c preempt timeout
[ 3196.871086] gk20a 17000000.gp10b: __locked_fifo_preempt: preempt TSG 7 timeout
               
[ 3196.879989] gk20a 17000000.gp10b: gk20a_set_error_notifier_locked: error notifier set to 8 for ch 497
[ 3198.165551] gk20a 17000000.gp10b: Timeout detected @ gr_gk20a_submit_fecs_method_op+0x104/0x274 
[ 3198.174350] gk20a 17000000.gp10b: gr_gk20a_ctx_wait_ucode: timeout waiting on ucode response
[ 3198.182805] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_os_r : 0
[ 3198.190256] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_cpuctl_r : 0x40
[ 3198.198277] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_idlestate_r : 0x1
[ 3198.206494] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_mailbox0_r : 0x3f
[ 3198.214685] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_mailbox1_r : 0x0
[ 3198.222871] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqstat_r : 0x0
[ 3198.230900] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqmode_r : 0x4
[ 3198.238967] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqmask_r : 0x8704
[ 3198.247253] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqdest_r : 0x0
[ 3198.255327] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_debug1_r : 0x40
[ 3198.263358] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_debuginfo_r : 0x0
[ 3198.271577] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(0) : 0x0
[ 3198.280373] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(1) : 0xffffffff
[ 3198.289807] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(2) : 0x54019
[ 3198.298956] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(3) : 0x0
[ 3198.307783] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(4) : 0x3ffd20
[ 3198.317017] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(5) : 0x0
[ 3198.325897] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(6) : 0x0
[ 3198.334693] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(7) : 0x0
[ 3198.343533] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_engctl_r : 0x0
[ 3198.351461] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_curctx_r : 0x0
[ 3198.359425] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_nxtctx_r : 0x0
[ 3198.367351] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_IMB : 0xbadfbadf
[ 3198.376196] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_DMB : 0xbadfbadf
[ 3198.384989] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_CSW : 0xbadfbadf
[ 3198.393826] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_CTX : 0xbadfbadf
[ 3198.402626] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_EXCI : 0xbadfbadf
[ 3198.411539] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3198.420247] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3198.429047] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3198.437757] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3198.446511] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3198.455223] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3198.463961] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3198.472669] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3198.481403] NV_PGRAPH_STATUS: 0x89
[ 3198.484819] NV_PGRAPH_STATUS1: 0x0
[ 3198.488260] NV_PGRAPH_STATUS2: 0x0
[ 3198.491678] NV_PGRAPH_ENGINE_STATUS: 0x1
[ 3198.495649] NV_PGRAPH_GRFIFO_STATUS : 0xa0a0001
[ 3198.500193] NV_PGRAPH_GRFIFO_CONTROL : 0x0
[ 3198.504324] NV_PGRAPH_PRI_FECS_HOST_INT_STATUS : 0x80000
[ 3198.509651] NV_PGRAPH_EXCEPTION  : 0x0
[ 3198.513432] NV_PGRAPH_FECS_INTR  : 0x0
[ 3198.517196] NV_PFIFO_ENGINE_STATUS(GR) : 0xd007d007
[ 3198.522174] NV_PGRAPH_ACTIVITY0: 0x0
[ 3198.525765] NV_PGRAPH_ACTIVITY1: 0x7000
[ 3198.529636] NV_PGRAPH_ACTIVITY2: 0x0
[ 3198.533211] NV_PGRAPH_ACTIVITY4: 0x0
[ 3198.536810] NV_PGRAPH_PRI_SKED_ACTIVITY: 0xe01c0000
[ 3198.541755] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY0: 0xffffff
[ 3198.547427] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY1: 0xffffff
[ 3198.553134] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY2: 0x7fcf
[ 3198.558635] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY3: 0x3f
[ 3198.563988] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3198.569831] NV_PGRAPH_PRI_GPC0_TPC1_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3198.575707] NV_PGRAPH_PRI_GPC0_TPCS_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3198.581556] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY0: 0xffffff
[ 3198.587257] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY1: 0xffffff
[ 3198.592934] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY2: 0x7fcf
[ 3198.598455] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY3: 0x3f
[ 3198.603780] NV_PGRAPH_PRI_GPCS_TPC0_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3198.609654] NV_PGRAPH_PRI_GPCS_TPC1_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3198.615499] NV_PGRAPH_PRI_GPCS_TPCS_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3198.621389] NV_PGRAPH_PRI_BE0_BECS_BE_ACTIVITY0: 0x7fff
[ 3198.626681] NV_PGRAPH_PRI_BE1_BECS_BE_ACTIVITY0: 0x7fff
[ 3198.631945] NV_PGRAPH_PRI_BES_BECS_BE_ACTIVITY0: 0x7fff
[ 3198.637209] NV_PGRAPH_PRI_DS_MPIPE_STATUS: 0x0
[ 3198.641701] NV_PGRAPH_PRI_FE_GO_IDLE_TIMEOUT : 0x800
[ 3198.646713] NV_PGRAPH_PRI_FE_GO_IDLE_INFO : 0x23000700
[ 3198.651912] NV_PGRAPH_PRI_GPC0_TPC0_TEX_M_TEX_SUBUNITS_STATUS: 0x3f77
[ 3198.658365] NV_PGRAPH_PRI_CWD_FS: 0x201
[ 3198.662250] NV_PGRAPH_PRI_FE_TPC_FS: 0x3
[ 3198.666189] NV_PGRAPH_PRI_CWD_GPC_TPC_ID(0): 0x100
[ 3198.671012] NV_PGRAPH_PRI_CWD_SM_ID(0): 0x100
[ 3198.675385] NV_PGRAPH_PRI_FECS_CTXSW_STATUS_FE_0: 0x20001
[ 3198.680826] NV_PGRAPH_PRI_FECS_CTXSW_STATUS_1: 0x4880
[ 3198.685889] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_STATUS_GPC_0: 0x0
[ 3198.691606] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_STATUS_1: 0x4b00
[ 3198.697188] NV_PGRAPH_PRI_FECS_CTXSW_IDLESTATE : 0xe
[ 3198.702194] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_IDLESTATE : 0xe
[ 3198.707693] NV_PGRAPH_PRI_FECS_CURRENT_CTX : 0x801da751
[ 3198.712963] NV_PGRAPH_PRI_FECS_NEW_CTX : 0x1da751
[ 3198.717679] NV_PGRAPH_PRI_BE0_CROP_STATUS1 : 0x5f00000
[ 3198.722911] NV_PGRAPH_PRI_BES_CROP_STATUS1 : 0x5f00000
[ 3198.728066] NV_PGRAPH_PRI_BE0_ZROP_STATUS : 0xe00000
[ 3198.733081] NV_PGRAPH_PRI_BE0_ZROP_STATUS2 : 0x7
[ 3198.737714] NV_PGRAPH_PRI_BES_ZROP_STATUS : 0xe00000
[ 3198.742730] NV_PGRAPH_PRI_BES_ZROP_STATUS2 : 0x7
[ 3198.747360] NV_PGRAPH_PRI_BE0_BECS_BE_EXCEPTION: 0x0
[ 3198.752361] NV_PGRAPH_PRI_BE0_BECS_BE_EXCEPTION_EN: 0x0
[ 3198.757601] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_EXCEPTION: 0x0
[ 3198.762869] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_EXCEPTION_EN: 0x30000
[ 3198.768711] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_EXCEPTION: 0x0
[ 3198.774428] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_EXCEPTION_EN: 0x3
[ 3198.780366] gk20a 17000000.gp10b: gk20a_fifo_reset_engine: failed to HALT gr pipe
[ 3198.893584] gk20a 17000000.gp10b: gk20a_channel_timeout_handler: Job on channel 507 timed out
[ 3198.902104] ---- mlocks ----

[ 3198.906554] ---- syncpts ----
[ 3198.909523] id 4 (disp_d) min 18656 max 18656 refs 1 (previous client : )
[ 3198.916318] id 5 (disp_e) min 2 max 2 refs 1 (previous client : )
[ 3198.922462] id 7 (vblank1) min 191703 max 0 refs 1 (previous client : )
[ 3198.929092] id 18 (17000000.gp10b_507) min 47184 max 47186 refs 1 (previous client : )
[ 3198.937013] id 19 (17000000.gp10b_506) min 846 max 846 refs 1 (previous client : )
[ 3198.944620] id 21 (17000000.gp10b_505) min 4688 max 4688 refs 1 (previous client : 17000000.gp10b_505)
[ 3198.953931] id 23 (17000000.gp10b_504) min 18 max 18 refs 1 (previous client : 17000000.gp10b_504)
[ 3198.962926] id 25 (17000000.gp10b_502) min 74 max 74 refs 1 (previous client : )
[ 3198.970329] id 28 (17000000.gp10b_501) min 36500 max 36500 refs 1 (previous client : )
[ 3198.978284] id 31 (17000000.gp10b_498) min 354620 max 354620 refs 1 (previous client : 17000000.gp10b_498)
[ 3198.987988] id 32 (17000000.gp10b_497) min 212284 max 212284 refs 1 (previous client : 17000000.gp10b_497)
[ 3198.997653] id 33 (154c0000.nvenc_camerad_0) min 36514 max 36514 refs 1 (previous client : 15340000.vic_camerad_0)
[ 3199.008041] id 34 (15340000.vic_camerad_0) min 438192 max 438192 refs 1 (previous client : 15340000.vic_camerad_0)
[ 3199.018388] id 35 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3199.028946] id 36 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3199.039500] id 37 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3199.050023] id 38 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3199.060576] id 39 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3199.071097] id 40 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3199.081648] id 41 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3199.092203] id 42 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3199.102721] id 43 (15340000.vic_camerad_0) min 54771 max 54771 refs 1 (previous client : 15340000.vic_camerad_0)

[ 3199.114944] ---- channels ----
[ 3199.118015] 
               channel 1 - 15820000.se

[ 3199.124498] NvHost basic channel registers:
[ 3199.128692] CMDFIFO_STAT_0:  00002040
[ 3199.132362] CMDFIFO_RDATA_0: 04900948
[ 3199.136035] CMDP_OFFSET_0:   00000000
[ 3199.139739] CMDP_CLASS_0:    00000000
[ 3199.143410] CHANNELSTAT_0:   00000000
[ 3199.147078] The CDMA sync queue is empty.

[ 3199.152580] 
               channel 2 - 15830000.se

[ 3199.159064] NvHost basic channel registers:
[ 3199.163255] CMDFIFO_STAT_0:  00002040
[ 3199.166926] CMDFIFO_RDATA_0: 80008600
[ 3199.170597] CMDP_OFFSET_0:   00000000
[ 3199.174300] CMDP_CLASS_0:    00000000
[ 3199.177969] CHANNELSTAT_0:   00000000
[ 3199.181638] The CDMA sync queue is empty.

[ 3199.187139] 
               channel 3 - 15840000.se

[ 3199.193621] NvHost basic channel registers:
[ 3199.197811] CMDFIFO_STAT_0:  00002040
[ 3199.201466] CMDFIFO_RDATA_0: 00dd8101
[ 3199.205171] CMDP_OFFSET_0:   00000000
[ 3199.208840] CMDP_CLASS_0:    00000000
[ 3199.212509] CHANNELSTAT_0:   00000000
[ 3199.216176] The CDMA sync queue is empty.

[ 3199.221729] 
               ---- host general irq ----

[ 3199.228439] sync_intc0mask = 0x00000001
[ 3199.232280] sync_intmask = 0x50000003
[ 3199.235949] 
               ---- host syncpt irq mask ----

[ 3199.243033] 
               ---- host syncpt irq status ----

[ 3199.250262] syncpt_thresh_cpu0_int_status(0) = 0x00000000
[ 3199.255698] syncpt_thresh_cpu0_int_status(1) = 0x00000000
[ 3199.261106] syncpt_thresh_cpu0_int_status(2) = 0x00000000
[ 3199.266507] syncpt_thresh_cpu0_int_status(3) = 0x00000000
[ 3199.271942] syncpt_thresh_cpu0_int_status(4) = 0x00000000
[ 3199.277345] syncpt_thresh_cpu0_int_status(5) = 0x00000000
[ 3199.282758] syncpt_thresh_cpu0_int_status(6) = 0x00000000
[ 3199.288195] syncpt_thresh_cpu0_int_status(7) = 0x00000000
[ 3199.293598] syncpt_thresh_cpu0_int_status(8) = 0x00000000
[ 3199.299000] syncpt_thresh_cpu0_int_status(9) = 0x00000000
[ 3199.304402] syncpt_thresh_cpu0_int_status(10) = 0x00000000
[ 3199.309928] syncpt_thresh_cpu0_int_status(11) = 0x00000000
[ 3199.315418] syncpt_thresh_cpu0_int_status(12) = 0x00000000
[ 3199.320907] syncpt_thresh_cpu0_int_status(13) = 0x00000000
[ 3199.326431] syncpt_thresh_cpu0_int_status(14) = 0x00000000
[ 3199.331919] syncpt_thresh_cpu0_int_status(15) = 0x00000000
[ 3199.337409] syncpt_thresh_cpu0_int_status(16) = 0x00000000
[ 3199.342945] syncpt_thresh_cpu0_int_status(17) = 0x00000000
[ 3199.348440] 17000000.gp10b pbdma 0: 
[ 3199.351847] id: 7 (tsg), next_id: 7 (tsg) chan status: invalid
[ 3199.357902] PUT: 0000001f082c9d40 GET: 0000001f082c9d40 FETCH: 00000629 HEADER: 60400000

[ 3199.367484] 17000000.gp10b eng 0: 
[ 3199.370722] id: 7 (tsg), next_id: 7 (tsg), ctx status: save 
[ 3199.376419] faulted 
[ 3199.377123] busy 

[ 3199.380559] 17000000.gp10b eng 1: 
[ 3199.383793] id: 7 (tsg), next_id: 7 (tsg), ctx status: invalid 

[ 3199.392895] 497-17000000.gp10b, pid 20801, refs: 3: 
[ 3199.397698] channel status: not in use idle not busy
[ 3199.402848] RAMFC : TOP: 8000001f082c9d40 PUT: 0000001f082c9d40 GET: 0000001f082c9d40 FETCH: 0000001f082c9d40
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00002001 SEMAPHORE 0000001e 01770aa0 00000000 00000002

[ 3199.426355] 498-17000000.gp10b, pid 20800, refs: 2: 
[ 3199.431149] channel status:  in use idle not busy
[ 3199.436036] RAMFC : TOP: 8000001f081504a0 PUT: 0000001f081504a0 GET: 0000001f081504a0 FETCH: 0000001f081504a0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001f01 SEMAPHORE 0000001e 014a0aa0 00000000 00000002

[ 3199.459659] 499-17000000.gp10b, pid 1760, refs: 2: 
[ 3199.464373] channel status:  in use idle not busy
[ 3199.469260] RAMFC : TOP: 800000010065169c PUT: 000000010065169c GET: 000000010065169c FETCH: 000000010065169c
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3199.492786] 500-17000000.gp10b, pid 1760, refs: 2: 
[ 3199.497503] channel status:  in use idle not busy
[ 3199.502394] RAMFC : TOP: 8000000100530294 PUT: 0000000100530294 GET: 0000000100530294 FETCH: 0000000100530294
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3199.525909] 501-17000000.gp10b, pid 1760, refs: 2: 
[ 3199.530618] channel status:  in use idle not busy
[ 3199.535504] RAMFC : TOP: 8000001f0832af00 PUT: 0000001f0832af00 GET: 0000001f0832af00 FETCH: 0000001f0832af00
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001c01 SEMAPHORE 00000001 00017ffc 00011d46 00000004

[ 3199.559012] 502-17000000.gp10b, pid 1760, refs: 2: 
[ 3199.563720] channel status:  in use idle not busy
[ 3199.568605] RAMFC : TOP: 80000001003f7de0 PUT: 00000001003f7de0 GET: 00000001003f7de0 FETCH: 00000001003f7de0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001901 SEMAPHORE 00000001 0000fbe0 000034d2 00000004

[ 3199.592092] 503-17000000.gp10b, pid 1760, refs: 2: 
[ 3199.596800] channel status:  in use idle not busy
[ 3199.601688] RAMFC : TOP: 8000000100277c3c PUT: 0000000100277c3c GET: 0000000100277c3c FETCH: 0000000100277c3c
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000001 0000fbd0 00004778 00000004

[ 3199.625175] 504-17000000.gp10b, pid 1760, refs: 2: 
[ 3199.629885] channel status:  in use idle not busy
[ 3199.634770] RAMFC : TOP: 8000001f08000060 PUT: 0000001f08000060 GET: 0000001f08000060 FETCH: 0000001f08000060
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001701 SEMAPHORE 0000001e 01090aa0 00000000 00000002

[ 3199.658273] 505-17000000.gp10b, pid 1441, refs: 2: 
[ 3199.662980] channel status:  in use idle not busy
[ 3199.667873] RAMFC : TOP: 8000001f080142b0 PUT: 0000001f080142b0 GET: 0000001f080142b0 FETCH: 0000001f080142b0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001501 SEMAPHORE 0000001e 03950010 00000001 00001001

[ 3199.691360] 506-17000000.gp10b, pid 846, refs: 2: 
[ 3199.695985] channel status:  in use idle not busy
[ 3199.700871] RAMFC : TOP: 8000001f081427a8 PUT: 0000001f081427a8 GET: 0000001f081427a8 FETCH: 0000001f081427a8
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001301 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3199.724360] 507-17000000.gp10b, pid 846, refs: 5: 
[ 3199.728988] channel status:  in use pending busy
[ 3199.733786] RAMFC : TOP: 8000001f08038500 PUT: 0000001f08038500 GET: 0000001f08038500 FETCH: 0000001f08038500
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001201 SEMAPHORE 0000000d fc001000 04e004b0 01100002

[ 3199.757274] 508-17000000.gp10b, pid 850, refs: 2: 
[ 3199.761900] channel status:  in use idle not busy
[ 3199.766791] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3199.790301] 509-17000000.gp10b, pid 850, refs: 2: 
[ 3199.794920] channel status:  in use idle not busy
[ 3199.799803] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3199.823474] 510-17000000.gp10b, pid 850, refs: 2: 
[ 3199.828108] channel status:  in use idle not busy
[ 3199.832996] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3199.856494] 511-17000000.gp10b, pid 850, refs: 2: 
[ 3199.861118] channel status:  in use idle not busy
[ 3199.866003] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3199.889493] NV_PGRAPH_STATUS: 0x89
[ 3199.892905] NV_PGRAPH_STATUS1: 0x0
[ 3199.896314] NV_PGRAPH_STATUS2: 0x0
[ 3199.899725] NV_PGRAPH_ENGINE_STATUS: 0x1
[ 3199.903654] NV_PGRAPH_GRFIFO_STATUS : 0xa0a0001
[ 3199.908226] NV_PGRAPH_GRFIFO_CONTROL : 0x0
[ 3199.912331] NV_PGRAPH_PRI_FECS_HOST_INT_STATUS : 0x80000
[ 3199.917647] NV_PGRAPH_EXCEPTION  : 0x0
[ 3199.921424] NV_PGRAPH_FECS_INTR  : 0x0
[ 3199.925189] NV_PFIFO_ENGINE_STATUS(GR) : 0xd007d007
[ 3199.930073] NV_PGRAPH_ACTIVITY0: 0x0
[ 3199.933656] NV_PGRAPH_ACTIVITY1: 0x7000
[ 3199.937484] NV_PGRAPH_ACTIVITY2: 0x0
[ 3199.941102] NV_PGRAPH_ACTIVITY4: 0x0
[ 3199.944684] NV_PGRAPH_PRI_SKED_ACTIVITY: 0xe01c0000
[ 3199.949567] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY0: 0xffffff
[ 3199.955265] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY1: 0xffffff
[ 3199.960928] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY2: 0x7fcf
[ 3199.966430] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY3: 0x3f
[ 3199.971780] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3199.977619] NV_PGRAPH_PRI_GPC0_TPC1_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3199.983456] NV_PGRAPH_PRI_GPC0_TPCS_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3199.989326] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY0: 0xffffff
[ 3199.994989] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY1: 0xffffff
[ 3200.000650] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY2: 0x7fcf
[ 3200.006176] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY3: 0x3f
[ 3200.011494] NV_PGRAPH_PRI_GPCS_TPC0_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3200.017330] NV_PGRAPH_PRI_GPCS_TPC1_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3200.023200] NV_PGRAPH_PRI_GPCS_TPCS_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3200.029036] NV_PGRAPH_PRI_BE0_BECS_BE_ACTIVITY0: 0x7fff
[ 3200.034265] NV_PGRAPH_PRI_BE1_BECS_BE_ACTIVITY0: 0x7fff
[ 3200.039530] NV_PGRAPH_PRI_BES_BECS_BE_ACTIVITY0: 0x7fff
[ 3200.044761] NV_PGRAPH_PRI_DS_MPIPE_STATUS: 0x0
[ 3200.049209] NV_PGRAPH_PRI_FE_GO_IDLE_TIMEOUT : 0x800
[ 3200.054182] NV_PGRAPH_PRI_FE_GO_IDLE_INFO : 0x23000700
[ 3200.059362] NV_PGRAPH_PRI_GPC0_TPC0_TEX_M_TEX_SUBUNITS_STATUS: 0x3f77
[ 3200.065806] NV_PGRAPH_PRI_CWD_FS: 0x201
[ 3200.069648] NV_PGRAPH_PRI_FE_TPC_FS: 0x3
[ 3200.073608] NV_PGRAPH_PRI_CWD_GPC_TPC_ID(0): 0x100
[ 3200.078409] NV_PGRAPH_PRI_CWD_SM_ID(0): 0x100
[ 3200.082772] NV_PGRAPH_PRI_FECS_CTXSW_STATUS_FE_0: 0x20001
[ 3200.088212] NV_PGRAPH_PRI_FECS_CTXSW_STATUS_1: 0x4880
[ 3200.093272] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_STATUS_GPC_0: 0x0
[ 3200.098936] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_STATUS_1: 0x4b00
[ 3200.104547] NV_PGRAPH_PRI_FECS_CTXSW_IDLESTATE : 0xe
[ 3200.109516] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_IDLESTATE : 0xe
[ 3200.115005] NV_PGRAPH_PRI_FECS_CURRENT_CTX : 0x801da751
[ 3200.120235] NV_PGRAPH_PRI_FECS_NEW_CTX : 0x1da751
[ 3200.124978] NV_PGRAPH_PRI_BE0_CROP_STATUS1 : 0x5f00000
[ 3200.130123] NV_PGRAPH_PRI_BES_CROP_STATUS1 : 0x5f00000
[ 3200.135266] NV_PGRAPH_PRI_BE0_ZROP_STATUS : 0xe00000
[ 3200.140269] NV_PGRAPH_PRI_BE0_ZROP_STATUS2 : 0x7
[ 3200.144893] NV_PGRAPH_PRI_BES_ZROP_STATUS : 0xe00000
[ 3200.149865] NV_PGRAPH_PRI_BES_ZROP_STATUS2 : 0x7
[ 3200.154511] NV_PGRAPH_PRI_BE0_BECS_BE_EXCEPTION: 0x0
[ 3200.159482] NV_PGRAPH_PRI_BE0_BECS_BE_EXCEPTION_EN: 0x0
[ 3200.164716] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_EXCEPTION: 0x0
[ 3200.169946] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_EXCEPTION_EN: 0x30000
[ 3200.175818] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_EXCEPTION: 0x0
[ 3200.181482] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_EXCEPTION_EN: 0x3
[ 3200.187412] gk20a 17000000.gp10b: gk20a_set_error_notifier_locked: error notifier set to 8 for ch 507
[ 3201.781672] gk20a 17000000.gp10b: Timeout detected @ gr_gk20a_submit_fecs_method_op+0x104/0x274 
[ 3201.790883] gk20a 17000000.gp10b: gr_gk20a_ctx_wait_ucode: timeout waiting on ucode response
[ 3201.799343] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_os_r : 0
[ 3201.806766] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_cpuctl_r : 0x40
[ 3201.814778] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_idlestate_r : 0x1
[ 3201.822963] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_mailbox0_r : 0x3f
[ 3201.831152] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_mailbox1_r : 0x0
[ 3201.839245] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqstat_r : 0x0
[ 3201.847253] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqmode_r : 0x4
[ 3201.855260] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqmask_r : 0x8704
[ 3201.863529] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_irqdest_r : 0x0
[ 3201.871536] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_debug1_r : 0x40
[ 3201.879546] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_debuginfo_r : 0x0
[ 3201.887734] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(0) : 0x0
[ 3201.896524] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(1) : 0xffffffff
[ 3201.905918] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(2) : 0x54019
[ 3201.915050] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(3) : 0x0
[ 3201.923839] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(4) : 0x3ffd20
[ 3201.933059] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(5) : 0x0
[ 3201.941854] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(6) : 0x0
[ 3201.950642] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_ctxsw_mailbox_r(7) : 0x0
[ 3201.959427] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_engctl_r : 0x0
[ 3201.967346] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_curctx_r : 0x0
[ 3201.975264] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: gr_fecs_nxtctx_r : 0x0
[ 3201.983185] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_IMB : 0xbadfbadf
[ 3201.991973] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_DMB : 0xbadfbadf
[ 3202.000770] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_CSW : 0xbadfbadf
[ 3202.009558] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_CTX : 0xbadfbadf
[ 3202.018348] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_EXCI : 0xbadfbadf
[ 3202.027224] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3202.035934] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3202.044637] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3202.053345] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3202.062094] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3202.070839] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3202.079562] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_PC : 0xbadfbadf
[ 3202.088273] gk20a 17000000.gp10b: gk20a_fecs_dump_falcon_stats: FECS_FALCON_REG_SP : 0xbadfbadf
[ 3202.096993] NV_PGRAPH_STATUS: 0x89
[ 3202.100436] NV_PGRAPH_STATUS1: 0x0
[ 3202.103864] NV_PGRAPH_STATUS2: 0x0
[ 3202.107285] NV_PGRAPH_ENGINE_STATUS: 0x1
[ 3202.111235] NV_PGRAPH_GRFIFO_STATUS : 0xa0a0001
[ 3202.115783] NV_PGRAPH_GRFIFO_CONTROL : 0x0
[ 3202.119903] NV_PGRAPH_PRI_FECS_HOST_INT_STATUS : 0x80000
[ 3202.125232] NV_PGRAPH_EXCEPTION  : 0x0
[ 3202.128997] NV_PGRAPH_FECS_INTR  : 0x0
[ 3202.132764] NV_PFIFO_ENGINE_STATUS(GR) : 0xd007d007
[ 3202.137661] NV_PGRAPH_ACTIVITY0: 0x0
[ 3202.141233] NV_PGRAPH_ACTIVITY1: 0x7000
[ 3202.145088] NV_PGRAPH_ACTIVITY2: 0x0
[ 3202.148683] NV_PGRAPH_ACTIVITY4: 0x0
[ 3202.152277] NV_PGRAPH_PRI_SKED_ACTIVITY: 0xe01c0000
[ 3202.157174] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY0: 0xffffff
[ 3202.162850] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY1: 0xffffff
[ 3202.168526] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY2: 0x7fcf
[ 3202.174027] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_ACTIVITY3: 0x3f
[ 3202.179362] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3202.185213] NV_PGRAPH_PRI_GPC0_TPC1_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3202.191072] NV_PGRAPH_PRI_GPC0_TPCS_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3202.196929] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY0: 0xffffff
[ 3202.202608] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY1: 0xffffff
[ 3202.208281] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY2: 0x7fcf
[ 3202.213792] NV_PGRAPH_PRI_GPCS_GPCCS_GPC_ACTIVITY3: 0x3f
[ 3202.219121] NV_PGRAPH_PRI_GPCS_TPC0_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3202.224971] NV_PGRAPH_PRI_GPCS_TPC1_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3202.230821] NV_PGRAPH_PRI_GPCS_TPCS_TPCCS_TPC_ACTIVITY0: 0xfff
[ 3202.236672] NV_PGRAPH_PRI_BE0_BECS_BE_ACTIVITY0: 0x7fff
[ 3202.241914] NV_PGRAPH_PRI_BE1_BECS_BE_ACTIVITY0: 0x7fff
[ 3202.247160] NV_PGRAPH_PRI_BES_BECS_BE_ACTIVITY0: 0x7fff
[ 3202.252401] NV_PGRAPH_PRI_DS_MPIPE_STATUS: 0x0
[ 3202.256867] NV_PGRAPH_PRI_FE_GO_IDLE_TIMEOUT : 0x800
[ 3202.261850] NV_PGRAPH_PRI_FE_GO_IDLE_INFO : 0x23000700
[ 3202.267014] NV_PGRAPH_PRI_GPC0_TPC0_TEX_M_TEX_SUBUNITS_STATUS: 0x3f77
[ 3202.273473] NV_PGRAPH_PRI_CWD_FS: 0x201
[ 3202.277326] NV_PGRAPH_PRI_FE_TPC_FS: 0x3
[ 3202.281266] NV_PGRAPH_PRI_CWD_GPC_TPC_ID(0): 0x100
[ 3202.286075] NV_PGRAPH_PRI_CWD_SM_ID(0): 0x100
[ 3202.290454] NV_PGRAPH_PRI_FECS_CTXSW_STATUS_FE_0: 0x20001
[ 3202.295870] NV_PGRAPH_PRI_FECS_CTXSW_STATUS_1: 0x4880
[ 3202.300939] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_STATUS_GPC_0: 0x0
[ 3202.306612] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_STATUS_1: 0x4b00
[ 3202.312203] NV_PGRAPH_PRI_FECS_CTXSW_IDLESTATE : 0xe
[ 3202.317184] NV_PGRAPH_PRI_GPC0_GPCCS_CTXSW_IDLESTATE : 0xe
[ 3202.322702] NV_PGRAPH_PRI_FECS_CURRENT_CTX : 0x801da751
[ 3202.327970] NV_PGRAPH_PRI_FECS_NEW_CTX : 0x1da751
[ 3202.332697] NV_PGRAPH_PRI_BE0_CROP_STATUS1 : 0x5f00000
[ 3202.337851] NV_PGRAPH_PRI_BES_CROP_STATUS1 : 0x5f00000
[ 3202.343007] NV_PGRAPH_PRI_BE0_ZROP_STATUS : 0xe00000
[ 3202.347988] NV_PGRAPH_PRI_BE0_ZROP_STATUS2 : 0x7
[ 3202.352624] NV_PGRAPH_PRI_BES_ZROP_STATUS : 0xe00000
[ 3202.357603] NV_PGRAPH_PRI_BES_ZROP_STATUS2 : 0x7
[ 3202.362238] NV_PGRAPH_PRI_BE0_BECS_BE_EXCEPTION: 0x0
[ 3202.367220] NV_PGRAPH_PRI_BE0_BECS_BE_EXCEPTION_EN: 0x0
[ 3202.372464] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_EXCEPTION: 0x0
[ 3202.377705] NV_PGRAPH_PRI_GPC0_GPCCS_GPC_EXCEPTION_EN: 0x30000
[ 3202.383556] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_EXCEPTION: 0x0
[ 3202.389229] NV_PGRAPH_PRI_GPC0_TPC0_TPCCS_TPC_EXCEPTION_EN: 0x3
[ 3202.395177] ---- mlocks ----

[ 3202.399641] ---- syncpts ----
[ 3202.400596] gk20a 17000000.gp10b: gk20a_fifo_set_ctx_mmu_error_tsg: TSG 7 generated a mmu fault
[ 3202.400622] gk20a 17000000.gp10b: fifo_error_isr: channel reset initiated from fifo_error_isr; intr=0x10000000
[ 3202.400643] gk20a 17000000.gp10b: gk20a_fifo_is_valid_engine_id: engine_id is not in active list/invalid -1
[ 3202.400646] gk20a 17000000.gp10b: gk20a_fifo_handle_sched_error: fifo sched error : 0x0000000d, failed to find engine
               
[ 3202.443156] id 4 (disp_d) min 18656 max 18656 refs 1 (previous client : )
[ 3202.449965] id 5 (disp_e) min 2 max 2 refs 1 (previous client : )
[ 3202.456080] id 7 (vblank1) min 191915 max 0 refs 1 (previous client : )
[ 3202.462718] id 18 (17000000.gp10b_507) min 47188 max 47188 refs 1 (previous client : )
[ 3202.470659] id 19 (17000000.gp10b_506) min 846 max 846 refs 1 (previous client : )
[ 3202.478241] id 21 (17000000.gp10b_505) min 4688 max 4688 refs 1 (previous client : 17000000.gp10b_505)
[ 3202.487564] id 23 (17000000.gp10b_504) min 18 max 18 refs 1 (previous client : 17000000.gp10b_504)
[ 3202.496534] id 25 (17000000.gp10b_502) min 74 max 74 refs 1 (previous client : )
[ 3202.503956] id 28 (17000000.gp10b_501) min 36500 max 36500 refs 1 (previous client : )
[ 3202.511891] id 31 (17000000.gp10b_498) min 354620 max 354620 refs 1 (previous client : 17000000.gp10b_498)
[ 3202.521559] id 32 (17000000.gp10b_497) min 212284 max 212284 refs 1 (previous client : 17000000.gp10b_497)
[ 3202.531228] id 33 (154c0000.nvenc_camerad_0) min 36514 max 36514 refs 1 (previous client : 15340000.vic_camerad_0)
[ 3202.541591] id 34 (15340000.vic_camerad_0) min 438192 max 438192 refs 1 (previous client : 15340000.vic_camerad_0)
[ 3202.551946] id 35 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3202.562479] id 36 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3202.573012] id 37 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3202.583553] id 38 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3202.594082] id 39 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3202.604618] id 40 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3202.615145] id 41 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3202.625681] id 42 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3202.636213] id 43 (15340000.vic_camerad_0) min 54771 max 54771 refs 1 (previous client : 15340000.vic_camerad_0)

[ 3202.648500] ---- channels ----
[ 3202.651599] 
               channel 1 - 15820000.se

[ 3202.658063] NvHost basic channel registers:
[ 3202.662268] CMDFIFO_STAT_0:  00002040
[ 3202.665952] CMDFIFO_RDATA_0: 04900948
[ 3202.669633] CMDP_OFFSET_0:   00000000
[ 3202.673289] CMDP_CLASS_0:    00000000
[ 3202.676973] CHANNELSTAT_0:   00000000
[ 3202.680653] The CDMA sync queue is empty.

[ 3202.686211] 
               channel 2 - 15830000.se

[ 3202.692674] NvHost basic channel registers:
[ 3202.696878] CMDFIFO_STAT_0:  00002040
[ 3202.700563] CMDFIFO_RDATA_0: 80008600
[ 3202.704245] CMDP_OFFSET_0:   00000000
[ 3202.707926] CMDP_CLASS_0:    00000000
[ 3202.711613] CHANNELSTAT_0:   00000000
[ 3202.715293] The CDMA sync queue is empty.

[ 3202.720825] 
               channel 3 - 15840000.se

[ 3202.727284] NvHost basic channel registers:
[ 3202.731486] CMDFIFO_STAT_0:  00002040
[ 3202.735168] CMDFIFO_RDATA_0: 00dd8101
[ 3202.738851] CMDP_OFFSET_0:   00000000
[ 3202.742534] CMDP_CLASS_0:    00000000
[ 3202.746215] CHANNELSTAT_0:   00000000
[ 3202.749895] The CDMA sync queue is empty.

[ 3202.755425] 
               ---- host general irq ----

[ 3202.762151] sync_intc0mask = 0x00000001
[ 3202.766006] sync_intmask = 0x50000003
[ 3202.769686] 
               ---- host syncpt irq mask ----

[ 3202.776762] 
               ---- host syncpt irq status ----

[ 3202.784002] syncpt_thresh_cpu0_int_status(0) = 0x00000000
[ 3202.789417] syncpt_thresh_cpu0_int_status(1) = 0x00000000
[ 3202.794833] syncpt_thresh_cpu0_int_status(2) = 0x00000000
[ 3202.800248] syncpt_thresh_cpu0_int_status(3) = 0x00000000
[ 3202.805665] syncpt_thresh_cpu0_int_status(4) = 0x00000000
[ 3202.811079] syncpt_thresh_cpu0_int_status(5) = 0x00000000
[ 3202.816506] syncpt_thresh_cpu0_int_status(6) = 0x00000000
[ 3202.821924] syncpt_thresh_cpu0_int_status(7) = 0x00000000
[ 3202.827349] syncpt_thresh_cpu0_int_status(8) = 0x00000000
[ 3202.832762] syncpt_thresh_cpu0_int_status(9) = 0x00000000
[ 3202.838183] syncpt_thresh_cpu0_int_status(10) = 0x00000000
[ 3202.843685] syncpt_thresh_cpu0_int_status(11) = 0x00000000
[ 3202.849197] syncpt_thresh_cpu0_int_status(12) = 0x00000000
[ 3202.854697] syncpt_thresh_cpu0_int_status(13) = 0x00000000
[ 3202.860203] syncpt_thresh_cpu0_int_status(14) = 0x00000000
[ 3202.865707] syncpt_thresh_cpu0_int_status(15) = 0x00000000
[ 3202.871216] syncpt_thresh_cpu0_int_status(16) = 0x00000000
[ 3202.876717] syncpt_thresh_cpu0_int_status(17) = 0x00000000
[ 3202.882224] 17000000.gp10b pbdma 0: 
[ 3202.885648] id: 0 (tsg), next_id: 0 (tsg) chan status: valid
[ 3202.891519] PUT: 0000001f08038540 GET: 0000001f08038540 FETCH: 0000047c HEADER: 60400000

[ 3202.901118] 17000000.gp10b eng 0: 
[ 3202.904367] id: 0 (tsg), next_id: 0 (tsg), ctx status: valid 

[ 3202.911635] 17000000.gp10b eng 1: 
[ 3202.914888] id: 7 (tsg), next_id: 7 (tsg), ctx status: invalid 

[ 3202.924229] 497-17000000.gp10b, pid 20801, refs: 3: 
[ 3202.929042] channel status: not in use idle not busy
[ 3202.934228] RAMFC : TOP: 8000001f082c9d40 PUT: 0000001f082c9d40 GET: 0000001f082c9d40 FETCH: 0000001f082c9d40
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00002001 SEMAPHORE 0000001e 01770aa0 00000000 00000002

[ 3202.957730] 498-17000000.gp10b, pid 20800, refs: 2: 
[ 3202.962536] channel status:  in use idle not busy
[ 3202.967457] RAMFC : TOP: 8000001f081504a0 PUT: 0000001f081504a0 GET: 0000001f081504a0 FETCH: 0000001f081504a0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001f01 SEMAPHORE 0000001e 014a0aa0 00000000 00000002

[ 3202.990972] 499-17000000.gp10b, pid 1760, refs: 2: 
[ 3202.995691] channel status:  in use idle not busy
[ 3203.000594] RAMFC : TOP: 800000010065169c PUT: 000000010065169c GET: 000000010065169c FETCH: 000000010065169c
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3203.024063] 500-17000000.gp10b, pid 1760, refs: 2: 
[ 3203.028784] channel status:  in use idle not busy
[ 3203.033681] RAMFC : TOP: 8000000100530294 PUT: 0000000100530294 GET: 0000000100530294 FETCH: 0000000100530294
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3203.057167] 501-17000000.gp10b, pid 1760, refs: 2: 
[ 3203.061886] channel status:  in use idle not busy
[ 3203.066800] RAMFC : TOP: 8000001f0832af00 PUT: 0000001f0832af00 GET: 0000001f0832af00 FETCH: 0000001f0832af00
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001c01 SEMAPHORE 00000001 00017ffc 00011d46 00000004

[ 3203.090297] 502-17000000.gp10b, pid 1760, refs: 2: 
[ 3203.095020] channel status:  in use idle not busy
[ 3203.099924] RAMFC : TOP: 80000001003f7de0 PUT: 00000001003f7de0 GET: 00000001003f7de0 FETCH: 00000001003f7de0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001901 SEMAPHORE 00000001 0000fbe0 000034d2 00000004

[ 3203.123412] 503-17000000.gp10b, pid 1760, refs: 2: 
[ 3203.128134] channel status:  in use idle not busy
[ 3203.133077] RAMFC : TOP: 8000000100277c3c PUT: 0000000100277c3c GET: 0000000100277c3c FETCH: 0000000100277c3c
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000001 0000fbd0 00004778 00000004

[ 3203.156586] 504-17000000.gp10b, pid 1760, refs: 2: 
[ 3203.161305] channel status:  in use idle not busy
[ 3203.166204] RAMFC : TOP: 8000001f08000060 PUT: 0000001f08000060 GET: 0000001f08000060 FETCH: 0000001f08000060
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001701 SEMAPHORE 0000001e 01090aa0 00000000 00000002

[ 3203.189704] 505-17000000.gp10b, pid 1441, refs: 2: 
[ 3203.194424] channel status:  in use idle not busy
[ 3203.199321] RAMFC : TOP: 8000001f080142b0 PUT: 0000001f080142b0 GET: 0000001f080142b0 FETCH: 0000001f080142b0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001501 SEMAPHORE 0000001e 03950010 00000001 00001001

[ 3203.222833] 506-17000000.gp10b, pid 846, refs: 2: 
[ 3203.227466] channel status:  in use idle not busy
[ 3203.232359] RAMFC : TOP: 8000001f081427a8 PUT: 0000001f081427a8 GET: 0000001f081427a8 FETCH: 0000001f081427a8
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001301 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3203.255831] 507-17000000.gp10b, pid 846, refs: 6: 
[ 3203.260466] channel status: not in use idle not busy
[ 3203.265621] RAMFC : TOP: 8000001f08038500 PUT: 0000001f08038500 GET: 0000001f08038500 FETCH: 0000001f08038500
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001201 SEMAPHORE 0000000d fc001000 04e004b0 01100002

[ 3203.289103] 508-17000000.gp10b, pid 850, refs: 2: 
[ 3203.293736] channel status:  in use idle not busy
[ 3203.298634] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3203.322136] 509-17000000.gp10b, pid 850, refs: 2: 
[ 3203.326767] channel status:  in use idle not busy
[ 3203.331664] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3203.355134] 510-17000000.gp10b, pid 850, refs: 2: 
[ 3203.359766] channel status:  in use idle not busy
[ 3203.364677] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3203.388163] 511-17000000.gp10b, pid 850, refs: 2: 
[ 3203.392800] channel status:  in use idle not busy
[ 3203.397697] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000
               HEADER: 60400000 COUNT: 00000000
               SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000

[ 3203.421388] gk20a 17000000.gp10b: gk20a_fifo_handle_mmu_fault: fake mmu fault on engine 0, engine subid 0 (gpc), client 12 (rast), addr 0x0000001e:0x04000000, type 2 (pte), info 0x00010c02,inst_ptr 0x1da751000
               
[ 3203.447119] gk20a 17000000.gp10b: gk20a_fifo_set_ctx_mmu_error_tsg: TSG 7 generated a mmu fault
[ 3203.455950] gk20a 17000000.gp10b: gk20a_fifo_set_ctx_mmu_error_tsg: TSG 0 generated a mmu fault
[ 3203.464672] ---- mlocks ----

[ 3203.469075] ---- syncpts ----
[ 3203.472097] id 4 (disp_d) min 18656 max 18656 refs 1 (previous client : )
[ 3203.478895] id 5 (disp_e) min 2 max 2 refs 1 (previous client : )
[ 3203.484994] id 7 (vblank1) min 191976 max 0 refs 1 (previous client : )
[ 3203.491665] id 18 (17000000.gp10b_507) min 47188 max 47188 refs 1 (previous client : )
[ 3203.499614] id 19 (17000000.gp10b_506) min 846 max 846 refs 1 (previous client : )
[ 3203.507245] id 21 (17000000.gp10b_505) min 4688 max 4688 refs 1 (previous client : 17000000.gp10b_505)
[ 3203.516613] id 23 (17000000.gp10b_504) min 18 max 18 refs 1 (previous client : 17000000.gp10b_504)
[ 3203.525621] id 25 (17000000.gp10b_502) min 74 max 74 refs 1 (previous client : )
[ 3203.533026] id 28 (17000000.gp10b_501) min 36500 max 36500 refs 1 (previous client : )
[ 3203.540984] id 31 (17000000.gp10b_498) min 354620 max 354620 refs 1 (previous client : 17000000.gp10b_498)
[ 3203.550638] id 32 (17000000.gp10b_497) min 212284 max 212284 refs 1 (previous client : 17000000.gp10b_497)
[ 3203.560326] id 33 (154c0000.nvenc_camerad_0) min 36514 max 36514 refs 1 (previous client : 15340000.vic_camerad_0)
[ 3203.570673] id 34 (15340000.vic_camerad_0) min 438192 max 438192 refs 1 (previous client : 15340000.vic_camerad_0)
[ 3203.581054] id 35 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3203.591607] id 36 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3203.602128] id 37 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3203.612680] id 38 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3203.623229] id 39 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3203.633764] id 40 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3203.644308] id 41 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3203.654839] id 42 (15480000.nvdec_camerad_0) min 36516 max 36516 refs 1 (previous client : 15480000.nvdec_camerad_0)
[ 3203.665371] id 43 (15340000.vic_camerad_0) min 54771 max 54771 refs 1 (previous client : 15340000.vic_camerad_0)

[ 3203.677676] ---- channels ----
[ 3203.680745] 
               channel 1 - 15820000.se

[ 3203.687207] NvHost basic channel registers:
[ 3203.691413] CMDFIFO_STAT_0:  00002040
[ 3203.695095] CMDFIFO_RDATA_0: 04900948
[ 3203.698779] CMDP_OFFSET_0:   00000000
[ 3203.702459] CMDP_CLASS_0:    00000000
[ 3203.706141] CHANNELSTAT_0:   00000000
[ 3203.709820] The CDMA sync queue is empty.

[ 3203.715337] 
               channel 2 - 15830000.se

[ 3203.721799] NvHost basic channel registers:
[ 3203.726002] CMDFIFO_STAT_0:  00002040
[ 3203.729681] CMDFIFO_RDATA_0: 80008600
[ 3203.733339] CMDP_OFFSET_0:   00000000
[ 3203.737024] CMDP_CLASS_0:    00000000
[ 3203.740702] CHANNELSTAT_0:   00000000
[ 3203.744390] The CDMA sync queue is empty.

[ 3203.749928] 
               channel 3 - 15840000.se

[ 3203.756384] NvHost basic channel registers:
[ 3203.760591] CMDFIFO_STAT_0:  00002040
[ 3203.764270] CMDFIFO_RDATA_0: 00dd8101
[ 3203.767958] CMDP_OFFSET_0:   00000000
[ 3203.771641] CMDP_CLASS_0:    00000000
[ 3203.775331] CHANNELSTAT_0:   00000000
[ 3203.779011] The CDMA sync queue is empty.

[ 3203.784530] 
               ---- host general irq ----

[ 3203.791252] sync_intc0mask = 0x00000001
[ 3203.795112] sync_intmask = 0x50000003
[ 3203.798790] 
               ---- host syncpt irq mask ----

[ 3203.805857] 
               ---- host syncpt irq status ----

[ 3203.813100] syncpt_thresh_cpu0_int_status(0) = 0x00000000
[ 3203.818547] syncpt_thresh_cpu0_int_status(1) = 0x00000000
[ 3203.823965] syncpt_thresh_cpu0_int_status(2) = 0x00000000
[ 3203.829383] syncpt_thresh_cpu0_int_status(3) = 0x00000000
[ 3203.834800] syncpt_thresh_cpu0_int_status(4) = 0x00000000
[ 3203.840215] syncpt_thresh_cpu0_int_status(5) = 0x00000000
[ 3203.845626] syncpt_thresh_cpu0_int_status(6) = 0x00000000
[ 3203.851043] syncpt_thresh_cpu0_int_status(7) = 0x00000000
[ 3203.856456] syncpt_thresh_cpu0_int_status(8) = 0x00000000
[ 3203.861872] syncpt_thresh_cpu0_int_status(9) = 0x00000000
[ 3203.867287] syncpt_thresh_cpu0_int_status(10) = 0x00000000
[ 3203.872796] syncpt_thresh_cpu0_int_status(11) = 0x00000000
[ 3203.878294] syncpt_thresh_cpu0_int_status(12) = 0x00000000
[ 3203.883799] syncpt_thresh_cpu0_int_status(13) = 0x00000000
[ 3203.889299] syncpt_thresh_cpu0_int_status(14) = 0x00000000
[ 3203.894801] syncpt_thresh_cpu0_int_status(15) = 0x00000000
[ 3203.900300] syncpt_thresh_cpu0_int_status(16) = 0x00000000
[ 3203.905801] syncpt_thresh_cpu0_int_status(17) = 0x00000000
[ 3203.911303] 17000000.gp10b pbdma 0: 
[ 3203.914725] id: 0 (tsg), next_id: 0 (tsg) chan status: invalid
[ 3203.920752] PUT: 0000001f08038540 GET: 0000001f08038540 FETCH: 0000047c HEADER: 60400000

[ 3203.930374] 17000000.gp10b eng 0: 
[ 3203.933620] id: 0 (tsg), next_id: 0 (tsg), ctx status: invalid 

[ 3203.941036] 17000000.gp10b eng 1: 
[ 3203.944287] id: 7 (tsg), next_id: 7 (tsg), ctx status: invalid 

[ 3203.953618] 497-17000000.gp10b, pid 20801, refs: 3: 
[ 3203.958413] channel status: not in use idle not busy
[ 3203.963566] RAMFC : TOP: 8000001f082c9d40 PUT: 0000001f082c9d40 GET: 0000001f082c9d40 FETCH: 0000001f082c9d40
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00002001 SEMAPHORE 0000001e 01770aa0 00000000 00000002

[ 3203.987048] 498-17000000.gp10b, pid 20800, refs: 2: 
[ 3203.991859] channel status:  in use idle not busy
[ 3203.996754] RAMFC : TOP: 8000001f081504a0 PUT: 0000001f081504a0 GET: 0000001f081504a0 FETCH: 0000001f081504a0
               HEADER: 60400000 COUNT: 80000000
               SYNCPOINT 00000000 00001f01 SEMAPHORE 0000001e 014a0aa0 00000000 00000002

[ 3204.020233] 499-17000000.gp10b, pid 1760, refs: 2: 
[ 3204

Hi,
For information, please share your release version($ head -1 /etc/nv_tegra_release)
Also do you run TenserRT or CUDA code in your implementation? If yes, please eliminate it and check if the issue is till there. There are prints about vic, nvdec, gk20a(GPU) and it can bring some information to eliminate GPU executions.

Hi,
my release verison as follow:

R28 (release), REVISION: 2.1, GCID: 11272647, BOARD: t186ref, EABI: aarch64, DATE: Thu May 17 07:29:06 UTC 2018

In my implementation, will use CUDA for video stitching, I will eliminate it and test whether the issue is still exist.