[212642.850906] nvgpu: 17000000.gp10b gk20a_fifo_handle_pbdma_intr_0:2689 [ERR] PBDMA intr PBENTRY invld Error [212642.850917] nvgpu: 17000000.gp10b gk20a_fifo_handle_pbdma_intr_0:2705 [ERR] pbdma_intr_0(0):0x00040000 PBH: 2010000c SHADOW: 0000000f gp shadow0: 003a71a8 gp shadow1: 00036201M0: 80410185 00000000 00000000 00000000 [212642.850925] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 507 [212642.850928] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 506 [212642.850931] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 505 [212642.850934] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 504 [212642.851284] nvgpu: 17000000.gp10b gk20a_fifo_handle_pbdma_intr_0:2689 [ERR] PBDMA intr PBENTRY invld Error [212642.851293] nvgpu: 17000000.gp10b gk20a_fifo_handle_pbdma_intr_0:2705 [ERR] pbdma_intr_0(0):0x00040000 PBH: 20500000 SHADOW: 00300000 gp shadow0: 003a71a8 gp shadow1: 00036201M0: 00000000 00000000 00000000 00000000 [212642.851298] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 507 [212642.851301] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 506 [212642.851304] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 505 [212642.851307] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 504 [212642.851635] ---- mlocks ---- [212642.851650] ---- syncpts ---- [212642.851942] ---- channels ---- [212642.851954] channel 2 - 15820000.se [212642.851956] NvHost basic channel registers: [212642.851958] CMDFIFO_STAT_0: 00002040 [212642.851960] CMDFIFO_RDATA_0: 00c860c0 [212642.851963] CMDP_OFFSET_0: 00000000 [212642.851966] CMDP_CLASS_0: 00000000 [212642.851967] CHANNELSTAT_0: 00000000 [212642.851969] The CDMA sync queue is empty. [212642.851973] channel 3 - 15830000.se [212642.851975] NvHost basic channel registers: [212642.851976] CMDFIFO_STAT_0: 00002040 [212642.851978] CMDFIFO_RDATA_0: 60200c0c [212642.851981] CMDP_OFFSET_0: 00000000 [212642.851983] CMDP_CLASS_0: 00000000 [212642.851984] CHANNELSTAT_0: 00000000 [212642.851986] The CDMA sync queue is empty. [212642.851990] channel 4 - 15840000.se [212642.851991] NvHost basic channel registers: [212642.851993] CMDFIFO_STAT_0: 00002040 [212642.851995] CMDFIFO_RDATA_0: 71012538 [212642.851997] CMDP_OFFSET_0: 00000000 [212642.851999] CMDP_CLASS_0: 00000000 [212642.852001] CHANNELSTAT_0: 00000000 [212642.852002] The CDMA sync queue is empty. [212642.852008] ---- host general irq ---- [212642.852010] sync_intc0mask = 0x00000001 [212642.852012] sync_intmask = 0x50000003 [212642.852013] ---- host syncpt irq mask ---- [212642.852015] ---- host syncpt irq status ---- [212642.852017] syncpt_thresh_cpu0_int_status(0) = 0x00000000 [212642.852020] syncpt_thresh_cpu0_int_status(1) = 0x00000000 [212642.852022] syncpt_thresh_cpu0_int_status(2) = 0x00000000 [212642.852024] syncpt_thresh_cpu0_int_status(3) = 0x00000000 [212642.852025] syncpt_thresh_cpu0_int_status(4) = 0x00000000 [212642.852027] syncpt_thresh_cpu0_int_status(5) = 0x00000000 [212642.852029] syncpt_thresh_cpu0_int_status(6) = 0x00000000 [212642.852031] syncpt_thresh_cpu0_int_status(7) = 0x00000000 [212642.852033] syncpt_thresh_cpu0_int_status(8) = 0x00000000 [212642.852035] syncpt_thresh_cpu0_int_status(9) = 0x00000000 [212642.852037] syncpt_thresh_cpu0_int_status(10) = 0x00000000 [212642.852039] syncpt_thresh_cpu0_int_status(11) = 0x00000000 [212642.852041] syncpt_thresh_cpu0_int_status(12) = 0x00000000 [212642.852043] syncpt_thresh_cpu0_int_status(13) = 0x00000000 [212642.852045] syncpt_thresh_cpu0_int_status(14) = 0x00000000 [212642.852047] syncpt_thresh_cpu0_int_status(15) = 0x00000000 [212642.852049] syncpt_thresh_cpu0_int_status(16) = 0x00000000 [212642.852051] syncpt_thresh_cpu0_int_status(17) = 0x00000000 [212642.852055] gp10b pbdma 0: [212642.852057] id: 4 (tsg), next_id: 4 (tsg) chan status: valid [212642.852067] PBDMA_PUT: 00000001003a7508 PBDMA_GET: 00000001003a71f0 GP_PUT: 00000efc GP_GET: 00000efc FETCH: 00000efc HEADER: 20100000 HDR: 00000001 SHADOW0: 003a71a8 SHADOW1: 00036201 [212642.852071] gp10b eng 0: [212642.852073] id: 4 (tsg), next_id: 4 (tsg), ctx status: valid [212642.852075] busy [212642.852078] gp10b eng 1: [212642.852080] id: 5 (tsg), next_id: 5 (tsg), ctx status: valid [212642.852251] 503-gp10b, pid 2551, refs 2, deterministic: [212642.852254] channel status: in use idle not busy [212642.852258] RAMFC : TOP: 0000000000000000 PUT: 00000001006a09f0 GET: 00000001006a09f0 FETCH: 00000201006a09f0 HEADER: 60400000 COUNT: 84000000 SYNCPOINT 00000000 00000000 SEMAPHORE 0000000f 00510000 ffffffff 28000010 [212642.852263] 504-gp10b, pid 2551, refs 2, deterministic: [212642.852265] channel status: not in use idle not busy [212642.852269] RAMFC : TOP: 0000000000000000 PUT: 0000000100550294 GET: 0000000100550294 FETCH: 0000020100550294 HEADER: 60400000 COUNT: 84000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212642.852273] 505-gp10b, pid 2551, refs 2, deterministic: [212642.852275] channel status: not in use idle not busy [212642.852278] RAMFC : TOP: 0000000000000000 PUT: 000000010045063c GET: 000000010045063c FETCH: 000002010045063c HEADER: 60400000 COUNT: 84000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212642.852282] 506-gp10b, pid 2551, refs 2, deterministic: [212642.852284] channel status: not in use on_pbdma_and_eng busy [212642.852288] RAMFC : TOP: 0000000000000000 PUT: 00000001003a71a8 GET: 00000001003a71a8 FETCH: 00000201003a71a8 HEADER: 20510184 COUNT: 84000001 SYNCPOINT 00000000 00000000 SEMAPHORE 00000001 00047e34 21dd8ee6 00000004 [212642.852291] 507-gp10b, pid 2551, refs 2, deterministic: [212642.852293] channel status: not in use idle not busy [212642.852297] RAMFC : TOP: 0000000000000000 PUT: 000000010026eec4 GET: 000000010026eec4 FETCH: 000002010026eec4 HEADER: 60400000 COUNT: 84000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000001 0002ffb0 00000005 00001004 [212642.852301] 508-gp10b, pid 2376, refs 2: [212642.852303] channel status: in use idle not busy [212642.852306] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000 HEADER: 60400000 COUNT: 00000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212642.852310] 509-gp10b, pid 2376, refs 2: [212642.852312] channel status: in use idle not busy [212642.852315] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000 HEADER: 60400000 COUNT: 00000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212642.852319] 510-gp10b, pid 2376, refs 2: [212642.852321] channel status: in use idle not busy [212642.852324] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000 HEADER: 60400000 COUNT: 00000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212642.852328] 511-gp10b, pid 2376, refs 2: [212642.852330] channel status: in use idle not busy [212642.852333] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000 HEADER: 60400000 COUNT: 00000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212645.852871] nvgpu: 17000000.gp10b __nvgpu_timeout_expired_msg_cpu:94 [ERR] Timeout detected @ gm20b_fifo_trigger_mmu_fault+0x130/0x240 [nvgpu] [212645.852877] nvgpu: 17000000.gp10b gm20b_fifo_trigger_mmu_fault:126 [ERR] mmu fault timeout [212645.853148] nvgpu: 17000000.gp10b gk20a_fifo_handle_mmu_fault_locked:1721 [ERR] fake mmu fault on engine 0, engine subid 1 (hub), client 1 (ce0), addr 0xd45422143000, type 0 (pde), access_type 0x00000002,inst_ptr 0xb0e384000 [212645.856407] nvgpu: 17000000.gp10b gk20a_fifo_handle_pbdma_intr_0:2689 [ERR] PBDMA intr PBENTRY invld Error [212645.856411] nvgpu: 17000000.gp10b gk20a_fifo_handle_pbdma_intr_0:2689 [ERR] PBDMA intr [ENGINE] Error [212645.856421] nvgpu: 17000000.gp10b gk20a_fifo_handle_pbdma_intr_0:2705 [ERR] pbdma_intr_0(0):0x01040000 PBH: 20100000 SHADOW: 00000001 gp shadow0: 003a71a8 gp shadow1: 00036201M0: 00000000 00000000 00000000 00000000 [212645.856426] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 507 [212645.856429] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 506 [212645.856432] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 505 [212645.856435] nvgpu: 17000000.gp10b nvgpu_set_error_notifier_locked:137 [ERR] error notifier set to 32 for ch 504 [212645.857133] ---- mlocks ---- [212645.857148] ---- syncpts ---- [212645.857412] ---- channels ---- [212645.857423] channel 2 - 15820000.se [212645.857425] NvHost basic channel registers: [212645.857428] CMDFIFO_STAT_0: 00002040 [212645.857429] CMDFIFO_RDATA_0: 00c860c0 [212645.857432] CMDP_OFFSET_0: 00000000 [212645.857434] CMDP_CLASS_0: 00000000 [212645.857436] CHANNELSTAT_0: 00000000 [212645.857438] The CDMA sync queue is empty. [212645.857442] channel 3 - 15830000.se [212645.857443] NvHost basic channel registers: [212645.857445] CMDFIFO_STAT_0: 00002040 [212645.857447] CMDFIFO_RDATA_0: 60200c0c [212645.857450] CMDP_OFFSET_0: 00000000 [212645.857451] CMDP_CLASS_0: 00000000 [212645.857453] CHANNELSTAT_0: 00000000 [212645.857455] The CDMA sync queue is empty. [212645.857459] channel 4 - 15840000.se [212645.857460] NvHost basic channel registers: [212645.857462] CMDFIFO_STAT_0: 00002040 [212645.857464] CMDFIFO_RDATA_0: 71012538 [212645.857466] CMDP_OFFSET_0: 00000000 [212645.857468] CMDP_CLASS_0: 00000000 [212645.857470] CHANNELSTAT_0: 00000000 [212645.857472] The CDMA sync queue is empty. [212645.857478] ---- host general irq ---- [212645.857480] sync_intc0mask = 0x00000001 [212645.857482] sync_intmask = 0x50000003 [212645.857483] ---- host syncpt irq mask ---- [212645.857484] ---- host syncpt irq status ---- [212645.857487] syncpt_thresh_cpu0_int_status(0) = 0x00000000 [212645.857489] syncpt_thresh_cpu0_int_status(1) = 0x00000000 [212645.857491] syncpt_thresh_cpu0_int_status(2) = 0x00000000 [212645.857493] syncpt_thresh_cpu0_int_status(3) = 0x00000000 [212645.857495] syncpt_thresh_cpu0_int_status(4) = 0x00000000 [212645.857497] syncpt_thresh_cpu0_int_status(5) = 0x00000000 [212645.857499] syncpt_thresh_cpu0_int_status(6) = 0x00000000 [212645.857501] syncpt_thresh_cpu0_int_status(7) = 0x00000000 [212645.857503] syncpt_thresh_cpu0_int_status(8) = 0x00000000 [212645.857505] syncpt_thresh_cpu0_int_status(9) = 0x00000000 [212645.857507] syncpt_thresh_cpu0_int_status(10) = 0x00000000 [212645.857509] syncpt_thresh_cpu0_int_status(11) = 0x00000000 [212645.857511] syncpt_thresh_cpu0_int_status(12) = 0x00000000 [212645.857513] syncpt_thresh_cpu0_int_status(13) = 0x00000000 [212645.857515] syncpt_thresh_cpu0_int_status(14) = 0x00000000 [212645.857517] syncpt_thresh_cpu0_int_status(15) = 0x00000000 [212645.857518] syncpt_thresh_cpu0_int_status(16) = 0x00000000 [212645.857520] syncpt_thresh_cpu0_int_status(17) = 0x00000000 [212645.857524] gp10b pbdma 0: [212645.857527] id: 4 (tsg), next_id: 4 (tsg) chan status: invalid [212645.857537] PBDMA_PUT: 00000001003a7508 PBDMA_GET: 00000001003a71f0 GP_PUT: 00000efc GP_GET: 00000efc FETCH: 00000efc HEADER: 60400000 HDR: 00000001 SHADOW0: 003a71a8 SHADOW1: 00036201 [212645.857541] gp10b eng 0: [212645.857544] id: 4 (tsg), next_id: 4 (tsg), ctx status: invalid [212645.857547] gp10b eng 1: [212645.857549] id: 5 (tsg), next_id: 5 (tsg), ctx status: invalid [212645.857702] 504-gp10b, pid 2551, refs 2, deterministic: [212645.857704] channel status: not in use idle not busy [212645.857709] RAMFC : TOP: 0000000000000000 PUT: 0000000100550294 GET: 0000000100550294 FETCH: 0000020100550294 HEADER: 60400000 COUNT: 84000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212645.857714] 505-gp10b, pid 2551, refs 2, deterministic: [212645.857716] channel status: not in use idle not busy [212645.857720] RAMFC : TOP: 0000000000000000 PUT: 000000010045063c GET: 000000010045063c FETCH: 000002010045063c HEADER: 60400000 COUNT: 84000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212645.857724] 506-gp10b, pid 2551, refs 2, deterministic: [212645.857726] channel status: not in use pending busy [212645.857730] RAMFC : TOP: 0000000000000000 PUT: 00000001003a7508 GET: 00000001003a71f0 FETCH: 00000201003a7508 HEADER: 60400000 COUNT: 04550000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000001 00047e34 21dd8ee6 00000004 [212645.857733] 507-gp10b, pid 2551, refs 2, deterministic: [212645.857735] channel status: not in use idle not busy [212645.857739] RAMFC : TOP: 0000000000000000 PUT: 000000010026eec4 GET: 000000010026eec4 FETCH: 000002010026eec4 HEADER: 60400000 COUNT: 84000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000001 0002ffb0 00000005 00001004 [212645.857743] 508-gp10b, pid 2376, refs 2: [212645.857745] channel status: in use idle not busy [212645.857748] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000 HEADER: 60400000 COUNT: 00000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212645.857752] 509-gp10b, pid 2376, refs 2: [212645.857754] channel status: in use idle not busy [212645.857757] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000 HEADER: 60400000 COUNT: 00000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212645.857761] 510-gp10b, pid 2376, refs 2: [212645.857763] channel status: in use idle not busy [212645.857766] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000 HEADER: 60400000 COUNT: 00000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212645.857770] 511-gp10b, pid 2376, refs 2: [212645.857772] channel status: in use idle not busy [212645.857775] RAMFC : TOP: 0000000000000000 PUT: 0000000000000000 GET: 0000000000000000 FETCH: 0000000000000000 HEADER: 60400000 COUNT: 00000000 SYNCPOINT 00000000 00000000 SEMAPHORE 00000000 00000000 00000000 00000000 [212645.857799] nvgpu: 17000000.gp10b gk20a_fifo_handle_mmu_fault_locked:1721 [ERR] mmu fault on engine 0, engine subid 1 (hub), client 1 (ce0), addr 0xd45422143000, type 0 (pde), access_type 0x00000002,inst_ptr 0xb0e384000 [212645.860898] nvgpu: 17000000.gp10b gk20a_fifo_handle_mmu_fault_locked:1827 [ERR] couldn't locate channel for mmu fault [212645.860936] nvgpu: 17000000.gp10b fifo_error_isr:2605 [ERR] channel reset initiated from fifo_error_isr; intr=0x10000000