Need help with Shmoo test tool V1.0.2 (nvhost KernelDriverNotFound)

I was trying to run Shmoo memory test tool (V1.0.2) on a Windows 7 PC to test our custom TK1 board. I think I have everything set up correctly based on what’s described in chapter 3 and 5.1~5.8 of the document. However when I ran runme_instead_TK1_Sanity.bat, it complained about “KernelDriverNotFound” and all test logs (.out files) showed “Crashed”. What am I missing here??

DefResult(FindState([0]), Crashed); # 1

Welcome to...
                _      _  _                  ___   ___  __
  /\/\    ___  | |__  (_)| |  ___   /\/\    /___\ /   \/ _\
 /    \  / _ \ | '_ \ | || | / _ \ /    \  //  /// /\ /\ \
/ /\/\ \| (_) || |_) || || ||  __// /\/\ \/ \_/// /_// _\ \
\/    \/ \___/ |_.__/ |_||_| \___|\/    \/\___//___,'  \__/
Copyright 2008 by NVIDIA Corporation.  All rights reserved.  All
  information contained herein is proprietary and confidential to NVIDIA
  Corporation.  Any use, reproduction, or disclosure without the written
  permission of NVIDIA Corporation is prohibited.


### Intermediate results printed to the .out file###

Setting PLLM828##Rdv##c1290i1300h1100 State:
   Rdv: 24
spawning nvhost: ['C:\\Tmp\\ShmooPackageV1.0.2_Public\\nvhost.exe', '-C', '50000
', '--avp', 'tests\\debug_nvt124_rvds_armv4\\wfblit_lite.axf', '--sdram', 'c:\\u
sers\\a000726\\appdata\\local\\temp\\tmp3k4aiew', '-t', '30', '--port', 'None',
'--chip', 't124', '--skip-reset', '--', '-fc', '0,50,0', '-vic', '312', '-reg',
'1', '-m', '0xbf800000', '-z', '16', '-s', '0xffffffff', '-n', '828##Rdv##c1290i
1300h1100', '-b', 'i', '--']
nvhost: ========================================
nvhost: Found --chip parameter
Error ParseFieldName: (null)
Error processing statement: SDRAM[0].PllMSetupControl=0x00000000
Error ParseFieldName: (null)
Error processing statement: SDRAM[0].EmcBctSpare1=0x00000000
nvhost:   ...success!  Found t124
nvhost: ========================================
nvblserver: Loading "tests\debug_nvt124_rvds_armv4\wfblit_lite.axg" via usb:...
Bootloader stream send failed!
Fail.
WARNING: Ignoring auto-detect due to --chip parameter
host_stderr: Error 00030012 (KernelDriverNotFound) at c:/workspace/src/t124-brin
gup/core-private/drivers/nvhost/nvhost.c:4704
host_stderr: Error 00030012 (KernelDriverNotFound) at c:/workspace/src/t124-brin
gup/core-private/drivers/nvhost/nvhost.c:5416
error: kernel driver not found
Traceback (most recent call last):
  File "shmoofw.py", line 549, in run_wfblit
  File "extras\scripts\wfblit_lite_shmoo.py", line 1574, in run_wfblit_lite
    testargs=options.testargs.split())
  File ".\wfblit_lite.py", line 83, in spawn
  File ".\nvhosttest.py", line 280, in __init__
  File "C:\Anaconda2\lib\socket.py", line 206, in accept
    sock, addr = self._sock.accept()
timeout: timed out
Result: Crashed

Estimated End Time: Thu Aug 11 17:21:31 2016

### Intermediate results printed to the .out file###

Setting PLLM828##Rdv##c1290i1300h1100 State:
   Rdv: 24 (no-op)
spawning nvhost: ['C:\\Tmp\\ShmooPackageV1.0.2_Public\\nvhost.exe', '-C', '50001
', '--avp', 'tests\\debug_nvt124_rvds_armv4\\wfblit_lite.axf', '--sdram', 'c:\\u
sers\\a000726\\appdata\\local\\temp\\tmpnj8bukw', '-t', '30', '--port', 'None',
'--chip', 't124', '--skip-reset', '--', '-fc', '0,50,0', '-vic', '312', '-reg',
'1', '-m', '0xbf800000', '-z', '16', '-s', '0xffffffff', '-n', '828##Rdv##c1290i
1300h1100', '-b', 'i', '--']
nvhost: ========================================
nvhost: Found --chip parameter
Error ParseFieldName: (null)
Error processing statement: SDRAM[0].PllMSetupControl=0x00000000
Error ParseFieldName: (null)
Error processing statement: SDRAM[0].EmcBctSpare1=0x00000000
nvhost:   ...success!  Found t124
nvhost: ========================================
nvblserver: Loading "tests\debug_nvt124_rvds_armv4\wfblit_lite.axg" via usb:...
Bootloader stream send failed!
Fail.
WARNING: Ignoring auto-detect due to --chip parameter
host_stderr: Error 00030012 (KernelDriverNotFound) at c:/workspace/src/t124-brin
gup/core-private/drivers/nvhost/nvhost.c:4704
host_stderr: Error 00030012 (KernelDriverNotFound) at c:/workspace/src/t124-brin
gup/core-private/drivers/nvhost/nvhost.c:5416
error: kernel driver not found
Traceback (most recent call last):
  File "shmoofw.py", line 549, in run_wfblit
  File "extras\scripts\wfblit_lite_shmoo.py", line 1574, in run_wfblit_lite
    testargs=options.testargs.split())
  File ".\wfblit_lite.py", line 83, in spawn
  File ".\nvhosttest.py", line 280, in __init__
  File "C:\Anaconda2\lib\socket.py", line 206, in accept
    sock, addr = self._sock.accept()
timeout: timed out
Result: Crashed

Estimated End Time: Thu Aug 11 17:22:04 2016

===SHMOO COMPLETE===
python -u mods.py extras\scripts\wfblit_lite_shmoo.py --name 828##Rdv##c1290i145
0h1100 --plltype "PLLM" --pdiv 1 --path .\ --corev 1290 --ddrv 1450 --ddrvcore1
0 --vrefca0 0 --vrefdq0 0 --vrefca1 0 --vrefdq1 0 --vddhs 1100 --vddrtc 1290 --s
vop 0 --ddrFreq 828.000000 --powercycle "enabled" --timeout 30 --check_autocal_d
ll 0 --data_check_mask 4294967295 --pmu AMS --processor_board PM375 --transport
"usb" --port "None" --shmoo_cfg "shmoo_cfg.txt" --verbose 0 --testargs " -fc 0,5
0,0 -vic 312 -reg 1 " --refFreq 12 --memoryBase 3212836864 --memsize 16 --sdram
extras\config_files\CFG_792MHz.cfg | mtee.exe /+ .\828PLLM_c1290i1450h1100_Rdv.l
og.txt

Just for confirmation:
Did you install the usb driver in this tool package?
Did you check the phidget’s setting is same as AppNote?
Can you see the device in Device Manager?
Did you make sure TK1 is in Force Recovery Mode before test?

Yes, usbpcdriver is installed. I can see “NVIDIA USB Boot-recovery driver for Mobile devices” showing up in Device Manager after plugging in the USB cable. And I think it only shows up when TK1 is under Force Recovery Mode.

[url]https://drive.google.com/file/d/0B9GKMo5OyzQma2d1dm1JdWZBcTg/view[/url]

On the other hand, I also think I have Phidget tool set up according to the documentation.

[url]https://drive.google.com/file/d/0B9GKMo5OyzQmTFpScXd6OWhpdlE/view[/url]

I tried to install Shmoo memory test tool on another Windows 7 PC and now it works. I think the thing I was missing previously was the “ADB driver” (from Android SDK). Previously I thought I didn’t need that since I was testing a L4T board rather than a TK1 Android board. But that’s not right. Obviously Shmoo test does requrie the ADB driver.

I now have the 924MHz test result of our custom TK1 board. (It took almost 10 hours to finish testing of this single frequency!)

Trumany, it’d be highly appreciated if you can help to review this output file and tell me if you have anything wrong.

[url]https://drive.google.com/file/d/0B9GKMo5OyzQmSDhCWnN2QjN6Zms/view?usp=sharing[/url]

The 924MHz result seems normal, you can choose and pick value to generate CFG following AppNote instruction.