Tesla K40c: Linux Kernel crashed once run 'nvidia-smi'

Hi all,

My server is Lenovo x3650 M5 with 900 AC, and the GPU is Tesla K40c. And my current Env. is: CentOS 7, Cuda 7.5 (driver 352.39). After I install the driver and run ‘nvidia-smi’, the kernel is crashed. And the same situation is on Ubuntu 14.04(linux kernel is 3.13). And I also try to upgrade the driver to 352.99, but still make the system crashed both on CentOS 7 and Ubuntu 14.04. And the kdump message on both OS is the same:

Any tips for this issue, it is very appreciated!

1671 [ 49.353839] virbr0: port 1(virbr0-nic) entered disabled state
1672 [ 71.635748] systemd-readahead[963]: open(/var/tmp/initramfs.Vg5FyY/usr/bin/loginctl) failed: Too many levels of symbolic links
1673 [ 71.645254] systemd-readahead[963]: open(/var/tmp/initramfs.Vg5FyY/usr/lib/systemd/system/dracut-emergency.service) failed: Too many levels of symbolic links
1674 [ 110.513253] nvidia 0000:06:00.0: irq 126 for MSI/MSI-X
1675 [ 111.687839] NVRM: GPU at PCI:0000:06:00: GPU-3c55dda4-f7c4-3e01-e150-eeabf00703ee
1676 [ 111.687843] NVRM: Xid (PCI:0000:06:00): 62, 15a4(4d98) 00000000 00000000
1677 [ 115.725109] BUG: unable to handle kernel NULL pointer dereference at (null)
1678 [ 115.725178] IP: [] _nv003025rm+0x34/0xb0 [nvidia]
1679 [ 115.725320] PGD 1027874067 PUD 1008608067 PMD 0
1680 [ 115.725359] Oops: 0000 [#1] SMP
1681 [ 115.725389] Modules linked in: xt_CHECKSUM ipt_MASQUERADE nf_nat_masquerade_ipv4 tun ip6t_rpfilter ip6t_REJECT ipt_REJECT xt_conntrack ebtable_nat ebtable_broute bridge stp llc ebtable_filter ebtables ip6table_nat nf_conntrack_ipv6 nf_defrag_ipv6 nf_nat_ipv6 ip6
1682 [ 115.725982] acpi_pad nfsd auth_rpcgss nfs_acl lockd grace sunrpc ip_tables xfs sd_mod crc_t10dif crct10dif_generic mgag200 syscopyarea sysfillrect sysimgblt i2c_algo_bit drm_kms_helper crct10dif_pclmul crct10dif_common crc32c_intel bnx2x ttm drm tg3 mdio i2c_co
1683 [ 115.726252] CPU: 16 PID: 13887 Comm: nvidia-smi Tainted: P OE ------------ 3.10.0-327.el7.x86_64 #1
1684 [ 115.726312] Hardware name: LENOVO System x3650 M5: -[5462I4Y]-/00MU899, BIOS -[TCE106KUS-1.10]- 04/17/2015
1685 [ 115.726370] task: ffff881008464500 ti: ffff881027898000 task.ti: ffff881027898000
1686 [ 115.726415] RIP: 0010:[] [] _nv003025rm+0x34/0xb0 [nvidia]
1687 [ 115.726531] RSP: 0018:ffff88102789b988 EFLAGS: 00010282
1688 [ 115.726564] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000001
1689 [ 115.726608] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffffffffa0d8e6a0
1690 [ 115.726651] RBP: ffff88201feb2f60 R08: ffff8810271cda9c R09: ffff8810228abf00
1691 [ 115.726694] R10: 0000000057be43fb R11: ffffffffa0962d90 R12: ffff8820237401b0
1692 [ 115.726737] R13: 0000000000000000 R14: ffff882026564008 R15: ffff8810188dc008
1693 [ 115.726781] FS: 00007f2648777740(0000) GS:ffff88203f280000(0000) knlGS:0000000000000000
1694 [ 115.726829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
1695 [ 115.726865] CR2: 0000000000000000 CR3: 0000001025f3d000 CR4: 00000000001407e0
1696 [ 115.726908] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
1697 [ 115.726951] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
1698 [ 115.726994] Stack:
1699 [ 115.727010] ffff882026564008 ffff8820237401b0 0000000000000000 ffffffffa0962de3
1700 [ 115.728749] ffff88201ad58030 ffff88201ff60008 ffff882026564008 ffffffffa09664ad
1701 [ 115.730483] ffff88201ad58018 ffffffffa0962f39 ffff88201ad58008 0000000000000000
1702 [ 115.732216] Call Trace:
1703 [ 115.734082] [] ? _nv013600rm+0x2b3/0x3b20 [nvidia]
1704 [ 115.735980] [] ? _nv013600rm+0x397d/0x3b20 [nvidia]
1705 [ 115.737874] [] ? _nv013600rm+0x409/0x3b20 [nvidia]
1706 [ 115.739761] [] ? _nv013600rm+0x1825/0x3b20 [nvidia]
1707 [ 115.741639] [] ? _nv013600rm+0x239d/0x3b20 [nvidia]
1708 [ 115.743471] [] ? _nv013690rm+0x67b/0x1370 [nvidia]
1709 [ 115.745240] [] ? _nv012509rm+0xe/0x30 [nvidia]
1710 [ 115.747013] [] ? _nv000982rm+0x9/0x20 [nvidia]
1711 [ 115.748733] [] ? _nv012512rm+0x2f/0x40 [nvidia]
1712 [ 115.750418] [] ? _nv000653rm+0xab3/0x2e30 [nvidia]
1713 [ 115.752097] [] ? _nv008602rm+0xf1/0x160 [nvidia]
1714 [ 115.753729] [] ? _nv000779rm+0x15f/0x250 [nvidia]
1715 [ 115.755428] [] ? _nv000689rm+0x3e8/0x760 [nvidia]
1716 [ 115.757006] [] ? rm_init_adapter+0x6a/0x100 [nvidia]
1717 [ 115.758572] [] ? nvidia_open+0x21f/0x980 [nvidia]
1718 [ 115.760127] [] ? nvidia_frontend_open+0x49/0xa0 [nvidia]
1719 [ 115.761600] [] ? chrdev_open+0xa1/0x1e0
1720 [ 115.763085] [] ? do_dentry_open+0x1a7/0x2e0
1721 [ 115.764568] [] ? cdev_put+0x30/0x30
1722 [ 115.766001] [] ? vfs_open+0x39/0x70
1723 [ 115.767389] [] ? do_last+0x1ed/0x1270
1724 [ 115.768728] [] ? path_openat+0xc2/0x490
1725 [ 115.770040] [] ? do_filp_open+0x4b/0xb0
1726 [ 115.771293] [] ? __alloc_fd+0xa7/0x130
1727 [ 115.772511] [] ? do_sys_open+0xf3/0x1f0
1728 [ 115.773682] [] ? SyS_open+0x1e/0x20
1729 [ 115.774821] [] ? system_call_fastpath+0x16/0x1b
1730 [ 115.775924] Code: 00 00 00 45 31 ed 41 54 49 89 d4 31 d2 53 ff 50 20 be 30 00 00 00 48 8b b8 38 09 00 00 ff 90 50 05 00 00 4d 85 e4 48 89 c3 74 5a <48> 8b 03 48 85 c0 74 38 48 83 b8 40 01 00 00 00 75 0a 5b 41 5c
1731 [ 115.778287] RIP [] _nv003025rm+0x34/0xb0 [nvidia]
1732 [ 115.779445] RSP
1733 [ 115.780487] CR2: 0000000000000000

have you removed the nouveau driver?

before the crash, what is the output of

dmesg |grep NVRM

hi txbob,

nouveau driver must be removed, otherwise, the driver can’t be insmod.

[alvin@hal-dev ~]$ sudo cat </etc/modprobe.d/blacklist-nouveau.conf

RPM Fusion blacklist for nouveau driver - you need to run as root:

dracut -f /boot/initramfs-(uname -r).img (uname -r)

if nouveau is loaded despite this file.

blacklist nouveau

[alvin@hal-dev ~]$ cat < kdump/127.0.0.1-2016-08-24-21:04:03/vmcore-dmesg.txt |grep NVRM
[ 10.783414] NVRM: loading NVIDIA UNIX x86_64 Kernel Module 352.39 Fri Aug 14 18:09:10 PDT 2015
[ 111.687839] NVRM: GPU at PCI:0000:06:00: GPU-3c55dda4-f7c4-3e01-e150-eeabf00703ee
[ 111.687843] NVRM: Xid (PCI:0000:06:00): 62, 15a4(4d98) 00000000 00000000

[alvin@hal-dev ~]$ cat < kdump/127.0.0.1-2016-08-24-21:04:03/vmcore-dmesg.txt |grep nvidia
[ 10.773243] nvidia: module license ‘NVIDIA’ taints kernel.
[ 10.778081] nvidia: module verification failed: signature and/or required key missing - tainting kernel
[ 10.782847] nvidia 0000:06:00.0: enabling device (0140 -> 0142)
[ 10.783396] [drm] Initialized nvidia-drm 0.0.0 20150116 for 0000:06:00.0 on minor 1
[ 110.513253] nvidia 0000:06:00.0: irq 126 for MSI/MSI-X

[alvin@hal-dev ~] lsmod|grep nouveau [alvin@hal-dev ~]

Just to verify nouveau must be removed.

txbob, since I can not attach files, if needed, I can share my dmesg file to you by email.

Actually, there is a nvidia engineer in my company, and she just took a look at this issue, but no ideas.

I am not sure whether it is possible to share us a debugging driver to locate this issue.

The Xid 62 error code indicates a severe problem (obviously).

It may be caused by unstable motherboard hardware.

Can you try plugging the GPU into a different slot? Have you double checked power delivery to the GPU and is your PSU able to deliver sufficient power for the entire system?

Are you certain this is a K40c and not a K40m ? (i.e. does it have a fan?)

txbob, thanks very much.

Actually, x3650 M5 have two PCIe x16 slots, and I have tried to plug in GPU into both slots, but the same error.

I don’t know how to check the power delivery to GPU, but our sever power is 900 W, and the server has 2 CPU, each CPU is 135w.

Our GPU is K40c, it has a fan, and I check the fan works.

BTW, we use a riser card, and I double check it, it is PCIe x16.

Do you have any other systems you can try the K40c in to verify that it is working correctly (or not)?

OK. We have another 3 new M5 server are coming, but the power are all 900W. Our company has a demo, and the server is M5 also, but the power is 1300W, and K40 has no fan. If we can identify it is a power issue, we can buy one power.

So,txbob, you suspect this issue is a power issue, am I right?

I plan to try windows server 2008 to see whether it works or not.

No I don’t really expect that this is a power issue. It might be, but I’m not convinced at this point. At idle, or even when running the nvidia-smi command, the GPU should only be drawing less than 100W.

Do you have the latest firmware in that system? If not can you please update to the latest firmware?

After that, can you run:

asu show

and paste the output into this thread?

hi txbob,

I have updated the firmware to the latest one, but got no lucky.

[alvin@hal-dev asu]$ sudo ./asu64 show
[sudo] password for alvin:
Lenovo Advanced Settings Utility version 10.3.92I
Licensed Materials - Property of Lenovo
© Copyright Lenovo Corp. 2007-2015 All Rights Reserved
Successfully discovered the IMM via SLP.
Discovered IMM at IP address 169.254.95.118
Connected to IMM at IP address 169.254.95.118
IMM.Cert_CSR_Export_Format=DER
IMM.SSH_SERVER_KEY=Installed
IMM.SSL_HTTPS_SERVER_CERT=Private Key and CA-signed cert installed. Expiration: July 11, 2025
IMM.SSL_HTTPS_SERVER_CSR=Private Key and CA-signed cert installed. Expiration: July 11, 2025
IMM.SSL_LDAP_CLIENT_CERT=Private Key and Self-signed cert installed. Expiration: June 14, 2026
IMM.SSL_LDAP_CLIENT_CSR=Private Key and Self-signed cert installed. Expiration: June 14, 2026
IMM.SSL_SERVER_DIRECTOR_CERT=Private Key and CA-signed cert installed. Expiration: July 11, 2025
IMM.SSL_SERVER_DIRECTOR_CSR=Private Key and CA-signed cert installed. Expiration: July 11, 2025
IMM.SSL_SKR_CLIENT_CERT=Cannot get Status. The FOD activation key is not installed!
IMM.SSL_SKR_CLIENT_CSR=Cannot get Status. The FOD activation key is not installed!
IMM.SSL_CLIENT_TRUSTED_CERT_SKR=Cannot get Status. The FOD activation key is not installed!
IMM.SSL_CLIENT_TRUSTED_CERT1=Installed, Expiration: January 01, 2070
IMM.SSL_CLIENT_TRUSTED_CERT2=Not-Installed
IMM.SSL_CLIENT_TRUSTED_CERT3=Not-Installed
IMM.SSL_CLIENT_TRUSTED_CERT4=Not-Installed
IMM.FanSpeedControl=BMC
IMM.DeploymentBoot=Disabled
IMM.MinimalBoot=Disabled
IMM.PowerRestorePolicy=Restore
IMM.ForceBootToUefi=Disabled
IMM.AutoROMPromotion=Enabled
IMM.PowerOnAtSpecifiedTime=0:0:0:0:0
IMM.ShutdownAndPowerOff=WD:HH:MM
IMM.PowerOnServer=WD:HH:MM
IMM.ShutdownAndRestart=WD:HH:MM
IMM.PXE_NextBootEnabled=Disabled
IMM.SystemNextBootMode=Legacy
IMM.TimeZone=GMT+0:00
IMM.DST=Off
IMM.IMMInfo_Name=
IMM.IMMInfo_Contact=
IMM.IMMInfo_Location=
IMM.IMMInfo_RoomId=
IMM.IMMInfo_RackId=
IMM.IMMInfo_Lowest_U=0
IMM.IMMInfo_Height=2
IMM.IMMInfo_BladeBay=0
IMM.IMMInfo_FullPostalAddress=
IMM.OSWatchdog=Disabled
IMM.LoaderWatchdog=Disabled
IMM.PowerOffDelay=Disabled
IMM.NTPAutoSynchronization=Enabled
IMM.NTPHost1=10.96.224.2
IMM.NTPHost2=
IMM.NTPHost3=
IMM.NTPHost4=
IMM.NTPFrequency=17
IMM.LoginId.1=USERID
IMM.LoginId.10=
IMM.LoginId.11=
IMM.LoginId.12=
IMM.LoginId.2=
IMM.LoginId.3=
IMM.LoginId.4=
IMM.LoginId.5=
IMM.LoginId.6=
IMM.LoginId.7=
IMM.LoginId.8=
IMM.LoginId.9=
IMM.AuthorityLevel.1=Supervisor
IMM.UserAccountManagementPriv.1=No
IMM.RemoteConsolePriv.1=No
IMM.RemoteConsoleDiskPriv.1=No
IMM.RemotePowerPriv.1=No
IMM.ClearEventLogPriv.1=No
IMM.BasicAdapterConfigPriv.1=No
IMM.AdapterConfigNetworkSecurityPriv.1=No
IMM.AdvancedAdapterConfigPriv.1=No
IMM.SNMPv3_AuthenticationProtocol.1=NONE
IMM.SNMPv3_PrivacyProtocol.1=NONE
IMM.SNMPv3_AccessType.1=Get
IMM.SNMPv3_TrapHostname.1=
IMM.User_Authentication_Method=LDAP first, then Local
IMM.WebTimeout=20 minutes
IMM.AccountSecurity=Legacy security settings
IMM.LockoutPeriod=2
IMM.LoginPassword=Disabled
IMM.PasswordReuse=Disabled
IMM.ComplexPassword=Disabled
IMM.PasswordAge=0
IMM.MinPasswordLen=0
IMM.PwChangeInterval=0
IMM.PwMaxFailure=5
IMM.PwDiffChar=0
IMM.DefPasswordExp=Disabled
IMM.FirstAccessPwChange=Disabled
IMM.SessionDisconnect_Default=Disabled
IMM.SessionTimeout_Default=60
IMM.RetryLimit=5 times
IMM.EntriesDelay=0.5 minutes
IMM.RetryDelay=0.5 minutes
IMM.SNMPAlerts_CriticalAlert=Disabled
IMM.SNMPAlerts_WarningAlert=Disabled
IMM.SNMPAlerts_SystemAlert=Disabled
IMM.SNMPAlerts_CriticalAlertCategory=none
IMM.SNMPAlerts_WarningAlertCategory=none
IMM.SNMPAlerts_SystemAlertCategory=none
IMM.SerialRedirectionCLIMode1=CLI active / user defined keystroke sequences
IMM.SerialExitCLIKeySequence=^[(
IMM.SerialBaudRate=115200
IMM.CIMOverHTTPPort=5988
IMM.CIMOverHTTPSPort=5989
IMM.HTTPPort=80
IMM.SSLPort=443
IMM.TelnetPort=23
IMM.SSHPort=22
IMM.SNMP_AgentPort=161
IMM.SNMP_TrapPort=162
IMM.RemoteConsolePort=3900
IMM.HttpPortControl=Open
IMM.HttpsPortControl=Open
IMM.CIMOverHttpPortControl=Open
IMM.CIMOverHttpsPortControl=Open
IMM.TelnetLegacyPortControl=Open
IMM.SSHLegacyPortControl=Open
IMM.RemotePresencePortControl=Open
IMM.SNMPAgentPortControl=Open
IMM.SLPPortControl=Open
IMM.FTPDataPortControl=Open
IMM.FTPServerPortControl=Open
IMM.SFTPPortControl=Open
IMM.IMMFTPServerPortControl=Open
IMM.IMMDebugPortControl=Open
IMM.DHCPClientPortControl=Open
IMM.DHCPBootPCClientPortControl=Open
IMM.CMMIPMIPortControl=Open
IMM.LanOverUsb=Enabled
IMM.LanOverUsbIMMIP=169.254.95.118
IMM.LanOverUsbIMMNetmask=255.255.0.0
IMM.LanOverUsbHostIP=169.254.95.120
IMM.PortForwarding=Enabled
IMM.Network1=Enabled
IMM.DHCP1=Disabled
IMM.HostName1=IMM2-0894ef01e055
IMM.HostIPAddress1=10.9.0.205
IMM.HostIPSubnet1=255.255.255.0
IMM.GatewayIPAddress1=10.9.0.1
IMM.SharedNicMode=Dedicated
IMM.FailoverMode=None
IMM.NetworkSettingSync=Enabled
IMM.DHCPAssignedHostname=IMM2-0894ef01e055
IMM.DHCPAssignedHostIP1=10.9.0.205
IMM.DHCPAssignedGateway1=10.9.0.1
IMM.DHCPAssignedNetMask1=255.255.255.0
IMM.DHCPAssignedDomainName=
IMM.DHCPAssignedPrimaryDNS1=0.0.0.0
IMM.DHCPAssignedSecondaryDNS1=0.0.0.0
IMM.DHCPAssignedTertiaryDNS1=0.0.0.0
IMM.IPv6Network1=Enabled
IMM.IPv6Static1=Disabled
IMM.IPv6DHCP1=Enabled
IMM.IPv6Stateless1=Enabled
IMM.IPv6HostIPAddressWithPrefix1=::/64
IMM.IPv6GatewayIPAddress1=::
IMM.IPv6LinkLocalIPAddress1=fe80::0a94:efff:fe01:e055/64
IMM.IPv6StatelessIPAddress1=::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0 ::/0
IMM.IPv6StatelessGateway1=::
IMM.IPv6DHCPAssignedHostIP1=::
IMM.IPv6DHCPAssignedDomainName=
IMM.IPv6DHCPAssignedPrimaryDNS1=::
IMM.IPv6DHCPAssignedSecondaryDNS1=::
IMM.IPv6DHCPAssignedTertiaryDNS1=::
IMM.AutoNegotiate1=Yes
IMM.LANDataRate1=Auto
IMM.Duplex1=Auto
IMM.MTU1=1500
IMM.MACAddress1=08:94:ef:01:e0:55
IMM.BurnedInMacAddress=08:94:ef:01:e0:55
IMM.SNMPv1Agent=Disabled
IMM.SNMPv3Agent=Disabled
IMM.SNMPTraps=Disabled
IMM.Community_Name.1=
IMM.Community_Name.2=
IMM.Community_Name.3=
IMM.Community_AccessType.1=Get
IMM.Community_AccessType.2=Get
IMM.Community_AccessType.3=Get
IMM.Community_HostIPAddress1.1=
IMM.Community_HostIPAddress1.2=
IMM.Community_HostIPAddress1.3=
IMM.Community_HostIPAddress2.1=
IMM.Community_HostIPAddress2.2=
IMM.Community_HostIPAddress2.3=
IMM.Community_HostIPAddress3.1=
IMM.Community_HostIPAddress3.2=
IMM.Community_HostIPAddress3.3=
IMM.DNS_Enable=Disabled
IMM.DNSPreference=IPv6
IMM.DNS_IP_Address1=0.0.0.0
IMM.DNS_IP_Address2=0.0.0.0
IMM.DNS_IP_Address3=0.0.0.0
IMM.IPv6DNS_IP_Address1=::
IMM.IPv6DNS_IP_Address2=::
IMM.IPv6DNS_IP_Address3=::
IMM.DDNS_Enable=Enabled
IMM.DDNSPreference=DHCP
IMM.Custom_Domain=
IMM.TelnetSessions=2
IMM.SMTP_ServerName=4.00588e-11
IMM.SMTP_Port=25
IMM.SMTP_Authentication=Disabled
IMM.SMTP_UserName=
IMM.SMTP_AuthMethod=CRAM-MD5
IMM.SMTP_ReversePath=
IMM.Select_LDAP_Servers=Use Pre-Configured LDAP Servers
IMM.Search_Domain=memberOf
IMM.LDAP_Server1_HostName_IPAddress=10.9.0.1
IMM.LDAP_Server1_Port=50637
IMM.LDAP_Server2_HostName_IPAddress=
IMM.LDAP_Server2_Port=389
IMM.LDAP_Server3_HostName_IPAddress=
IMM.LDAP_Server3_Port=389
IMM.LDAP_Server4_HostName_IPAddress=
IMM.LDAP_Server4_Port=389
IMM.SKR_Server1_HostName_IPAddress=
IMM.SKR_Server1_Port=
IMM.SKR_Server2_HostName_IPAddress=
IMM.SKR_Server2_Port=
IMM.SKR_Server3_HostName_IPAddress=
IMM.SKR_Server3_Port=
IMM.SKR_Server4_HostName_IPAddress=
IMM.SKR_Server4_Port=
IMM.SKR_DEVICE_GROUP=
IMM.Root_DN=ou=Users,dc=ibmbase,dc=com
IMM.UID_Search=cn
IMM.BindingMethod=Bind using Login Credentials
IMM.ClientDN=
IMM.RoleBasedSecurity=Disabled
IMM.ServerTargetName=
IMM.GroupFilter=
IMM.Group_Search_Attribute=memberOf
IMM.AuthorizationMethod=authorization will be done in LDAP Server.
IMM.Forest_Name=
IMM.Login_Permission_Attribute=ibm-chassisRole
IMM.SSL_Server_Enable=Enabled
IMM.CIMXMLOverHTTPS_Enable=Enabled
IMM.SSL_Client_Enable=Enabled
IMM.SSH_Enable=Enabled
IMM.CryptographyMode=Basic
IMM.CryptoSnmpv3Exception=Disabled
IMM.VMMigration_EventCategoryType=custom:error
IMM.VMMigration_EventCategory=custom:memo|cool
SYSTEM_PROD_DATA.SysInfoProdName=5462I4Y
SYSTEM_PROD_DATA.SysInfoProdIdentifier=System x3650 M5:
SYSTEM_PROD_DATA.SysInfoSerialNum=06GCGXA
SYSTEM_PROD_DATA.SysInfoUUID=22792FAC29FF11E5BF850894EF01E050
SYSTEM_PROD_DATA.SysInfoUDI=
SYSTEM_PROD_DATA.SysEncloseAssetTag=
PXE.NicPortMacAddress.1=00:0E:1E:7F:6F:00
PXE.NicPortMacAddress.2=00:0E:1E:7F:6F:02
PXE.NicPortMacAddress.3=08:94:EF:01:E0:50
PXE.NicPortMacAddress.4=08:94:EF:01:E0:51
PXE.NicPortMacAddress.5=08:94:EF:01:E0:52
PXE.NicPortMacAddress.6=08:94:EF:01:E0:53
PXE.NicPortPxeMode.1=Enabled
PXE.NicPortPxeMode.2=Enabled
PXE.NicPortPxeMode.3=Enabled
PXE.NicPortPxeMode.4=Enabled
PXE.NicPortPxeMode.5=Enabled
PXE.NicPortPxeMode.6=Enabled
PXE.NicPortPxeProtocol.1=IPV4
PXE.NicPortPxeProtocol.2=IPV4
PXE.NicPortPxeProtocol.3=IPV4
PXE.NicPortPxeProtocol.4=IPV4
PXE.NicPortPxeProtocol.5=IPV4
PXE.NicPortPxeProtocol.6=IPV4
AdvancedRAS.PCIeIsolation=Disable
POSTAttempts.POSTAttemptsLimit=3
BackupBankManagement.BackupBankManagementMethod=Auto Promotion
BackupBankManagement.NumberOfSuccessfulConsecutiveBoots=53
BackupBankManagement.NumberOfWeeks=52
LegacySupport.ForceLegacyVideoonBoot=Enabled
LegacySupport.RehookINT19h=Disabled
LegacySupport.LegacyThunkSupport=Enabled
LegacySupport.InfiniteBootRetry=Disabled
LegacySupport.BBSBoot=Enabled
LegacySupport.Non-PlanarPXE=Enabled
DiskGPTRecovery.DiskGPTRecovery=Manual
OperatingModes.ChooseOperatingMode=Efficiency - Favor Performance
SystemRecovery.POSTWatchdogTimer=Disable
SystemRecovery.POSTWatchdogTimerValue=5
SystemRecovery.RebootSystemonNMI=Enable
SystemRecovery.HaltOnSevereError=Disable
Memory.MemoryMode=Independent
Memory.Sparing=Disable
Memory.MemorySpeed=Max Performance
Memory.MemoryPowerManagement=Disable
Memory.SocketInterleave=NUMA
Memory.PatrolScrub=Enable
Memory.MemoryDataScrambling=Enable
Memory.PagePolicy=Adaptive
Memory.ColdBootFast=Disable
Processors.TurboMode=Enable
Processors.CPUP-stateControl=Legacy
Processors.C-States=Legacy
Processors.C1EnhancedMode=Enable
Processors.Hyper-Threading=Enable
Processors.ExecuteDisableBit=Enable
Processors.TrustedExecutionTechnology=Disable
Processors.IntelVirtualizationTechnology=Enable
Processors.HardwarePrefetcher=Enable
Processors.AdjacentCachePrefetch=Enable
Processors.DCUStreamerPrefetcher=Enable
Processors.DCUIPPrefetcher=Enable
Processors.DCA=Disable
Processors.EnergyEfficientTurbo=Enable
Processors.UncoreFrequencyScaling=Enable
Processors.MONITORMWAIT=Enable
Processors.QPILinkDisable=Enable All Links
Processors.CODPreference=Disable
Processors.SnoopPreference=Home Snoop
Processors.PerCoreP-state=Enable
Processors.CoresinCPUPackage=All
Processors.QPILinkFrequency=Max Performance
Processors.TurboLimits=Full turbo uplift
Power.ActiveEnergyManager=Capping Enabled
Power.PowerPerformanceBias=Platform Controlled
Power.PlatformControlledType=Efficiency - Favor Performance
Power.WorkloadConfiguration=Balanced
Power.ZeroOutput=Advance Mode
Power.Interval=30 minutes
DevicesandIOPorts.ActiveVideo=Onboard Device
DevicesandIOPorts.PCI64-BitResourceAllocation=Enable
DevicesandIOPorts.MMConfigBase=2GB
DevicesandIOPorts.IntelVTforDirectedIOVT-d=Enable
DevicesandIOPorts.BCM5719LowPowerMode=Disable
DevicesandIOPorts.SetOptionROMExecutionOrder=Ethernet 1=Ethernet 2=Ethernet 3=Ethernet 4=Video=Slot 4=Slot 5=Slot 6=Slot 8=Slot 9
DevicesandIOPorts.Video=Enable
DevicesandIOPorts.EnableDisableOnboardDevices_Slot4=Enable
DevicesandIOPorts.EnableDisableOnboardDevices_Slot5=Enable
DevicesandIOPorts.EnableDisableOnboardDevices_Slot6=Enable
DevicesandIOPorts.EnableDisableOnboardDevices_Slot8=Enable
DevicesandIOPorts.EnableDisableOnboardDevices_Slot9=Enable
DevicesandIOPorts.Legacy_Ethernet1=Enable
DevicesandIOPorts.Legacy_Ethernet2=Enable
DevicesandIOPorts.Legacy_Ethernet3=Enable
DevicesandIOPorts.Legacy_Ethernet4=Enable
DevicesandIOPorts.Legacy_Video=Enable
DevicesandIOPorts.Legacy_Slot4=Enable
DevicesandIOPorts.Legacy_Slot5=Enable
DevicesandIOPorts.Legacy_Slot6=Enable
DevicesandIOPorts.Legacy_Slot8=Enable
DevicesandIOPorts.Legacy_Slot9=Enable
DevicesandIOPorts.UEFI_Ethernet1=Enable
DevicesandIOPorts.UEFI_Ethernet2=Enable
DevicesandIOPorts.UEFI_Ethernet3=Enable
DevicesandIOPorts.UEFI_Ethernet4=Enable
DevicesandIOPorts.UEFI_Video=Enable
DevicesandIOPorts.UEFI_Slot4=Enable
DevicesandIOPorts.UEFI_Slot5=Enable
DevicesandIOPorts.UEFI_Slot6=Enable
DevicesandIOPorts.UEFI_Slot8=Enable
DevicesandIOPorts.UEFI_Slot9=Enable
DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot4=Gen3
DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot5=Gen3
DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot6=Gen3
DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot8=Gen3
DevicesandIOPorts.PCIeGen1Gen2Gen3SpeedSelection_Slot9=Gen3
DevicesandIOPorts.COMPort1=Enable
DevicesandIOPorts.COMPort2=Enable
DevicesandIOPorts.RemoteConsole=Auto
DevicesandIOPorts.SerialPortSharing=Disable
DevicesandIOPorts.SerialPortAccessMode=Disable
DevicesandIOPorts.LegacyOptionROMDisplay=COM Port 1
DevicesandIOPorts.Com1BaudRate=115200
DevicesandIOPorts.Com1DataBits=8
DevicesandIOPorts.Com1Parity=None
DevicesandIOPorts.Com1StopBits=1
DevicesandIOPorts.Com1TerminalEmulation=ANSI
DevicesandIOPorts.Com1ActiveAfterBoot=Disable
DevicesandIOPorts.Com1FlowControl=Disable
DevicesandIOPorts.Com2BaudRate=115200
DevicesandIOPorts.Com2DataBits=8
DevicesandIOPorts.Com2Parity=None
DevicesandIOPorts.Com2StopBits=1
DevicesandIOPorts.Com2TerminalEmulation=ANSI
DevicesandIOPorts.Com2ActiveAfterBoot=Disable
DevicesandIOPorts.Com2FlowControl=Disable
SecureBootConfiguration.SecureBootis=Disabled
BootModes.SystemBootMode=UEFI Mode
BootModes.OptimizedBoot=Enabled
BootModes.QuietBoot=Enabled
BootOrder.BootOrder=CentOS Linux - Boot000E=CentOS=Windows Boot Manager=CentOS Linux - Boot000A=CentOS Linux - Boot0008=CD/DVD Rom=Hard Disk 0=PXE Network
BootOrder.WolBootOrder=PXE Network=CD/DVD Rom=Hard Disk 0
iSCSI.InitiatorName=iqn.1986-03.com.example
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_UCMDataStructureVersion=2
LSIMegaRAIDConfigurationTool-0B0.ControllerName=ServeRAID M5210
LSIMegaRAIDConfigurationTool-0B0.FirmwareVersion=4.270.00-4288
LSIMegaRAIDConfigurationTool-0B0.UEFIBSDVersion=0x060B0201
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_DriveCount=4
LSIMegaRAIDConfigurationTool-0B0.VirtualDriveCount=4
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes
LSIMegaRAIDConfigurationTool-0B0.ProtectionEnabled=Yes
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_RAIDLevel=RAID0
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_DriveCount=1
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Optimal
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Online
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes(2)
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_TargetIDofAssociatedVirtualDrive=3
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Online
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes(2)
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_TargetIDofAssociatedVirtualDrive=2
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Online
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes(2)
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_TargetIDofAssociatedVirtualDrive=1
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Media=HDD
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_InterfaceType=SAS
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_SizeKB=291991552
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_LogicalSectorSize=512B
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_Status=Online
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_ProtectionCapable=Yes(2)
LSIMegaRAIDConfigurationTool-0B0.ControllerSummary_TargetIDofAssociatedVirtualDrive=0
LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_UCMDataStructureVersion=2
LSIMegaRAIDConfigurationTool-0B0.ClearConfiguration=None
LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_RAIDLevel=RAID0
LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_DriveCount=0
LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_Media=None
LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_InterfaceType=None
LSIMegaRAIDConfigurationTool-0B0.SimpleConfiguration_LogicalSectorSize=None
LSIMegaRAIDConfigurationTool-0B0.ProtectVirtualDrive=No
LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_UCMDataStructureVersion=2
LSIMegaRAIDConfigurationTool-0B0.Operation=Save
LSIMegaRAIDConfigurationTool-0B0.ExcludeSystemPDs=No
LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=Dde3E@800020000En0721X:10o20@D014P00@03P000000011M01@@E0@100400080000000000P00oe1_LW@P=20]83L000000002003oD6mbM2082dPy00000000000?l0000000000000000000000000o0000000000000000000000003o0000000000000000000000000?l0000000000000000000000000o0000000000
LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000003o0000000000000000000000P0000000002]BF9H3050000000@820:kL4URF01@0000004:0P1j;A=HUPy0D00000014P80]RXCF9H3050000000AX2000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000410000040hyhR000000400@010z3z8P00000000800@3PcR8000000P030040hyhR000000y0000000090?h00000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=0000003n1@8000010@00000000000000hyhR0000004000002@3n000000000000000000000000oPD200000@410000000000000z3z8P000002000000T0oP00000000000000000000000?h50P0000410P0000000000003PcR80000000000090?h000000000000000000000003n1@8000010@y0000000000000hyhR00000003
LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=0?0ool0o000PyH003PcR80000000020@400P000@80o03oo3o00020aP00z3z8P00000000810@020002003l0?oo0?l000836000hyhR000000000P41008000y10?0ool0o000PyH003PcR80000000020@400P000O0200000010gP1o000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000 LSIMegaRAIDConfigurationTool-0B0.ConfigurationSaveRestore_String=000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000P0000000002]BF9H3050000000@820:kL4URF01@
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.VirtualizationMode=None (pNIC)
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BlinkLEDs=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.LinkStatus=Disconnected
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.PermanentMACAddress=00:0E:1E:7F:6F:00
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.VirtualMACAddress=00:0E:1E:7F:6F:00
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.LegacyBootProtocol=PXE
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BootStrapType=Auto Detect
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.HideSetupPrompt=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SetupKeyStroke=Ctrl-S
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BannerMessageTimeout=5
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.LinkSpeed=10 Gbps Full
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.WakeOnLAN=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.VLANMode=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.VLANID14094=1
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BootRetryCount=No Retry
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.TCPIPParametersviaDHCP=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIParametersviaDHCP=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.CHAPAuthentication=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.BoottoTarget=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.DHCPVendorID=BRCM ISAN
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIGeneralParameters_LinkUpDelayTime=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.UseTCPTimestamp=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIGeneralParameters_TargetasFirstHDD=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIGeneralParameters_LUNBusyRetryCount=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.IPVersion=IPv4
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIInitiatorParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SubnetMask=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SubnetMaskPrefix=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.DefaultGateway=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.PrimaryDNS=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SecondaryDNS=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIInitiatorParameters_iSCSIName=iqn.1995-05.com.broadcom.iscsiboot
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIInitiatorParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIInitiatorParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_Connect=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_TCPPort=3260
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_BootLUN=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_iSCSIName=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIFirstTargetParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_Connect=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_TCPPort=3260
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_BootLUN=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_iSCSIName=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSISecondTargetParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.SecondaryDeviceMACAddress=00:00:00:00:00:00
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.UseIndependentTargetPortal=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.UseIndependentTargetName=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.MFW=7.8.55
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.MBA=7.8.51
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.EFI=7.8.53
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.iSCSIBoot=7.8.51
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.L2FW=7.8.5
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.FCoEBoot=N/A
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.CCM=N/A
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.DCBProtocol=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F00.MaxPFMSI-XVectors=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.VirtualizationMode=None (pNIC)
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BlinkLEDs=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.LinkStatus=Disconnected
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.PermanentMACAddress=00:0E:1E:7F:6F:02
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.VirtualMACAddress=00:0E:1E:7F:6F:02
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.LegacyBootProtocol=PXE
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BootStrapType=Auto Detect
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.HideSetupPrompt=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SetupKeyStroke=Ctrl-S
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BannerMessageTimeout=5
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.LinkSpeed=10 Gbps Full
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.WakeOnLAN=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.VLANMode=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.VLANID14094=1
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BootRetryCount=No Retry
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.TCPIPParametersviaDHCP=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIParametersviaDHCP=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.CHAPAuthentication=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.BoottoTarget=Enabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.DHCPVendorID=BRCM ISAN
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIGeneralParameters_LinkUpDelayTime=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.UseTCPTimestamp=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIGeneralParameters_TargetasFirstHDD=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIGeneralParameters_LUNBusyRetryCount=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.IPVersion=IPv4
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIInitiatorParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SubnetMask=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SubnetMaskPrefix=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.DefaultGateway=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.PrimaryDNS=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SecondaryDNS=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIInitiatorParameters_iSCSIName=iqn.1995-05.com.broadcom.iscsiboot
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIInitiatorParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIInitiatorParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_Connect=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_TCPPort=3260
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_BootLUN=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_iSCSIName=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIFirstTargetParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_Connect=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_IPAddress=0.0.0.0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_TCPPort=3260
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_BootLUN=0
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_iSCSIName=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_CHAPID=
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSISecondTargetParameters_CHAPSecret=********
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.SecondaryDeviceMACAddress=00:00:00:00:00:00
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.UseIndependentTargetPortal=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.UseIndependentTargetName=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.MFW=7.8.55
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.MBA=7.8.51
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.EFI=7.8.53
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.iSCSIBoot=7.8.51
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.L2FW=7.8.5
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.FCoEBoot=N/A
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.CCM=N/A
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.DCBProtocol=Disabled
BroadcomNetXtremeII10GbEthernetBCM57810-000E1E7F6F02.MaxPFMSI-XVectors=0
BroadcomGigabitEthernetBCM5719-0894EF01E050.BlinkLEDs=0
BroadcomGigabitEthernetBCM5719-0894EF01E050.LinkStatus=Disconnected
BroadcomGigabitEthernetBCM5719-0894EF01E050.PermanentMACAddress=08:94:EF:01:E0:50
BroadcomGigabitEthernetBCM5719-0894EF01E050.VirtualMACAddress=08:94:EF:01:E0:50
BroadcomGigabitEthernetBCM5719-0894EF01E050.LegacyBootProtocol=PXE
BroadcomGigabitEthernetBCM5719-0894EF01E050.BootStrapType=Auto Detect
BroadcomGigabitEthernetBCM5719-0894EF01E050.HideSetupPrompt=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E050.SetupKeyStroke=Ctrl-S
BroadcomGigabitEthernetBCM5719-0894EF01E050.BannerMessageTimeout=5
BroadcomGigabitEthernetBCM5719-0894EF01E050.LinkSpeed=AutoNeg
BroadcomGigabitEthernetBCM5719-0894EF01E050.Pre-bootWakeOnLAN=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E050.VLANMode=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E050.VLANID14094=1
BroadcomGigabitEthernetBCM5719-0894EF01E050.Bootcode=1.38
BroadcomGigabitEthernetBCM5719-0894EF01E050.MBA=16.8.0
BroadcomGigabitEthernetBCM5719-0894EF01E050.EFI=16.8.4
BroadcomGigabitEthernetBCM5719-0894EF01E050.iSCSIBoot=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E050.NC-SI=1.3.4
BroadcomGigabitEthernetBCM5719-0894EF01E050.CCM=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E051.BlinkLEDs=0
BroadcomGigabitEthernetBCM5719-0894EF01E051.LinkStatus=Connected
BroadcomGigabitEthernetBCM5719-0894EF01E051.PermanentMACAddress=08:94:EF:01:E0:51
BroadcomGigabitEthernetBCM5719-0894EF01E051.VirtualMACAddress=08:94:EF:01:E0:51
BroadcomGigabitEthernetBCM5719-0894EF01E051.LegacyBootProtocol=PXE
BroadcomGigabitEthernetBCM5719-0894EF01E051.BootStrapType=Auto Detect
BroadcomGigabitEthernetBCM5719-0894EF01E051.HideSetupPrompt=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E051.SetupKeyStroke=Ctrl-S
BroadcomGigabitEthernetBCM5719-0894EF01E051.BannerMessageTimeout=5
BroadcomGigabitEthernetBCM5719-0894EF01E051.LinkSpeed=AutoNeg
BroadcomGigabitEthernetBCM5719-0894EF01E051.Pre-bootWakeOnLAN=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E051.VLANMode=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E051.VLANID14094=1
BroadcomGigabitEthernetBCM5719-0894EF01E051.Bootcode=1.38
BroadcomGigabitEthernetBCM5719-0894EF01E051.MBA=16.8.0
BroadcomGigabitEthernetBCM5719-0894EF01E051.EFI=16.8.4
BroadcomGigabitEthernetBCM5719-0894EF01E051.iSCSIBoot=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E051.NC-SI=1.3.4
BroadcomGigabitEthernetBCM5719-0894EF01E051.CCM=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E052.BlinkLEDs=0
BroadcomGigabitEthernetBCM5719-0894EF01E052.LinkStatus=Disconnected
BroadcomGigabitEthernetBCM5719-0894EF01E052.PermanentMACAddress=08:94:EF:01:E0:52
BroadcomGigabitEthernetBCM5719-0894EF01E052.VirtualMACAddress=08:94:EF:01:E0:52
BroadcomGigabitEthernetBCM5719-0894EF01E052.LegacyBootProtocol=PXE
BroadcomGigabitEthernetBCM5719-0894EF01E052.BootStrapType=Auto Detect
BroadcomGigabitEthernetBCM5719-0894EF01E052.HideSetupPrompt=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E052.SetupKeyStroke=Ctrl-S
BroadcomGigabitEthernetBCM5719-0894EF01E052.BannerMessageTimeout=5
BroadcomGigabitEthernetBCM5719-0894EF01E052.LinkSpeed=AutoNeg
BroadcomGigabitEthernetBCM5719-0894EF01E052.Pre-bootWakeOnLAN=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E052.VLANMode=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E052.VLANID14094=1
BroadcomGigabitEthernetBCM5719-0894EF01E052.Bootcode=1.38
BroadcomGigabitEthernetBCM5719-0894EF01E052.MBA=16.8.0
BroadcomGigabitEthernetBCM5719-0894EF01E052.EFI=16.8.4
BroadcomGigabitEthernetBCM5719-0894EF01E052.iSCSIBoot=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E052.NC-SI=1.3.4
BroadcomGigabitEthernetBCM5719-0894EF01E052.CCM=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E053.BlinkLEDs=0
BroadcomGigabitEthernetBCM5719-0894EF01E053.LinkStatus=Disconnected
BroadcomGigabitEthernetBCM5719-0894EF01E053.PermanentMACAddress=08:94:EF:01:E0:53
BroadcomGigabitEthernetBCM5719-0894EF01E053.VirtualMACAddress=08:94:EF:01:E0:53
BroadcomGigabitEthernetBCM5719-0894EF01E053.LegacyBootProtocol=PXE
BroadcomGigabitEthernetBCM5719-0894EF01E053.BootStrapType=Auto Detect
BroadcomGigabitEthernetBCM5719-0894EF01E053.HideSetupPrompt=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E053.SetupKeyStroke=Ctrl-S
BroadcomGigabitEthernetBCM5719-0894EF01E053.BannerMessageTimeout=5
BroadcomGigabitEthernetBCM5719-0894EF01E053.LinkSpeed=AutoNeg
BroadcomGigabitEthernetBCM5719-0894EF01E053.Pre-bootWakeOnLAN=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E053.VLANMode=Disabled
BroadcomGigabitEthernetBCM5719-0894EF01E053.VLANID14094=1
BroadcomGigabitEthernetBCM5719-0894EF01E053.Bootcode=1.38
BroadcomGigabitEthernetBCM5719-0894EF01E053.MBA=16.8.0
BroadcomGigabitEthernetBCM5719-0894EF01E053.EFI=16.8.4
BroadcomGigabitEthernetBCM5719-0894EF01E053.iSCSIBoot=N/A
BroadcomGigabitEthernetBCM5719-0894EF01E053.NC-SI=1.3.4
BroadcomGigabitEthernetBCM5719-0894EF01E053.CCM=N/A

bob,

I also try to install windows 2008 server on my system x3650 M5, but while I install cuda 7.5, it reports no GPU device detected, so the driver can’t be installed.

One of my colleagues set up a 3650 M5 with K40c and CentOS 7 and didn’t have any trouble. He had this to say:

I tried out my  x3650 M5.
I used both Centos 6.5 (previously installed) and Centos 7.
In both cases, once I had removed nouveau the systems seem to be working correctly.

I do not get any failures when running nvidia-smi or similar.
With nouveau still loading at startup but after removing before running nvidia-smi I would see a failure under v6.5.  I did not try this under v7.0

In all cases I was using NV r352.99 off of nvidia.com.

My x3650 M5 has broadwell processors in it and recent FW.

So I don’t think we’ll be able to help on this forum. You need to be certain that you are installing the driver correctly. That is covered in the linux installation guide. Be sure to remove nouveau, and do not mix package manager install methods with runfile install methods. If you’re unsure, reinstall the OS, then use the runfile installer for 352.99 from nvidia.com

My next steps would be to suggest that you try a different K40c card in that server, and/or try a different server with that K40c card.

You may also want to discuss your issue with Lenovo.

Bob,

Thanks very much. Actually, I have tried several methods, including re-install the OS, use latest 352.99 driver.

BTW, what’s the power of x3650 M5 your colleague use? Since x3650 has configurations with power 900w, 1300w, and 1500w.And one nvidia engineer also sets up a 3650 M5 with K40c, and the power of M5 is 1300w.

FYI
https://devtalk.nvidia.com/default/topic/852598/34x-35x-36x-freeze-at-reboot-shutdown-tty-switch-rcu_sched-self-detected-stall-detected/